Jul 20 19:54:19.802169 ip-10-0-128-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 19:54:19.802183 ip-10-0-128-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 19:54:19.802193 ip-10-0-128-178 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 19:54:19.802524 ip-10-0-128-178 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 19:54:30.774996 ip-10-0-128-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 19:54:30.775009 ip-10-0-128-178 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3887db2f2eca4f7991943f67527b9270 --
Jul 20 19:56:15.292003 ip-10-0-128-178 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 19:56:16.261661 ip-10-0-128-178 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:56:16.261661 ip-10-0-128-178 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 19:56:16.261661 ip-10-0-128-178 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:56:16.261661 ip-10-0-128-178 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 19:56:16.261661 ip-10-0-128-178 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:56:16.261661 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.229780    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 19:56:16.536215 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536184    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:56:16.536215 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536214    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:56:16.536215 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536218    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536222    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536226    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536229    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536232    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536235    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536239    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536243    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536245    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536248    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536251    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536254    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536257    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536260    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536263    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536266    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536269    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536272    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536275    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536278    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:56:16.536341 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536281    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536289    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536292    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536295    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536298    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536301    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536304    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536306    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536309    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536312    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536315    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536318    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536321    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536324    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536328    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536331    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536334    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536337    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536340    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:56:16.536915 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536343    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536346    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536349    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536352    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536355    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536358    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536360    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536363    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536366    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536369    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536372    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536375    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536380    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536385    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536389    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536392    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536394    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536397    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536401    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:56:16.537418 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536405    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536408    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536411    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536413    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536416    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536419    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536422    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536425    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536429    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536431    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536434    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536437    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536440    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536444    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536448    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536452    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536456    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536459    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536463    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536467    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:56:16.537907 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536470    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536473    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536476    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536479    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536482    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536485    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536488    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536490    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536494    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536496    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536499    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536502    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536504    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536509    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536512    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536515    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536517    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536520    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:56:16.538398 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.536523    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539814    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539829    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539833    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539837    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539840    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539843    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539847    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539850    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539853    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539855    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539858    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539861    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539865    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539867    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539870    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539873    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539876    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539879    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539881    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:56:16.539919 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539884    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539888    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539892    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539895    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539898    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539901    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539904    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539906    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539913    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539916    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539919    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539922    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539925    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539928    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539932    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539935    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539937    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539940    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539943    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:56:16.540462 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539946    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539948    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539951    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539953    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539956    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539959    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539962    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539964    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539967    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539970    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539973    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539975    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539978    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539981    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539983    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539987    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539991    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539995    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.539997    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:56:16.540953 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540000    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540003    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540006    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540010    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540012    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540015    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540018    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540021    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540024    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540027    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540029    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540033    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540037    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540040    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540043    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540046    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540049    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540052    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540054    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540058    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:56:16.541420 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540061    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540064    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540069    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540071    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540074    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540077    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540080    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540084    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540087    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540090    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540093    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540096    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540098    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540102    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540104    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540107    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540112    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540116    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540119    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540122    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:56:16.541939 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540125    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540128    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540585    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540591    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540594    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540597    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540600    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540603    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540606    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540609    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540612    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540616    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540619    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540622    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540626    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540629    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540633    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540636    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540639    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540642    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:56:16.542443 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540645    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540648    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540651    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540654    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540656    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540659    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540662    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540665    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540668    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540671    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540674    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540676    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540679    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540682    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540685    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540688    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540691    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540693    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540696    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540699    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:56:16.542956 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540702    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540705    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540707    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540710    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540713    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540716    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540718    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540721    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540724    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540726    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540729    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540732    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540735    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540737    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540740    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540743    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540745    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540748    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540751    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540753    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:56:16.543440 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540758    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540761    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540766    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540768    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540771    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540774    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540777    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540781    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540784    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540787    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540790    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540793    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540796    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540818    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540823    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540827    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540830    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540833    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540836    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540838    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:56:16.543945 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540841    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540844    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540847    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540854    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540857    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540859    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540862    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540865    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540868    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540871    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540874    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540877    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540879    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540882    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540885    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540888    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540891    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540894    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540897    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:56:16.544447 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540899    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.540902    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541030    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541049    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541065    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541070    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541075    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541079    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541085    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541090    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541094    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541097    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541101    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541105    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541108    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541112    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541115    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541118    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541121    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541125    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541129    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541132    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541136    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541139    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 19:56:16.544969 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541143    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541147    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541150    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541154    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541158    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541162    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541165    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541168    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541171    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541175    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541179    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541184    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541187    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541191    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541194    2572 flags.go:64] FLAG: --enable-server="true"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541197    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541203    2572 flags.go:64] FLAG: --event-burst="100"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541211    2572 flags.go:64] FLAG: --event-qps="50"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541214    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541217    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541221    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541225    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541228    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541231    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541235    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 20 19:56:16.545545 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541238    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541241    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541244    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541247    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541250    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541253    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541256    2572 flags.go:64] FLAG: --feature-gates=""
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541260    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541264    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541267    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541271    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541275    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541278    2572 flags.go:64] FLAG: --help="false"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541282    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541285    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541288    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541291    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541295    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541299    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541302    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541306    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541309    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541312    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 19:56:16.546201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541315    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541319    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541322    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541325    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541328    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541331    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541334    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541338    2572 flags.go:64] FLAG: --lock-file=""
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541341    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541344    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541347    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541353    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541356    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541359    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541362    2572 flags.go:64] FLAG: --logging-format="text"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541365    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541369    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541372    2572 flags.go:64] FLAG: --manifest-url=""
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541375    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541379    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541383    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541387    2572 flags.go:64] FLAG: --max-pods="110"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541391    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541394    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541397    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 19:56:16.546796 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541401    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541404    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541407    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541411    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541419    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541422    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541426    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541429    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541432    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541438    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541441    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541445    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541448    2572 flags.go:64] FLAG: --port="10250"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541451    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541455    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dea27139729894b3"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541458    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541461    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541464    2572 flags.go:64] FLAG: --register-node="true"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541467    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541471    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541474    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541477    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541480    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541484    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541487    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 19:56:16.547438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541490    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541493    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541496    2572 flags.go:64] FLAG: --runonce="false"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541499    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541502    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541506    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541509    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541512    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541516    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541520    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541532    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541536    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541539    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541542    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541545    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541549    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541552    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541555    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541562    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541565    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541568    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541572    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541575    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541578    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541581    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 19:56:16.548141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541584    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541587    2572 flags.go:64] FLAG: --v="2"
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541592    2572 flags.go:64] FLAG: --version="false"
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541596    2572 flags.go:64] FLAG: --vmodule=""
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541600    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.541603    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541756    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541761    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541764    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541767    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541770    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541773    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541775    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541779    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541782    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541802    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541807    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541812    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541815    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541819    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541822    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:56:16.548760 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541825    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541829    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541832    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541835    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541838    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541840    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541844    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541847    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541850    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541852    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541855    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541858    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541861    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541863    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541866    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541868    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541871    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541874    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541877    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:56:16.549292 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541879    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541882    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541884    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541887    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541890    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541893    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541896    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541901    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541905    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541908    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541910    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541915    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541918    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541921    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541924    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541927    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541929    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541932    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541935    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:56:16.549816 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541938    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541940    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541943    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541946    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541949    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541952    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541955    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541958    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541960    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541963    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541966    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541968    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541971    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541974    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541977    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541979    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541982    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541985    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541989    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:56:16.550299 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541992    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.541999    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542003    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542006    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542009    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542013    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542016    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542019    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542022    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542025    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542027    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542030    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542033    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542036    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542039    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542043    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542046    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542048    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542051    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542054    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542056    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:56:16.550766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542059    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542062    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542064    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542067    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542070    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.542072    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.542078    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.549196    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.549216    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.549705    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.549714    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549779    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549786    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549789    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549792    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:56:16.551298 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549809    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549813    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549815    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549819    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549822    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549825    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549827    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549830    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549833    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549836    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549839    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549842    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549845    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549848    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549851    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549853    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549856    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549859    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549862    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549865    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:56:16.551681 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549868    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549870    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549873    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549876    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549879    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549883    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549887    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549890    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549893    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549896    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549899    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549902    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549904    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549907    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549909    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549912    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549915    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549917    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549920    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549923    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:56:16.552265 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549925    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549928    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549931    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549933    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549936    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549939    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549941    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549944    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549947    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549949    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549952    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549954    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549957    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549959    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549962    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549965    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549968    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549971    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549974    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:56:16.552766 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549977    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549982    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549986    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549989    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549992    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549995    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.549998    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550003    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550006    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550009    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550012    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550014    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550017    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550020    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550022    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550025    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550028    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550031    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550034    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:56:16.553258 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550036    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550039    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550043    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550047    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550050    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550053    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550056    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550059    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550061    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550064    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550067    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550070    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550073    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550076    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550080    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550082    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:56:16.553741 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550085    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.550090    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550229    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550235    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550238    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550241    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550244    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550247    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550250    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550253    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550255    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550258    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550261    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550263    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550266    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:56:16.554151 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550269    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550271    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550274    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550277    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550280    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550283    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550285    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550288    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550290    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550293    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550296    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550298    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550301    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550304    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550307    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550311    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550314    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550317    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550319    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550324    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:56:16.554543 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550327    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550330    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550333    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550336    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550338    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550341    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550344    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550347    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550350    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550352    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550355    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550358    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550360    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550363    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550365    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550368    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550371    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550374    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550376    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550379    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:56:16.555042 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550382    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550384    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550387    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550389    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550392    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550395    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550397    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550400    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550403    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550405    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550408    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550411    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550413    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550416    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550418    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550422    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550425    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550428    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550431    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:56:16.555567 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550434    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550436    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550439    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550442    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550444    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550447    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550449    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550452    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550455    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550459    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550461    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550464    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550467    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550469    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550472    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550474    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550477    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550480    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550482    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:56:16.556062 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550485    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550488    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550490    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550494    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550496    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550499    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550502    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:16.550504    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.550509    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.550659    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.552623    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.554285    2572 server.go:1019] "Starting client certificate rotation"
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.554405    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:56:16.556519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.555373    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:56:16.557736 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.557719    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:56:16.561834 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.561820    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:56:16.570000 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.569977    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 20 19:56:16.572481 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.572464    2572 log.go:25] "Validated CRI v1 image API"
Jul 20 19:56:16.574663 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.574639    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 19:56:16.578520 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.578497    2572 fs.go:135] Filesystem UUIDs: map[6b860330-8fec-45c8-bcb1-ef6281b88588:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f03d7bd1-1285-472c-acd3-58e1981bb2e7:/dev/nvme0n1p3]
Jul 20 19:56:16.578606 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.578518    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 19:56:16.583095 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.582971    2572 manager.go:216] Machine: {Timestamp:2026-07-20 19:56:16.582467654 +0000 UTC m=+1.165698536 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199414 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec251a96ef7346619cdd21c6f1f98059 SystemUUID:ec251a96-ef73-4661-9cdd-21c6f1f98059 BootID:3887db2f-2eca-4f79-9194-3f67527b9270 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:24:9c:47:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:24:9c:47:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:6a:dd:1c:29:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 19:56:16.583095 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.583084    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 19:56:16.583261 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.583192    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 19:56:16.584932 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.584906    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 19:56:16.585082 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.584932    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 19:56:16.585751 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.585741    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 19:56:16.585785 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.585752    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 19:56:16.585785 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.585760    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:56:16.585785 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.585772    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:56:16.587050 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.587039    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 19:56:16.590960 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.590947    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:56:16.591080 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591071    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 19:56:16.591113 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591101    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 19:56:16.591113 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591110    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 19:56:16.591177 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591127    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 19:56:16.591177 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591136    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 20 19:56:16.591177 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591148    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 19:56:16.591523 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591512    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:56:16.591565 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.591531    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:56:16.592649 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.592626    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:56:16.593633 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.593607    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 19:56:16.595525 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.595511    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 19:56:16.595583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.595543    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 19:56:16.596515 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596497    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 19:56:16.596570 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596518    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 19:56:16.596570 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596527    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 19:56:16.596570 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596536    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 19:56:16.596570 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596554    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 19:56:16.596570 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596563    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 19:56:16.596714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596581    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 19:56:16.596714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596587    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 19:56:16.596714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596594    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 19:56:16.596714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596599    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 19:56:16.596714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596609    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 19:56:16.596714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.596616    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 19:56:16.597348 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.597337    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 19:56:16.597348 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.597347    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 19:56:16.600737 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.600709    2572 server.go:1268] "Started kubelet"
Jul 20 19:56:16.600985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.600819    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 19:56:16.600985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.600878    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 19:56:16.601103 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.600894    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 19:56:16.601554 ip-10-0-128-178 systemd[1]: Started Kubernetes Kubelet.
Jul 20 19:56:16.603736 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.603709    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 19:56:16.603897 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.603873    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 19:56:16.604098 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.604072    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 19:56:16.604217 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.604194    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 19:56:16.605843 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.605826    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 19:56:16.608416 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.608395    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 19:56:16.610029 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.608977    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18c417ab3e7b6bce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-07-20 19:56:16.600681422 +0000 UTC m=+1.183912304,LastTimestamp:2026-07-20 19:56:16.600681422 +0000 UTC m=+1.183912304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}"
Jul 20 19:56:16.610494 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.610471    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 19:56:16.610494 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.610489    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 19:56:16.610636 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.610581    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:16.611323 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.611224    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 19:56:16.611323 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.611246    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 19:56:16.611323 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.611256    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 19:56:16.611547 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.611394    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 19:56:16.611547 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.611405    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 19:56:16.612521 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612502    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 19:56:16.612521 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612519    2572 factory.go:55] Registering systemd factory
Jul 20 19:56:16.612521 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612526    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 20 19:56:16.612828 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612784    2572 factory.go:153] Registering CRI-O factory
Jul 20 19:56:16.612828 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612805    2572 factory.go:223] Registration of the crio container factory successfully
Jul 20 19:56:16.612828 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612831    2572 factory.go:103] Registering Raw factory
Jul 20 19:56:16.613012 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.612847    2572 manager.go:1196] Started watching for new ooms in manager
Jul 20 19:56:16.613289 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.613274    2572 manager.go:349] Starting recovery of all containers
Jul 20 19:56:16.622642 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.622609    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 19:56:16.622743 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.622694    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 19:56:16.624066 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.623975    2572 manager.go:354] Recovery completed
Jul 20 19:56:16.628094 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.628082    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.630474 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.630457    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.630537 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.630487    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.630537 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.630498    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.631047 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.631022    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 19:56:16.631047 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.631040    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 19:56:16.631138 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.631056    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:56:16.631138 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.631064    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.632499 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.632475    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.632592 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.632518    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.632592 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.632541    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.633446 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.633428    2572 policy_none.go:49] "None policy: Start"
Jul 20 19:56:16.633565 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.633553    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 19:56:16.633656 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.633644    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 19:56:16.636100 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.636084    2572 policy_none.go:47] "Start"
Jul 20 19:56:16.639568 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.639400    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18c417ab404204f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-07-20 19:56:16.630473971 +0000 UTC m=+1.213704855,LastTimestamp:2026-07-20 19:56:16.630473971 +0000 UTC m=+1.213704855,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}"
Jul 20 19:56:16.645440 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.645353    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18c417ab40424d01  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-07-20 19:56:16.630492417 +0000 UTC m=+1.213723298,LastTimestamp:2026-07-20 19:56:16.630492417 +0000 UTC m=+1.213723298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}"
Jul 20 19:56:16.652503 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.652480    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nzwhg"
Jul 20 19:56:16.657309 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.657231    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18c417ab4042755d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-07-20 19:56:16.630502749 +0000 UTC m=+1.213733631,LastTimestamp:2026-07-20 19:56:16.630502749 +0000 UTC m=+1.213733631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}"
Jul 20 19:56:16.661646 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.661629    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nzwhg"
Jul 20 19:56:16.663375 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.663293    2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-178.ec2.internal.18c417ab404204f3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18c417ab404204f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-07-20 19:56:16.630473971 +0000 UTC m=+1.213704855,LastTimestamp:2026-07-20 19:56:16.632498372 +0000 UTC m=+1.215729256,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}"
Jul 20 19:56:16.684196 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684181    2572 manager.go:337] "Starting Device Plugin manager"
Jul 20 19:56:16.684287 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.684214    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 19:56:16.684287 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684225    2572 server.go:87] "Starting device plugin registration server"
Jul 20 19:56:16.684492 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684480    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 19:56:16.684535 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684495    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 19:56:16.684627 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684609    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 19:56:16.684725 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684708    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 19:56:16.684725 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.684720    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 19:56:16.685221 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.685202    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 19:56:16.685304 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.685252    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:16.716965 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.716934    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 19:56:16.728164 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.718258    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 19:56:16.728164 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.718297    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 19:56:16.728164 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.718326    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 19:56:16.728164 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.718356    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 19:56:16.728164 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.721432    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:56:16.786113 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.786032    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.787088 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.787068    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.787190 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.787106    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.787190 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.787117    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.787190 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.787144    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.799036 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.799018    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.799093 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.799041    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-178.ec2.internal\": node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:16.818586 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.818558    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"]
Jul 20 19:56:16.818685 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.818622    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.820072 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.820058    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.820131 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.820087    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.820131 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.820097    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.822203 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822192    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.822344 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822328    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.822383 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822367    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.822884 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822864    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.822987 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822898    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.822987 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822907    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.822987 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822931    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.822987 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822941    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.822987 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.822912    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.825009 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.824994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.825059 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.825022    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:56:16.825685 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.825668    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:56:16.825765 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.825697    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:56:16.825765 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:16.825713    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:56:16.840551 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.840529    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:16.845372 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.845355    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-178.ec2.internal\" not found" node="ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.848876 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.848859    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-178.ec2.internal\" not found" node="ip-10-0-128-178.ec2.internal"
Jul 20 19:56:16.941912 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:16.941879    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.012519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.012483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33194a3215b528c9d931b2bdc04c62bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"33194a3215b528c9d931b2bdc04c62bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.012519 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.012517    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5414ab3db9e2c55023fc7625a31b52c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"f5414ab3db9e2c55023fc7625a31b52c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.012711 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.012538    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33194a3215b528c9d931b2bdc04c62bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"33194a3215b528c9d931b2bdc04c62bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.043986 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.043919    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.112665 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.112615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33194a3215b528c9d931b2bdc04c62bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"33194a3215b528c9d931b2bdc04c62bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.112776 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.112686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33194a3215b528c9d931b2bdc04c62bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"33194a3215b528c9d931b2bdc04c62bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.112776 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.112695    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33194a3215b528c9d931b2bdc04c62bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"33194a3215b528c9d931b2bdc04c62bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.112776 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.112718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5414ab3db9e2c55023fc7625a31b52c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"f5414ab3db9e2c55023fc7625a31b52c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.112883 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.112796    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33194a3215b528c9d931b2bdc04c62bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"33194a3215b528c9d931b2bdc04c62bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.112883 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.112797    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5414ab3db9e2c55023fc7625a31b52c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"f5414ab3db9e2c55023fc7625a31b52c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.146284 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.146248    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.148618 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.148600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.151983 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.151961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.247488 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.247441    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.349935 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.349841    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.451065 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.451025    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.553371 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.553331    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.553482 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.553377    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 19:56:17.553548 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.553529    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:56:17.654472 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:17.654389    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found"
Jul 20 19:56:17.666416 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.666386    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:51:16 +0000 UTC" deadline="2028-05-07 03:28:30.304505096 +0000 UTC"
Jul 20 19:56:17.666485 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.666417    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15751h32m12.638091484s"
Jul 20 19:56:17.687968 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.687940    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:56:17.723507 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.723484    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:56:17.747783 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.747756    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:56:17.810978 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.810948    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.831529 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.831499    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:56:17.832620 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.832601    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"
Jul 20 19:56:17.844708 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.844687    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:56:17.905018 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:17.904949    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33194a3215b528c9d931b2bdc04c62bf.slice/crio-b3acfded7bad34307ed47027449a36d3255b19d3c30e2347afc548ac96a85a44 WatchSource:0}: Error finding container b3acfded7bad34307ed47027449a36d3255b19d3c30e2347afc548ac96a85a44: Status 404 returned error can't find the container with id b3acfded7bad34307ed47027449a36d3255b19d3c30e2347afc548ac96a85a44
Jul 20 19:56:17.916709 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:17.916687    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:56:17.922613 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:17.922588    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5414ab3db9e2c55023fc7625a31b52c.slice/crio-7494a33259721bb8ffc516878fcc66408c1a08b05ad894ce36011145a6fa158a WatchSource:0}: Error finding container 7494a33259721bb8ffc516878fcc66408c1a08b05ad894ce36011145a6fa158a: Status 404 returned error can't find the container with id 7494a33259721bb8ffc516878fcc66408c1a08b05ad894ce36011145a6fa158a
Jul 20 19:56:18.592338 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.592314    2572 apiserver.go:52] "Watching apiserver"
Jul 20 19:56:18.598616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.598597    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 19:56:18.598988 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.598967    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9hj8b","kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-s2hb5","openshift-network-diagnostics/network-check-target-w85j4","openshift-network-operator/iptables-alerter-7dnxw","openshift-ovn-kubernetes/ovnkube-node-79v8f","kube-system/konnectivity-agent-sz5wh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l","openshift-cluster-node-tuning-operator/tuned-8979p","openshift-dns/node-resolver-9h22n","openshift-image-registry/node-ca-fzhh6","openshift-multus/multus-qzb5d","openshift-multus/network-metrics-daemon-47d7r"]
Jul 20 19:56:18.601677 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.601662    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.603723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.603703    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.603922 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.603902    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5lgnk\""
Jul 20 19:56:18.604569 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.604554    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 19:56:18.604674 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.604660    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.604708 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.604672    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.605994 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.605976    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.606595 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.606574    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vt98k\""
Jul 20 19:56:18.606691 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.606574    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.606914 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.606898    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.608204 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.608079    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.609765 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.609731    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 19:56:18.609876 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.609806    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 19:56:18.609918 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.609883    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.610844 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.610504    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qmtnp\""
Jul 20 19:56:18.610844 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.610546    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:18.610844 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.610635    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:18.611049 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.610960    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 19:56:18.612270 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.611143    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 19:56:18.613668 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.613647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.613756 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.613718    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:18.614241 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614218    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.614344 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614253    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 19:56:18.614344 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614326    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 19:56:18.614606 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614589    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 19:56:18.614678 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614663    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.614876 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614854    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 19:56:18.614876 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614870    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5sqpb\""
Jul 20 19:56:18.615001 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.614887    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.615955 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.615936    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.617968 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.617946    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 19:56:18.618063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.617992    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4rzbm\""
Jul 20 19:56:18.618063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.617952    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 19:56:18.618251 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.618236    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.620542 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.620523    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.620542 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.620540    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.620681 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.620601    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 19:56:18.620904 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.620890    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.621220 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621203    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dvd6n\""
Jul 20 19:56:18.621707 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-ovnkube-config\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.621812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621713    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-os-release\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.621812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.621812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-ovn\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.621812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-env-overrides\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.621812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-cnibin\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621853    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621878    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnld\" (UniqueName: \"kubernetes.io/projected/8a56d85e-03d1-4801-af1f-1ab780210e98-kube-api-access-8jnld\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c9992d0-737f-460d-91e2-c99281caa72b-hosts-file\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-log-socket\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-run-ovn-kubernetes\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-cni-bin\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0aa018f-4961-41a1-a6db-eb09001bf816-ovn-node-metrics-cert\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.621987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jh85\" (UniqueName: \"kubernetes.io/projected/f0aa018f-4961-41a1-a6db-eb09001bf816-kube-api-access-7jh85\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6fe97ec9-b7e1-496f-add0-f616a228e390-kubelet-config\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.622054 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dea52d85-a77f-4eab-ba5b-a47e38f147eb-iptables-alerter-script\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dea52d85-a77f-4eab-ba5b-a47e38f147eb-host-slash\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-systemd\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-ovnkube-script-lib\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622146    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-system-cni-dir\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622211    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzrwj\" (UniqueName: \"kubernetes.io/projected/dea52d85-a77f-4eab-ba5b-a47e38f147eb-kube-api-access-kzrwj\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvrr\" (UniqueName: \"kubernetes.io/projected/8c9992d0-737f-460d-91e2-c99281caa72b-kube-api-access-wqvrr\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-systemd-units\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c9992d0-737f-460d-91e2-c99281caa72b-tmp-dir\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622307    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-kubelet\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622330    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-run-netns\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-cni-netd\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6fe97ec9-b7e1-496f-add0-f616a228e390-dbus\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622410    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-slash\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.622583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622458    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-etc-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-var-lib-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-node-log\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622548    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.622967    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.623210    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.623458 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.623451    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.623921 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.623493    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-298nb\""
Jul 20 19:56:18.624920 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.624903    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 19:56:18.625148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.625132    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 19:56:18.625219 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.625152    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 19:56:18.625401 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.625386    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.625401 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.625398    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v5j9q\""
Jul 20 19:56:18.625651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.625634    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:56:18.627669 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.627654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:18.627753 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.627709    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:18.629194 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.629172    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 19:56:18.629589 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.629572    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ppbws\""
Jul 20 19:56:18.664321 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.664303    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fglx6"
Jul 20 19:56:18.693193 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.693171    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fglx6"
Jul 20 19:56:18.702024 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.702007    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:56:18.712373 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.712353    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 19:56:18.722130 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722079    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" event={"ID":"f5414ab3db9e2c55023fc7625a31b52c","Type":"ContainerStarted","Data":"7494a33259721bb8ffc516878fcc66408c1a08b05ad894ce36011145a6fa158a"}
Jul 20 19:56:18.722696 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-systemd\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.722838 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:18.722838 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-systemd\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.722838 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqr69\" (UniqueName: \"kubernetes.io/projected/b2ceedd5-55de-41d6-a0a0-45de41a8b261-kube-api-access-cqr69\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:18.722838 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.722838 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722802    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-registration-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.722838 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-lib-modules\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722850    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-socket-dir-parent\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722878    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-cni-bin\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c9992d0-737f-460d-91e2-c99281caa72b-tmp-dir\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-socket-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-tmp\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.722985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-os-release\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-conf-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-kubelet\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-tuned\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723106    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"33194a3215b528c9d931b2bdc04c62bf","Type":"ContainerStarted","Data":"b3acfded7bad34307ed47027449a36d3255b19d3c30e2347afc548ac96a85a44"}
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ww4n\" (UniqueName: \"kubernetes.io/projected/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-kube-api-access-2ww4n\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-kubelet\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-system-cni-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-cnibin\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723169 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysctl-d\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/872437eb-bba0-4f92-9c9e-3734c274cd28-cni-binary-copy\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723200    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c9992d0-737f-460d-91e2-c99281caa72b-tmp-dir\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-etc-kubernetes\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-kubernetes\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-var-lib-kubelet\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-cni-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-kubelet\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-multus-certs\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/719b562b-5156-41d3-944a-21f94c3fead4-konnectivity-ca\") pod \"konnectivity-agent-sz5wh\" (UID: \"719b562b-5156-41d3-944a-21f94c3fead4\") " pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723416    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-ovnkube-config\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-serviceca\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723457    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-k8s-cni-cncf-io\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-cni-multus\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.723717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723486    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-ovn\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-env-overrides\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-cni-bin\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-ovn\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723556    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0aa018f-4961-41a1-a6db-eb09001bf816-ovn-node-metrics-cert\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-cni-bin\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dea52d85-a77f-4eab-ba5b-a47e38f147eb-iptables-alerter-script\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-run\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-daemon-config\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-ovnkube-script-lib\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-system-cni-dir\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723696    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzrwj\" (UniqueName: \"kubernetes.io/projected/dea52d85-a77f-4eab-ba5b-a47e38f147eb-kube-api-access-kzrwj\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723768    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysconfig\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-systemd-units\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723789    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-system-cni-dir\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.724488 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-sys-fs\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-modprobe-d\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-host\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723894    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.723979    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-ovnkube-config\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-env-overrides\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.724045    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:19.224026611 +0000 UTC m=+3.807257479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.723897    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxlm\" (UniqueName: \"kubernetes.io/projected/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-kube-api-access-lxxlm\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-systemd-units\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-run-netns\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-cni-netd\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724136    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dea52d85-a77f-4eab-ba5b-a47e38f147eb-iptables-alerter-script\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-cni-netd\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-run-netns\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724192    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0aa018f-4961-41a1-a6db-eb09001bf816-ovnkube-script-lib\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725233 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6fe97ec9-b7e1-496f-add0-f616a228e390-dbus\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-device-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-slash\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724341    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-hostroot\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-etc-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6fe97ec9-b7e1-496f-add0-f616a228e390-dbus\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724455    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-var-lib-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-node-log\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724509    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-os-release\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724369    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-slash\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-var-lib-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnld\" (UniqueName: \"kubernetes.io/projected/8a56d85e-03d1-4801-af1f-1ab780210e98-kube-api-access-8jnld\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724571    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.725723 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724599    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-os-release\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/719b562b-5156-41d3-944a-21f94c3fead4-agent-certs\") pod \"konnectivity-agent-sz5wh\" (UID: \"719b562b-5156-41d3-944a-21f94c3fead4\") " pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-systemd\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-node-log\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-etc-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724662    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-cnibin\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c9992d0-737f-460d-91e2-c99281caa72b-hosts-file\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6nb\" (UniqueName: \"kubernetes.io/projected/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-kube-api-access-fn6nb\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-host\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724782    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a56d85e-03d1-4801-af1f-1ab780210e98-cnibin\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-netns\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724823    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7ms\" (UniqueName: \"kubernetes.io/projected/872437eb-bba0-4f92-9c9e-3734c274cd28-kube-api-access-nr7ms\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724835    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-run-openvswitch\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-log-socket\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724874    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-run-ovn-kubernetes\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jh85\" (UniqueName: \"kubernetes.io/projected/f0aa018f-4961-41a1-a6db-eb09001bf816-kube-api-access-7jh85\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724907    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c9992d0-737f-460d-91e2-c99281caa72b-hosts-file\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6fe97ec9-b7e1-496f-add0-f616a228e390-kubelet-config\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724935    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-host-run-ovn-kubernetes\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dea52d85-a77f-4eab-ba5b-a47e38f147eb-host-slash\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724950    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0aa018f-4961-41a1-a6db-eb09001bf816-log-socket\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvrr\" (UniqueName: \"kubernetes.io/projected/8c9992d0-737f-460d-91e2-c99281caa72b-kube-api-access-wqvrr\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724989    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysctl-conf\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6fe97ec9-b7e1-496f-add0-f616a228e390-kubelet-config\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.725009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-sys\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.724996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dea52d85-a77f-4eab-ba5b-a47e38f147eb-host-slash\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.726700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.725007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a56d85e-03d1-4801-af1f-1ab780210e98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.727052 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.726886    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0aa018f-4961-41a1-a6db-eb09001bf816-ovn-node-metrics-cert\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.736800 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.736777    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzrwj\" (UniqueName: \"kubernetes.io/projected/dea52d85-a77f-4eab-ba5b-a47e38f147eb-kube-api-access-kzrwj\") pod \"iptables-alerter-7dnxw\" (UID: \"dea52d85-a77f-4eab-ba5b-a47e38f147eb\") " pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.741368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.741344    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:56:18.741368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.741371    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:56:18.741528 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.741384    2572 projected.go:196] Error preparing data for projected volume kube-api-access-bd6jb for pod openshift-network-diagnostics/network-check-target-w85j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:18.741528 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.741438    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb podName:c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:19.241425343 +0000 UTC m=+3.824656210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bd6jb" (UniqueName: "kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb") pod "network-check-target-w85j4" (UID: "c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:18.743181 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.743143    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvrr\" (UniqueName: \"kubernetes.io/projected/8c9992d0-737f-460d-91e2-c99281caa72b-kube-api-access-wqvrr\") pod \"node-resolver-9h22n\" (UID: \"8c9992d0-737f-460d-91e2-c99281caa72b\") " pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.743887 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.743865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jh85\" (UniqueName: \"kubernetes.io/projected/f0aa018f-4961-41a1-a6db-eb09001bf816-kube-api-access-7jh85\") pod \"ovnkube-node-79v8f\" (UID: \"f0aa018f-4961-41a1-a6db-eb09001bf816\") " pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.743982 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.743963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnld\" (UniqueName: \"kubernetes.io/projected/8a56d85e-03d1-4801-af1f-1ab780210e98-kube-api-access-8jnld\") pod \"multus-additional-cni-plugins-s2hb5\" (UID: \"8a56d85e-03d1-4801-af1f-1ab780210e98\") " pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.825687 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-registration-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.825687 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-lib-modules\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825706    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-socket-dir-parent\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-cni-bin\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825756    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-socket-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-tmp\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825797    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-os-release\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-registration-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-socket-dir-parent\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825846    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-conf-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-cni-bin\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825864    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-os-release\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825875    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-tuned\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825886    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-lib-modules\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825911    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-conf-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825911    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-socket-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.825931 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ww4n\" (UniqueName: \"kubernetes.io/projected/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-kube-api-access-2ww4n\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-system-cni-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.825986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-cnibin\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826010    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysctl-d\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/872437eb-bba0-4f92-9c9e-3734c274cd28-cni-binary-copy\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826035    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-system-cni-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-cnibin\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-etc-kubernetes\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-etc-kubernetes\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-kubernetes\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-kubernetes\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-var-lib-kubelet\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826151    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysctl-d\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826167    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-var-lib-kubelet\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-cni-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826200    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-kubelet\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-cni-dir\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-multus-certs\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.826616 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/719b562b-5156-41d3-944a-21f94c3fead4-konnectivity-ca\") pod \"konnectivity-agent-sz5wh\" (UID: \"719b562b-5156-41d3-944a-21f94c3fead4\") " pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826254    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-kubelet\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826279    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-serviceca\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-k8s-cni-cncf-io\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-multus-certs\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-cni-multus\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-run\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826380    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-daemon-config\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-k8s-cni-cncf-io\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826420    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysconfig\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-sys-fs\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-modprobe-d\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826489    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-host\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxlm\" (UniqueName: \"kubernetes.io/projected/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-kube-api-access-lxxlm\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-device-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-hostroot\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826631    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/719b562b-5156-41d3-944a-21f94c3fead4-agent-certs\") pod \"konnectivity-agent-sz5wh\" (UID: \"719b562b-5156-41d3-944a-21f94c3fead4\") " pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.827306 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-systemd\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6nb\" (UniqueName: \"kubernetes.io/projected/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-kube-api-access-fn6nb\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-host\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-netns\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826811    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-serviceca\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826811    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/872437eb-bba0-4f92-9c9e-3734c274cd28-cni-binary-copy\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826814    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ms\" (UniqueName: \"kubernetes.io/projected/872437eb-bba0-4f92-9c9e-3734c274cd28-kube-api-access-nr7ms\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826861    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-run\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysctl-conf\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826902    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-var-lib-cni-multus\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-sys\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826928    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/872437eb-bba0-4f92-9c9e-3734c274cd28-multus-daemon-config\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826973    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-sys\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.826934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.827005    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827015    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysctl-conf\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:18.827070    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:19.327053346 +0000 UTC m=+3.910284218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:18.828162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827057    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-sysconfig\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827105    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-modprobe-d\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827007    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqr69\" (UniqueName: \"kubernetes.io/projected/b2ceedd5-55de-41d6-a0a0-45de41a8b261-kube-api-access-cqr69\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827148    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-systemd\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-host\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-device-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-host\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-hostroot\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/872437eb-bba0-4f92-9c9e-3734c274cd28-host-run-netns\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827313    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-sys-fs\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.827775    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/719b562b-5156-41d3-944a-21f94c3fead4-konnectivity-ca\") pod \"konnectivity-agent-sz5wh\" (UID: \"719b562b-5156-41d3-944a-21f94c3fead4\") " pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.828359    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-etc-tuned\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.828775 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.828622    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-tmp\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.829324 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.829308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/719b562b-5156-41d3-944a-21f94c3fead4-agent-certs\") pod \"konnectivity-agent-sz5wh\" (UID: \"719b562b-5156-41d3-944a-21f94c3fead4\") " pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.842218 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.842191    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7ms\" (UniqueName: \"kubernetes.io/projected/872437eb-bba0-4f92-9c9e-3734c274cd28-kube-api-access-nr7ms\") pod \"multus-qzb5d\" (UID: \"872437eb-bba0-4f92-9c9e-3734c274cd28\") " pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.842600 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.842542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ww4n\" (UniqueName: \"kubernetes.io/projected/cbd270e2-d4f5-411d-9e01-3b62c96d5e0e-kube-api-access-2ww4n\") pod \"tuned-8979p\" (UID: \"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e\") " pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.843209 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.843186    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqr69\" (UniqueName: \"kubernetes.io/projected/b2ceedd5-55de-41d6-a0a0-45de41a8b261-kube-api-access-cqr69\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:18.843461 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.843444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6nb\" (UniqueName: \"kubernetes.io/projected/80d984c8-dd2a-42fb-8688-8fdeda9ca00a-kube-api-access-fn6nb\") pod \"aws-ebs-csi-driver-node-cwh2l\" (UID: \"80d984c8-dd2a-42fb-8688-8fdeda9ca00a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.844563 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.844541    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxlm\" (UniqueName: \"kubernetes.io/projected/e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4-kube-api-access-lxxlm\") pod \"node-ca-fzhh6\" (UID: \"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4\") " pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.912532 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.912499    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7dnxw"
Jul 20 19:56:18.919808 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.919784    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9h22n"
Jul 20 19:56:18.922128 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.922101    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea52d85_a77f_4eab_ba5b_a47e38f147eb.slice/crio-61d40537c1a8df7543b7449c9f9ec7814080af756aec16f4bee385116eac6f67 WatchSource:0}: Error finding container 61d40537c1a8df7543b7449c9f9ec7814080af756aec16f4bee385116eac6f67: Status 404 returned error can't find the container with id 61d40537c1a8df7543b7449c9f9ec7814080af756aec16f4bee385116eac6f67
Jul 20 19:56:18.926700 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.926679    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:18.931481 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.931435    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9992d0_737f_460d_91e2_c99281caa72b.slice/crio-fda29960a057f7a0ca91d475e680268fa1bac7db70e01ebb131aeb536f87626a WatchSource:0}: Error finding container fda29960a057f7a0ca91d475e680268fa1bac7db70e01ebb131aeb536f87626a: Status 404 returned error can't find the container with id fda29960a057f7a0ca91d475e680268fa1bac7db70e01ebb131aeb536f87626a
Jul 20 19:56:18.931598 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.931520    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2hb5"
Jul 20 19:56:18.936913 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.936895    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:18.938322 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.938302    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0aa018f_4961_41a1_a6db_eb09001bf816.slice/crio-5dea4b29ecc0cd24853c1d7c85940ee15030b28921ecfbf3bd71bbdfd95ee8c8 WatchSource:0}: Error finding container 5dea4b29ecc0cd24853c1d7c85940ee15030b28921ecfbf3bd71bbdfd95ee8c8: Status 404 returned error can't find the container with id 5dea4b29ecc0cd24853c1d7c85940ee15030b28921ecfbf3bd71bbdfd95ee8c8
Jul 20 19:56:18.943679 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.943659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l"
Jul 20 19:56:18.948685 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.948657    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8979p"
Jul 20 19:56:18.951209 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.951121    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719b562b_5156_41d3_944a_21f94c3fead4.slice/crio-ebf633f5e581aca9c72fe78dd0b6f2766b3b2454c5b0706a49311cfc6f29a304 WatchSource:0}: Error finding container ebf633f5e581aca9c72fe78dd0b6f2766b3b2454c5b0706a49311cfc6f29a304: Status 404 returned error can't find the container with id ebf633f5e581aca9c72fe78dd0b6f2766b3b2454c5b0706a49311cfc6f29a304
Jul 20 19:56:18.953332 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.953310    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fzhh6"
Jul 20 19:56:18.953566 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.953534    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d984c8_dd2a_42fb_8688_8fdeda9ca00a.slice/crio-bb305bc82195e2fccf45b96e8e0305449484e2ef2e27591ec62026285a1a3786 WatchSource:0}: Error finding container bb305bc82195e2fccf45b96e8e0305449484e2ef2e27591ec62026285a1a3786: Status 404 returned error can't find the container with id bb305bc82195e2fccf45b96e8e0305449484e2ef2e27591ec62026285a1a3786
Jul 20 19:56:18.958349 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:18.958197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzb5d"
Jul 20 19:56:18.958748 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.958699    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd270e2_d4f5_411d_9e01_3b62c96d5e0e.slice/crio-47c169873aa6dcf185149eebdd8a3dd5f1e5f1f1ca03251dd89f959f646beb85 WatchSource:0}: Error finding container 47c169873aa6dcf185149eebdd8a3dd5f1e5f1f1ca03251dd89f959f646beb85: Status 404 returned error can't find the container with id 47c169873aa6dcf185149eebdd8a3dd5f1e5f1f1ca03251dd89f959f646beb85
Jul 20 19:56:18.965451 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.965428    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fc6eea_f7e9_49a0_a320_62d3e65f9fb4.slice/crio-7d5e6031766a0b07fa080726feba3b3d314010d3ac09f3948ea22f06df407a3f WatchSource:0}: Error finding container 7d5e6031766a0b07fa080726feba3b3d314010d3ac09f3948ea22f06df407a3f: Status 404 returned error can't find the container with id 7d5e6031766a0b07fa080726feba3b3d314010d3ac09f3948ea22f06df407a3f
Jul 20 19:56:18.969314 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:18.969291    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872437eb_bba0_4f92_9c9e_3734c274cd28.slice/crio-d1e842d66495dcdca8afbdc10436dbeec40de7f99185b08c90de45b984717cfa WatchSource:0}: Error finding container d1e842d66495dcdca8afbdc10436dbeec40de7f99185b08c90de45b984717cfa: Status 404 returned error can't find the container with id d1e842d66495dcdca8afbdc10436dbeec40de7f99185b08c90de45b984717cfa
Jul 20 19:56:19.230696 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.230610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:19.231093 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.230899    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:19.231093 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.231045    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:20.231020076 +0000 UTC m=+4.814250962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:19.331324 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.331291    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:19.331495 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.331350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:19.331495 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.331480    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:19.331604 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.331541    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:20.331524494 +0000 UTC m=+4.914755376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:19.332002 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.331876    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:56:19.332002 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.331904    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:56:19.332002 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.331918    2572 projected.go:196] Error preparing data for projected volume kube-api-access-bd6jb for pod openshift-network-diagnostics/network-check-target-w85j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:19.332002 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:19.331975    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb podName:c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:20.331957112 +0000 UTC m=+4.915188026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd6jb" (UniqueName: "kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb") pod "network-check-target-w85j4" (UID: "c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:19.696897 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.696805    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:51:18 +0000 UTC" deadline="2028-04-16 10:54:12.17069025 +0000 UTC"
Jul 20 19:56:19.696897 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.696847    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15254h57m52.473847005s"
Jul 20 19:56:19.727332 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.727294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzb5d" event={"ID":"872437eb-bba0-4f92-9c9e-3734c274cd28","Type":"ContainerStarted","Data":"d1e842d66495dcdca8afbdc10436dbeec40de7f99185b08c90de45b984717cfa"}
Jul 20 19:56:19.728768 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.728694    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fzhh6" event={"ID":"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4","Type":"ContainerStarted","Data":"7d5e6031766a0b07fa080726feba3b3d314010d3ac09f3948ea22f06df407a3f"}
Jul 20 19:56:19.730098 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.730035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8979p" event={"ID":"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e","Type":"ContainerStarted","Data":"47c169873aa6dcf185149eebdd8a3dd5f1e5f1f1ca03251dd89f959f646beb85"}
Jul 20 19:56:19.732419 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.732195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sz5wh" event={"ID":"719b562b-5156-41d3-944a-21f94c3fead4","Type":"ContainerStarted","Data":"ebf633f5e581aca9c72fe78dd0b6f2766b3b2454c5b0706a49311cfc6f29a304"}
Jul 20 19:56:19.733769 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.733737    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"5dea4b29ecc0cd24853c1d7c85940ee15030b28921ecfbf3bd71bbdfd95ee8c8"}
Jul 20 19:56:19.735491 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.735463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9h22n" event={"ID":"8c9992d0-737f-460d-91e2-c99281caa72b","Type":"ContainerStarted","Data":"fda29960a057f7a0ca91d475e680268fa1bac7db70e01ebb131aeb536f87626a"}
Jul 20 19:56:19.737008 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.736984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7dnxw" event={"ID":"dea52d85-a77f-4eab-ba5b-a47e38f147eb","Type":"ContainerStarted","Data":"61d40537c1a8df7543b7449c9f9ec7814080af756aec16f4bee385116eac6f67"}
Jul 20 19:56:19.738509 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.738483    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l" event={"ID":"80d984c8-dd2a-42fb-8688-8fdeda9ca00a","Type":"ContainerStarted","Data":"bb305bc82195e2fccf45b96e8e0305449484e2ef2e27591ec62026285a1a3786"}
Jul 20 19:56:19.739858 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:19.739832    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerStarted","Data":"6bd60354c616c6fd06fd84676166f2e59cc20c890c8c6c56ca55f5dcb8a476f4"}
Jul 20 19:56:20.238647 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.238611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:20.238835 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.238801    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:20.238912 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.238867    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:22.238849651 +0000 UTC m=+6.822080523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:20.339618 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.339586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:20.339792 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.339637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:20.339792 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.339760    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:20.339905 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.339819    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:22.339801852 +0000 UTC m=+6.923032731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:20.340183 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.340069    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:56:20.340183 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.340095    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:56:20.340183 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.340108    2572 projected.go:196] Error preparing data for projected volume kube-api-access-bd6jb for pod openshift-network-diagnostics/network-check-target-w85j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:20.340183 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.340156    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb podName:c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:22.340140452 +0000 UTC m=+6.923371328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd6jb" (UniqueName: "kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb") pod "network-check-target-w85j4" (UID: "c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:20.697537 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.697450    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:51:18 +0000 UTC" deadline="2028-04-15 01:45:56.591709042 +0000 UTC"
Jul 20 19:56:20.697537 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.697492    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15221h49m35.894221417s"
Jul 20 19:56:20.723597 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.721433    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:20.723597 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.721563    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:20.723597 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.721964    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:20.723597 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.722065    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:20.723597 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:20.722140    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:20.723597 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:20.722225    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:21.795541 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:21.794874    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" event={"ID":"f5414ab3db9e2c55023fc7625a31b52c","Type":"ContainerStarted","Data":"b5e5cc72a79b05c7198ba7bc0b8136bc081d21d6aba041f061cb6df7a31a2707"}
Jul 20 19:56:21.836202 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:21.835794    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" podStartSLOduration=4.835772185 podStartE2EDuration="4.835772185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:21.816229531 +0000 UTC m=+6.399460419" watchObservedRunningTime="2026-07-20 19:56:21.835772185 +0000 UTC m=+6.419003073"
Jul 20 19:56:22.259383 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.258754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:22.259383 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.258944    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:22.259383 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.259014    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:26.258995104 +0000 UTC m=+10.842225975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.359296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.359365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.359523    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.359588    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:26.359568767 +0000 UTC m=+10.942799635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.359990    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.360007    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.360018    2572 projected.go:196] Error preparing data for projected volume kube-api-access-bd6jb for pod openshift-network-diagnostics/network-check-target-w85j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:22.360143 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.360065    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb podName:c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:26.360049555 +0000 UTC m=+10.943280423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd6jb" (UniqueName: "kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb") pod "network-check-target-w85j4" (UID: "c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:22.720511 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.719791    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:22.720511 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.719941    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:22.720511 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.720317    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:22.720511 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.720405    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:22.721017 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.720890    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:22.721017 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:22.720982    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:22.809901 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.809865    2572 generic.go:356] "Generic (PLEG): container finished" podID="33194a3215b528c9d931b2bdc04c62bf" containerID="debe2df085096c75844a29e71954967336a9912b05871279aad608746d48c74a" exitCode=0
Jul 20 19:56:22.810413 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:22.810390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"33194a3215b528c9d931b2bdc04c62bf","Type":"ContainerDied","Data":"debe2df085096c75844a29e71954967336a9912b05871279aad608746d48c74a"}
Jul 20 19:56:24.719311 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:24.719277    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:24.719311 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:24.719295    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:24.719938 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:24.719277    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:24.719938 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:24.719419    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:24.719938 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:24.719459    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:24.719938 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:24.719527    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:26.291257 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:26.291209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:26.291706 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.291398    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:26.291706 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.291483    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:34.291461019 +0000 UTC m=+18.874691890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:26.392644 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:26.392605    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:26.392846 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:26.392712    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:26.392846 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.392796    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:26.392958 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.392864    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:56:26.392958 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.392876    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:34.392854916 +0000 UTC m=+18.976085801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:26.392958 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.392886    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:56:26.392958 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.392896    2572 projected.go:196] Error preparing data for projected volume kube-api-access-bd6jb for pod openshift-network-diagnostics/network-check-target-w85j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:26.392958 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.392941    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb podName:c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:34.392925523 +0000 UTC m=+18.976156389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd6jb" (UniqueName: "kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb") pod "network-check-target-w85j4" (UID: "c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:26.720454 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:26.720378    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:26.720593 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.720482    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:26.720593 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:26.720500    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:26.720593 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:26.720529    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:26.720749 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.720616    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:26.720749 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:26.720708    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:28.719568 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:28.719533    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:28.719980 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:28.719533    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:28.719980 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:28.719685    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:28.719980 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:28.719811    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:28.719980 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:28.719533    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:28.719980 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:28.719917    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:30.718863 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:30.718828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:30.719295 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:30.718837    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:30.719295 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:30.718955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:30.719295 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:30.719049    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:30.719295 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:30.718951    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:30.719295 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:30.719160    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:30.828084 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:30.828048    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"33194a3215b528c9d931b2bdc04c62bf","Type":"ContainerStarted","Data":"d76d386488e4a8b82284300e37a6f40029b5de7553fe3a59322ee0d879caf741"}
Jul 20 19:56:30.843360 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:30.843304    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" podStartSLOduration=13.843284184 podStartE2EDuration="13.843284184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:30.842276693 +0000 UTC m=+15.425507581" watchObservedRunningTime="2026-07-20 19:56:30.843284184 +0000 UTC m=+15.426515076"
Jul 20 19:56:32.719279 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:32.719244    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:32.719782 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:32.719244    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:32.719782 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:32.719385    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:32.719782 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:32.719251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:32.719782 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:32.719457    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:32.719782 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:32.719543    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:34.348876 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:34.348844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:34.349305 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.348969    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:34.349305 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.349029    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:50.349010702 +0000 UTC m=+34.932241569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:34.449226 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:34.449195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:34.449425 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:34.449273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:34.449425 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.449353    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:34.449425 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.449416    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:50.449396288 +0000 UTC m=+35.032627168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:34.449601 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.449441    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:56:34.449601 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.449460    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:56:34.449601 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.449474    2572 projected.go:196] Error preparing data for projected volume kube-api-access-bd6jb for pod openshift-network-diagnostics/network-check-target-w85j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:34.449601 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.449524    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb podName:c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:50.449507829 +0000 UTC m=+35.032738696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd6jb" (UniqueName: "kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb") pod "network-check-target-w85j4" (UID: "c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:56:34.719530 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:34.719450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:34.719680 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:34.719450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:34.719680 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:34.719590    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:34.719680 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.719582    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:34.719848 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.719670    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:34.719848 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:34.719756    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:36.719882 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:36.719854    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:36.720282 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:36.719964    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:36.720282 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:36.720036    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:36.720282 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:36.720128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:36.720282 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:36.720157    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:36.720282 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:36.720218    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:37.843795 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.843664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l" event={"ID":"80d984c8-dd2a-42fb-8688-8fdeda9ca00a","Type":"ContainerStarted","Data":"8865031d678853e3f673bf52081def5b6f4504653f1204e0541805fabe97bbb7"}
Jul 20 19:56:37.845471 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.845382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerStarted","Data":"b0955ddd7bd2dc19bc41cb4f8c6a97fd62b47bece00b6746a08cbfcb06281220"}
Jul 20 19:56:37.847689 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.847027    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzb5d" event={"ID":"872437eb-bba0-4f92-9c9e-3734c274cd28","Type":"ContainerStarted","Data":"ecfe8d43b80122481511a6715eda412d6af9c6b635e308debf09fb81077c5820"}
Jul 20 19:56:37.849351 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.849269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fzhh6" event={"ID":"e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4","Type":"ContainerStarted","Data":"99815864cb20d94f7c77db426b683f9a7c09f0964f4cb194a42553404b9e68ba"}
Jul 20 19:56:37.853646 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.853593    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8979p" event={"ID":"cbd270e2-d4f5-411d-9e01-3b62c96d5e0e","Type":"ContainerStarted","Data":"839fbd09db1e833db6ee027525981ae85c49575486330cbe0e509571b8aa43e3"}
Jul 20 19:56:37.857078 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.856983    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sz5wh" event={"ID":"719b562b-5156-41d3-944a-21f94c3fead4","Type":"ContainerStarted","Data":"221cd3c042e741aa5d301767d2ed611c4be5af9b1413978792f5a80a02cd47a0"}
Jul 20 19:56:37.859377 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.859316    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"7c241f042e6b923ae524bf5ce7ddf9d28dcdc56a6ad0121883a99e38652c69e0"}
Jul 20 19:56:37.861231 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.861208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9h22n" event={"ID":"8c9992d0-737f-460d-91e2-c99281caa72b","Type":"ContainerStarted","Data":"1f657ac892954f4e67a46754e0d242913c79ce7eccb712861d4c0017efad6fc4"}
Jul 20 19:56:37.890413 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.890175    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fzhh6" podStartSLOduration=9.913998889 podStartE2EDuration="20.890158237s" totalImagesPullingTime="10.976159348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:37.888892524 +0000 UTC m=+22.472123412" watchObservedRunningTime="2026-07-20 19:56:37.890158237 +0000 UTC m=+22.473389153"
Jul 20 19:56:37.912469 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.912316    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9h22n" podStartSLOduration=10.90320934 podStartE2EDuration="21.912295815s" totalImagesPullingTime="11.009086475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:37.912197575 +0000 UTC m=+22.495428466" watchObservedRunningTime="2026-07-20 19:56:37.912295815 +0000 UTC m=+22.495526747"
Jul 20 19:56:37.953220 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.953165    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qzb5d" podStartSLOduration=2.259750273 podStartE2EDuration="20.953146853s" totalImagesPullingTime="18.69339658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:37.953056188 +0000 UTC m=+22.536287076" watchObservedRunningTime="2026-07-20 19:56:37.953146853 +0000 UTC m=+22.536377742"
Jul 20 19:56:37.991320 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.991282    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sz5wh" podStartSLOduration=10.00204893 podStartE2EDuration="20.991266037s" totalImagesPullingTime="10.989217107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:37.970674589 +0000 UTC m=+22.553905480" watchObservedRunningTime="2026-07-20 19:56:37.991266037 +0000 UTC m=+22.574496908"
Jul 20 19:56:37.991454 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:37.991436    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8979p" podStartSLOduration=10.008828616 podStartE2EDuration="20.991431574s" totalImagesPullingTime="10.982602958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:37.991375221 +0000 UTC m=+22.574606109" watchObservedRunningTime="2026-07-20 19:56:37.991431574 +0000 UTC m=+22.574662463"
Jul 20 19:56:38.457218 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.457130    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:38.457803 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.457786    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:38.581365 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.581332    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:38.581720 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.581705    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sz5wh"
Jul 20 19:56:38.718862 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.718785    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:38.718862 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.718806    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:38.719071 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.718789    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:38.719071 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:38.718887    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:38.719071 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:38.718967    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:38.719071 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:38.719056    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:38.864859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.864829    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a56d85e-03d1-4801-af1f-1ab780210e98" containerID="b0955ddd7bd2dc19bc41cb4f8c6a97fd62b47bece00b6746a08cbfcb06281220" exitCode=0
Jul 20 19:56:38.865383 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.864909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerDied","Data":"b0955ddd7bd2dc19bc41cb4f8c6a97fd62b47bece00b6746a08cbfcb06281220"}
Jul 20 19:56:38.868866 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.868842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"a98db692de86c1ef49462223c1ccefaeb2b899bcdee10c8bc6e047ac17c368b5"}
Jul 20 19:56:38.868968 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.868902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"00a899db3e011785053e7acd6b73d3c8a02aad4327c4031ae3118beaed8ef887"}
Jul 20 19:56:38.868968 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.868931    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"01dadd5fb5d8fd6f05b7ed98bef57f1e50a19717e23a659eb8ad21ae5016c5ca"}
Jul 20 19:56:38.868968 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.868957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"d6c79104c8a7a95d18e268685b3101ba70225c696ef7491df622ea5c7023e3bc"}
Jul 20 19:56:38.869144 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:38.868991    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"0307f762543c842a0bbdad293cac41d8959079438538e8d46be6f5daf23613b8"}
Jul 20 19:56:39.443238 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.443211    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 19:56:39.695021 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.694860    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:56:39.443231539Z","UUID":"976b1b91-aa16-40ce-bb5d-a36efc366186","Handler":null,"Name":"","Endpoint":""}
Jul 20 19:56:39.696505 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.696484    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 19:56:39.696642 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.696527    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 19:56:39.874928 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.873553    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7dnxw" event={"ID":"dea52d85-a77f-4eab-ba5b-a47e38f147eb","Type":"ContainerStarted","Data":"3e5ed51ce751ae762e032dd07427d086d78e5e885038db558c7a2c78c3ac1e2d"}
Jul 20 19:56:39.877132 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.877095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l" event={"ID":"80d984c8-dd2a-42fb-8688-8fdeda9ca00a","Type":"ContainerStarted","Data":"fc5a3a1b321ca127d8a9d7d04212fae5c022da904446a4bcb44a9f44bdd472af"}
Jul 20 19:56:39.890481 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:39.890435    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7dnxw" podStartSLOduration=12.86417489 podStartE2EDuration="23.890417009s" totalImagesPullingTime="11.026242119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:39.890227984 +0000 UTC m=+24.473458883" watchObservedRunningTime="2026-07-20 19:56:39.890417009 +0000 UTC m=+24.473647898"
Jul 20 19:56:40.719460 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:40.719429    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:40.719627 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:40.719567    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:40.719627 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:40.719564    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:40.720312 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:40.719642    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:40.720312 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:40.719767    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:40.720312 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:40.719863    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:40.883420 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:40.883138    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"f079c56301dde9f218db9302d8676d5e3d177c28eea4303c02c128bec576f332"}
Jul 20 19:56:41.887426 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:41.887385    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l" event={"ID":"80d984c8-dd2a-42fb-8688-8fdeda9ca00a","Type":"ContainerStarted","Data":"05498fd10dd5fc485a245ef7266c1f692267f5ae2c7417857b25444196c4015c"}
Jul 20 19:56:41.907273 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:41.907219    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwh2l" podStartSLOduration=10.939719058 podStartE2EDuration="24.907191676s" totalImagesPullingTime="13.967472618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:41.906476736 +0000 UTC m=+26.489707625" watchObservedRunningTime="2026-07-20 19:56:41.907191676 +0000 UTC m=+26.490422566"
Jul 20 19:56:42.718607 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:42.718567    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:42.718607 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:42.718599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:42.718858 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:42.718707    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:42.718858 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:42.718796    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:42.718958 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:42.718860    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:42.718958 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:42.718931    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:44.718685 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.718488    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:44.719280 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.718491    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:44.719280 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:44.718739    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:44.719280 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.718506    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:44.719280 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:44.718809    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:44.719280 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:44.718901    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:44.895538 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.895503    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a56d85e-03d1-4801-af1f-1ab780210e98" containerID="1fd51f2dd151a0e717ee34267b69c03ea258320eabd6bfc486c4e106f28bd72c" exitCode=0
Jul 20 19:56:44.895718 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.895586    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerDied","Data":"1fd51f2dd151a0e717ee34267b69c03ea258320eabd6bfc486c4e106f28bd72c"}
Jul 20 19:56:44.899176 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.899157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" event={"ID":"f0aa018f-4961-41a1-a6db-eb09001bf816","Type":"ContainerStarted","Data":"6ca965d9556ab2403cd0481a0f08c2804464ccaec7cb861e9fb646d2f4988867"}
Jul 20 19:56:44.899472 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.899456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:44.914526 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.914492    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:44.946367 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:44.944798    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f" podStartSLOduration=9.198246573 podStartE2EDuration="27.944779048s" totalImagesPullingTime="18.746532475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:44.942641735 +0000 UTC m=+29.525872622" watchObservedRunningTime="2026-07-20 19:56:44.944779048 +0000 UTC m=+29.528009936"
Jul 20 19:56:45.901673 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:45.901643    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:45.902084 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:45.901794    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:45.915987 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:45.915964    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:56:46.229009 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.228933    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9hj8b"]
Jul 20 19:56:46.229146 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.229050    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:46.229146 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:46.229129    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:46.233995 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.233966    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47d7r"]
Jul 20 19:56:46.234138 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.234088    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:46.234221 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:46.234202    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:46.234588 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.234542    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w85j4"]
Jul 20 19:56:46.234702 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.234629    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:46.234787 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:46.234717    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:46.905690 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.905654    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a56d85e-03d1-4801-af1f-1ab780210e98" containerID="f1e3cb5f78b5c5630f3ebc266e63be0680c0bb1faac466fe594bf2353ff46bbc" exitCode=0
Jul 20 19:56:46.906062 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:46.905693    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerDied","Data":"f1e3cb5f78b5c5630f3ebc266e63be0680c0bb1faac466fe594bf2353ff46bbc"}
Jul 20 19:56:47.719377 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:47.719138    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:47.719564 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:47.719138    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:47.719564 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:47.719211    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:47.719564 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:47.719441    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:47.719564 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:47.719495    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:47.719564 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:47.719522    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:48.912876 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:48.912845    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a56d85e-03d1-4801-af1f-1ab780210e98" containerID="7a1064d01a9db88c01fd248fe72a927bebc92d11048e3b32707794298c9138ee" exitCode=0
Jul 20 19:56:48.913394 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:48.912887    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerDied","Data":"7a1064d01a9db88c01fd248fe72a927bebc92d11048e3b32707794298c9138ee"}
Jul 20 19:56:49.718794 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:49.718761    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:49.718989 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:49.718773    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:49.718989 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:49.718773    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:49.718989 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:49.718944    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47d7r" podUID="b2ceedd5-55de-41d6-a0a0-45de41a8b261"
Jul 20 19:56:49.718989 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:49.718961    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9hj8b" podUID="6fe97ec9-b7e1-496f-add0-f616a228e390"
Jul 20 19:56:49.719200 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:49.719008    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w85j4" podUID="c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2"
Jul 20 19:56:50.197499 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.197333    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeReady"
Jul 20 19:56:50.197499 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.197483    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 19:56:50.268445 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.268412    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"]
Jul 20 19:56:50.271645 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.271619    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.271806 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.271622    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6688b656cd-pxppf"]
Jul 20 19:56:50.273689 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.273666    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 19:56:50.273825 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.273768    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 19:56:50.273994 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.273978    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f5clj\""
Jul 20 19:56:50.275098 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.275081    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"]
Jul 20 19:56:50.275216 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.275192    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.277453 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.277434    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 19:56:50.277575 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.277537    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 19:56:50.277633 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.277559    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.277985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.277969    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xzmhf\""
Jul 20 19:56:50.278043 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.278005    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 19:56:50.280339 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.280324    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.280414 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.280369    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.281205 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.281184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 20 19:56:50.281304 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.281206    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 20 19:56:50.281713 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.281693    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-g8xmx\""
Jul 20 19:56:50.287160 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.287141    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-rtjdf"]
Jul 20 19:56:50.288881 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.288859    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 19:56:50.289926 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.289907    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"]
Jul 20 19:56:50.290010 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.290001    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.290260 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.290242    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"]
Jul 20 19:56:50.292162 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.292141    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 20 19:56:50.292429 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.292408    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.293260 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.293244    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"]
Jul 20 19:56:50.293372 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.293353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"
Jul 20 19:56:50.298107 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.298036    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2d4nx"]
Jul 20 19:56:50.298799 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.298353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.303090 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.302761    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"]
Jul 20 19:56:50.303889 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.303759    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.305125 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.305104    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 19:56:50.305453 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.305244    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.305453 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.305298    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.305453 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.305145    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.305453 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.305242    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 20 19:56:50.305699 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.305489    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5h7xl\""
Jul 20 19:56:50.306390 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.306049    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.306390 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.306151    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-chtmm\""
Jul 20 19:56:50.307078 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.307030    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.307269 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.307164    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"]
Jul 20 19:56:50.307504 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.307451    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.307691 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.307669    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8z4s8\""
Jul 20 19:56:50.308903 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.308878    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4rbnq\""
Jul 20 19:56:50.309241 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.309132    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.309701 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.309682    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.310033 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.309879    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 20 19:56:50.310190 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.310149    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 20 19:56:50.311479 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.310898    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 19:56:50.311479 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.311386    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.312238 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.312160    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.312861    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6688b656cd-pxppf"]
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.312916    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"]
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.312943    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"]
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.312964    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2d4nx"]
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.313006    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"]
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.313033    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"]
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.313127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.313229    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xkrsf\""
Jul 20 19:56:50.314744 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.313628    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q8gn8"]
Jul 20 19:56:50.316063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.315255    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 20 19:56:50.316063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.315791    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.316063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.315798    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 19:56:50.316063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.315852    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.316063 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.315792    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.316476 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.316405    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6qw82\""
Jul 20 19:56:50.316707 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.316688    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 19:56:50.317792 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.317675    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.319652 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.319633    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"]
Jul 20 19:56:50.319881 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.319864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 19:56:50.320089 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.320072    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 19:56:50.320307 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.320281    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5458484848-8v9pn"]
Jul 20 19:56:50.321975 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.321955    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fzgwk\""
Jul 20 19:56:50.323992 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.323964    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wph6n"]
Jul 20 19:56:50.324477 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.324457    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.324896 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.324697    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 20 19:56:50.327166 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.327045    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 19:56:50.327424 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.327403    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 19:56:50.327641 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.327623    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.327815 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.327631    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 19:56:50.329026 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.328980    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z652g\""
Jul 20 19:56:50.329026 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.329000    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 19:56:50.329685 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.329663    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"]
Jul 20 19:56:50.330704 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.329828    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.331929 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.331909    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.334279 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.334258    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.334827 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.334811    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 19:56:50.334985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.334822    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qsckw\""
Jul 20 19:56:50.336837 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.336817    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.337597 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.337576    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-rtjdf"]
Jul 20 19:56:50.337678 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.337624    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q8gn8"]
Jul 20 19:56:50.337678 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.337658    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"]
Jul 20 19:56:50.337812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.337680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wph6n"]
Jul 20 19:56:50.337812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.337706    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5458484848-8v9pn"]
Jul 20 19:56:50.337905 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.337828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"
Jul 20 19:56:50.340001 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.339980    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:56:50.340370 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.340183    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hbn8l\""
Jul 20 19:56:50.340462 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.340443    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:56:50.369070 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369040    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.369201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.369201 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9925e645-3cc0-4d07-b219-eb32d0710984-config\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.369311 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d556cc5-0f02-471f-83b5-ba063ca86391-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.369311 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369276    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d556cc5-0f02-471f-83b5-ba063ca86391-config\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.369311 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbrp\" (UniqueName: \"kubernetes.io/projected/d2c32f51-016d-419b-b2c1-19d1c71af987-kube-api-access-hhbrp\") pod \"volume-data-source-validator-78cf4c6f6-stftf\" (UID: \"d2c32f51-016d-419b-b2c1-19d1c71af987\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"
Jul 20 19:56:50.369456 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26a48c4d-665f-4265-9fc3-ca5602e33a7e-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.369456 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-installation-pull-secrets\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369456 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369371    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwl4x\" (UniqueName: \"kubernetes.io/projected/9925e645-3cc0-4d07-b219-eb32d0710984-kube-api-access-wwl4x\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.369456 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369449    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-certificates\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369510    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rwn\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-kube-api-access-59rwn\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfdm8\" (UniqueName: \"kubernetes.io/projected/1d556cc5-0f02-471f-83b5-ba063ca86391-kube-api-access-pfdm8\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.369651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9925e645-3cc0-4d07-b219-eb32d0710984-trusted-ca\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.369651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:50.369651 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9925e645-3cc0-4d07-b219-eb32d0710984-serving-cert\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9t8\" (UniqueName: \"kubernetes.io/projected/697da59a-495e-47c3-8bbb-e63fc4e4f508-kube-api-access-xc9t8\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-image-registry-private-configuration\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369790    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-trusted-ca\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.369798    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369848    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c20762f3-f694-4f22-bf76-f14bcca7c20e-ca-trust-extracted\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.369886    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret podName:6fe97ec9-b7e1-496f-add0-f616a228e390 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.369867851 +0000 UTC m=+66.953098732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret") pod "global-pull-secret-syncer-9hj8b" (UID: "6fe97ec9-b7e1-496f-add0-f616a228e390") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:56:50.369954 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.369941    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-bound-sa-token\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.470824 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.470789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f362015d-26e7-4cb2-9dda-100e6f42d877-cert\") pod \"ingress-canary-wph6n\" (UID: \"f362015d-26e7-4cb2-9dda-100e6f42d877\") " pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.470985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.470855    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-image-registry-private-configuration\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.470985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.470879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e992044-c007-471a-b45d-2214076982eb-config-volume\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.470985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.470902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:50.470985 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.470930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-default-certificate\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.471147 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.470984    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.471147 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.471025    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:50.471147 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.471147 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.471095    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs podName:b2ceedd5-55de-41d6-a0a0-45de41a8b261 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.471075507 +0000 UTC m=+67.054306394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs") pod "network-metrics-daemon-47d7r" (UID: "b2ceedd5-55de-41d6-a0a0-45de41a8b261") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:56:50.471147 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471120    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26a48c4d-665f-4265-9fc3-ca5602e33a7e-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.471428 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-installation-pull-secrets\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.471428 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-serving-cert\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.471428 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.471428 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-certificates\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.471561 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.471479    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:56:50.471561 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.471494    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6688b656cd-pxppf: secret "image-registry-tls" not found
Jul 20 19:56:50.471561 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.471556    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls podName:c20762f3-f694-4f22-bf76-f14bcca7c20e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:50.971520681 +0000 UTC m=+35.554751565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls") pod "image-registry-6688b656cd-pxppf" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e") : secret "image-registry-tls" not found
Jul 20 19:56:50.471699 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9925e645-3cc0-4d07-b219-eb32d0710984-trusted-ca\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.471699 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471690    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rwn\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-kube-api-access-59rwn\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471913    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/26a48c4d-665f-4265-9fc3-ca5602e33a7e-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.471945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfdm8\" (UniqueName: \"kubernetes.io/projected/1d556cc5-0f02-471f-83b5-ba063ca86391-kube-api-access-pfdm8\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-certificates\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472034    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm49d\" (UniqueName: \"kubernetes.io/projected/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-kube-api-access-sm49d\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.472137 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472075    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5psnz\" (UniqueName: \"kubernetes.io/projected/f362015d-26e7-4cb2-9dda-100e6f42d877-kube-api-access-5psnz\") pod \"ingress-canary-wph6n\" (UID: \"f362015d-26e7-4cb2-9dda-100e6f42d877\") " pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472163    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-trusted-ca\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9t8\" (UniqueName: \"kubernetes.io/projected/697da59a-495e-47c3-8bbb-e63fc4e4f508-kube-api-access-xc9t8\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472290    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c20762f3-f694-4f22-bf76-f14bcca7c20e-ca-trust-extracted\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-bound-sa-token\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9925e645-3cc0-4d07-b219-eb32d0710984-serving-cert\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-tmp\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d556cc5-0f02-471f-83b5-ba063ca86391-config\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472437    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.472483 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.472885 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rb5b\" (UniqueName: \"kubernetes.io/projected/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-kube-api-access-8rb5b\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.472885 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rjwb\" (UniqueName: \"kubernetes.io/projected/4bbe953b-222d-480e-8a1d-db3bf388f7c9-kube-api-access-6rjwb\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.472885 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9925e645-3cc0-4d07-b219-eb32d0710984-config\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.472885 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d556cc5-0f02-471f-83b5-ba063ca86391-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.472885 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472775    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9925e645-3cc0-4d07-b219-eb32d0710984-trusted-ca\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.472885 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.472851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbrp\" (UniqueName: \"kubernetes.io/projected/d2c32f51-016d-419b-b2c1-19d1c71af987-kube-api-access-hhbrp\") pod \"volume-data-source-validator-78cf4c6f6-stftf\" (UID: \"d2c32f51-016d-419b-b2c1-19d1c71af987\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"
Jul 20 19:56:50.473105 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.472935    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:56:50.473105 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c20762f3-f694-4f22-bf76-f14bcca7c20e-ca-trust-extracted\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.473105 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.473094    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:56:50.473241 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473095    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-trusted-ca\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.473241 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlr5c\" (UniqueName: \"kubernetes.io/projected/4e992044-c007-471a-b45d-2214076982eb-kube-api-access-hlr5c\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.473241 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwl4x\" (UniqueName: \"kubernetes.io/projected/9925e645-3cc0-4d07-b219-eb32d0710984-kube-api-access-wwl4x\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.473377 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.473246    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert podName:26a48c4d-665f-4265-9fc3-ca5602e33a7e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:50.973228585 +0000 UTC m=+35.556459452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kjwp5" (UID: "26a48c4d-665f-4265-9fc3-ca5602e33a7e") : secret "networking-console-plugin-cert" not found
Jul 20 19:56:50.473377 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqltb\" (UniqueName: \"kubernetes.io/projected/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-kube-api-access-tqltb\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.473478 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473379    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d556cc5-0f02-471f-83b5-ba063ca86391-config\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.474029 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.473997    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-service-ca-bundle\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.474142 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-stats-auth\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.474464 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.474446    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls podName:697da59a-495e-47c3-8bbb-e63fc4e4f508 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:50.974430748 +0000 UTC m=+35.557661616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xmchw" (UID: "697da59a-495e-47c3-8bbb-e63fc4e4f508") : secret "samples-operator-tls" not found
Jul 20 19:56:50.474552 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474530    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bbe953b-222d-480e-8a1d-db3bf388f7c9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.474604 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-snapshots\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.474659 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474624    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.474659 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474651    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.474792 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9925e645-3cc0-4d07-b219-eb32d0710984-config\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.474792 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:50.474891 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswt6\" (UniqueName: \"kubernetes.io/projected/48352dd7-c97e-4a7b-a268-7d089909d34a-kube-api-access-dswt6\") pod \"network-check-source-7bc5b6bf85-m8dc4\" (UID: \"48352dd7-c97e-4a7b-a268-7d089909d34a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"
Jul 20 19:56:50.474891 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.474837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e992044-c007-471a-b45d-2214076982eb-tmp-dir\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.475879 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.475855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d556cc5-0f02-471f-83b5-ba063ca86391-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.475964 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.475867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9925e645-3cc0-4d07-b219-eb32d0710984-serving-cert\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.476106 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.476085    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-image-registry-private-configuration\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.476141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.476118    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-installation-pull-secrets\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.477244 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.477228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd6jb\" (UniqueName: \"kubernetes.io/projected/c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2-kube-api-access-bd6jb\") pod \"network-check-target-w85j4\" (UID: \"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2\") " pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:50.484393 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.483769    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9t8\" (UniqueName: \"kubernetes.io/projected/697da59a-495e-47c3-8bbb-e63fc4e4f508-kube-api-access-xc9t8\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.484393 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.484366    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbrp\" (UniqueName: \"kubernetes.io/projected/d2c32f51-016d-419b-b2c1-19d1c71af987-kube-api-access-hhbrp\") pod \"volume-data-source-validator-78cf4c6f6-stftf\" (UID: \"d2c32f51-016d-419b-b2c1-19d1c71af987\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"
Jul 20 19:56:50.484539 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.484471    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwl4x\" (UniqueName: \"kubernetes.io/projected/9925e645-3cc0-4d07-b219-eb32d0710984-kube-api-access-wwl4x\") pod \"console-operator-565b7b569d-rtjdf\" (UID: \"9925e645-3cc0-4d07-b219-eb32d0710984\") " pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.484879 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.484854    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rwn\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-kube-api-access-59rwn\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.485017 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.484997    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfdm8\" (UniqueName: \"kubernetes.io/projected/1d556cc5-0f02-471f-83b5-ba063ca86391-kube-api-access-pfdm8\") pod \"service-ca-operator-5bcbc94c78-jn9cx\" (UID: \"1d556cc5-0f02-471f-83b5-ba063ca86391\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.485974 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.485954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-bound-sa-token\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.575583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575548    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bbe953b-222d-480e-8a1d-db3bf388f7c9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.575583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575587    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-snapshots\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dswt6\" (UniqueName: \"kubernetes.io/projected/48352dd7-c97e-4a7b-a268-7d089909d34a-kube-api-access-dswt6\") pod \"network-check-source-7bc5b6bf85-m8dc4\" (UID: \"48352dd7-c97e-4a7b-a268-7d089909d34a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e992044-c007-471a-b45d-2214076982eb-tmp-dir\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f362015d-26e7-4cb2-9dda-100e6f42d877-cert\") pod \"ingress-canary-wph6n\" (UID: \"f362015d-26e7-4cb2-9dda-100e6f42d877\") " pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e992044-c007-471a-b45d-2214076982eb-config-volume\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-default-certificate\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575829    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.575859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.575859    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-serving-cert\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.575932    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.075911851 +0000 UTC m=+35.659142723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : secret "router-metrics-certs-default" not found
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.575973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm49d\" (UniqueName: \"kubernetes.io/projected/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-kube-api-access-sm49d\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576031    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5psnz\" (UniqueName: \"kubernetes.io/projected/f362015d-26e7-4cb2-9dda-100e6f42d877-kube-api-access-5psnz\") pod \"ingress-canary-wph6n\" (UID: \"f362015d-26e7-4cb2-9dda-100e6f42d877\") " pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-tmp\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rb5b\" (UniqueName: \"kubernetes.io/projected/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-kube-api-access-8rb5b\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rjwb\" (UniqueName: \"kubernetes.io/projected/4bbe953b-222d-480e-8a1d-db3bf388f7c9-kube-api-access-6rjwb\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlr5c\" (UniqueName: \"kubernetes.io/projected/4e992044-c007-471a-b45d-2214076982eb-kube-api-access-hlr5c\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.576319 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576255    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-snapshots\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.576846 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqltb\" (UniqueName: \"kubernetes.io/projected/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-kube-api-access-tqltb\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.576846 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576407    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bbe953b-222d-480e-8a1d-db3bf388f7c9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.576846 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576783    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e992044-c007-471a-b45d-2214076982eb-tmp-dir\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.576983 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.577039 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.576969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e992044-c007-471a-b45d-2214076982eb-config-volume\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.577089 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.576005    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.577341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-tmp\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.577373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.576346    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.076333956 +0000 UTC m=+35.659564829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : configmap references non-existent config key: service-ca.crt
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.576467    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.577489    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls podName:4bbe953b-222d-480e-8a1d-db3bf388f7c9 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.077469163 +0000 UTC m=+35.660700040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hcst6" (UID: "4bbe953b-222d-480e-8a1d-db3bf388f7c9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.577515    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls podName:4e992044-c007-471a-b45d-2214076982eb nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.077502856 +0000 UTC m=+35.660733724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls") pod "dns-default-q8gn8" (UID: "4e992044-c007-471a-b45d-2214076982eb") : secret "dns-default-metrics-tls" not found
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.577535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-service-ca-bundle\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.577888 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.577584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-stats-auth\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.578416 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.578200    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-service-ca-bundle\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.579871 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.579849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-default-certificate\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.580714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.580695    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-stats-auth\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.581148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.580976    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f362015d-26e7-4cb2-9dda-100e6f42d877-cert\") pod \"ingress-canary-wph6n\" (UID: \"f362015d-26e7-4cb2-9dda-100e6f42d877\") " pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.581148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.581048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-serving-cert\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.581148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.581111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.585532 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.585510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswt6\" (UniqueName: \"kubernetes.io/projected/48352dd7-c97e-4a7b-a268-7d089909d34a-kube-api-access-dswt6\") pod \"network-check-source-7bc5b6bf85-m8dc4\" (UID: \"48352dd7-c97e-4a7b-a268-7d089909d34a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"
Jul 20 19:56:50.585934 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.585846    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqltb\" (UniqueName: \"kubernetes.io/projected/9f9d45ea-8cc0-46ba-b7b3-da28821e45f1-kube-api-access-tqltb\") pod \"kube-storage-version-migrator-operator-7658d9b749-ptz79\" (UID: \"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.587356 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.587317    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rb5b\" (UniqueName: \"kubernetes.io/projected/7dbf6118-6ad4-4780-8f5c-4034bdb30e25-kube-api-access-8rb5b\") pod \"insights-operator-555d9d7885-2d4nx\" (UID: \"7dbf6118-6ad4-4780-8f5c-4034bdb30e25\") " pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.587608 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.587590    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlr5c\" (UniqueName: \"kubernetes.io/projected/4e992044-c007-471a-b45d-2214076982eb-kube-api-access-hlr5c\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:50.587884 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.587861    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5psnz\" (UniqueName: \"kubernetes.io/projected/f362015d-26e7-4cb2-9dda-100e6f42d877-kube-api-access-5psnz\") pod \"ingress-canary-wph6n\" (UID: \"f362015d-26e7-4cb2-9dda-100e6f42d877\") " pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.588230 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.588213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm49d\" (UniqueName: \"kubernetes.io/projected/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-kube-api-access-sm49d\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:50.588650 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.588634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rjwb\" (UniqueName: \"kubernetes.io/projected/4bbe953b-222d-480e-8a1d-db3bf388f7c9-kube-api-access-6rjwb\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:50.600509 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.600492    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"
Jul 20 19:56:50.611139 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.611120    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:56:50.622676 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.622599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"
Jul 20 19:56:50.642180 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.642147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2d4nx"
Jul 20 19:56:50.649785 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.649759    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"
Jul 20 19:56:50.681748 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.681436    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wph6n"
Jul 20 19:56:50.686763 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.686392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"
Jul 20 19:56:50.822920 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.816335    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx"]
Jul 20 19:56:50.839836 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.839785    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d556cc5_0f02_471f_83b5_ba063ca86391.slice/crio-2e0df6e33b82a726d92c3ba196bb0a0beb0da4e42b7df1394b0ae43655289335 WatchSource:0}: Error finding container 2e0df6e33b82a726d92c3ba196bb0a0beb0da4e42b7df1394b0ae43655289335: Status 404 returned error can't find the container with id 2e0df6e33b82a726d92c3ba196bb0a0beb0da4e42b7df1394b0ae43655289335
Jul 20 19:56:50.873660 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.867905    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-rtjdf"]
Jul 20 19:56:50.873660 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.872345    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9925e645_3cc0_4d07_b219_eb32d0710984.slice/crio-954b9bd1201ef0bc044dc25b3f3c16fe2b293d758369608f2ff8431a02df4f45 WatchSource:0}: Error finding container 954b9bd1201ef0bc044dc25b3f3c16fe2b293d758369608f2ff8431a02df4f45: Status 404 returned error can't find the container with id 954b9bd1201ef0bc044dc25b3f3c16fe2b293d758369608f2ff8431a02df4f45
Jul 20 19:56:50.883594 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.883527    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2d4nx"]
Jul 20 19:56:50.889073 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.889043    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbf6118_6ad4_4780_8f5c_4034bdb30e25.slice/crio-f88ca617aff2625d2c202bd96bbbdb8bb52531ebd7d121c56ae9996e86497c0a WatchSource:0}: Error finding container f88ca617aff2625d2c202bd96bbbdb8bb52531ebd7d121c56ae9996e86497c0a: Status 404 returned error can't find the container with id f88ca617aff2625d2c202bd96bbbdb8bb52531ebd7d121c56ae9996e86497c0a
Jul 20 19:56:50.896431 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.896383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf"]
Jul 20 19:56:50.901007 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.900983    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c32f51_016d_419b_b2c1_19d1c71af987.slice/crio-9e82ae14701fa6b44db2150a610af815250b017a60563817cd9673ce6582b697 WatchSource:0}: Error finding container 9e82ae14701fa6b44db2150a610af815250b017a60563817cd9673ce6582b697: Status 404 returned error can't find the container with id 9e82ae14701fa6b44db2150a610af815250b017a60563817cd9673ce6582b697
Jul 20 19:56:50.907876 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.907856    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79"]
Jul 20 19:56:50.910873 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.910849    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9d45ea_8cc0_46ba_b7b3_da28821e45f1.slice/crio-1b2b277fb2ced50f03d8acc4683ebe312b1babae7d316f21d4423fc95e18cc38 WatchSource:0}: Error finding container 1b2b277fb2ced50f03d8acc4683ebe312b1babae7d316f21d4423fc95e18cc38: Status 404 returned error can't find the container with id 1b2b277fb2ced50f03d8acc4683ebe312b1babae7d316f21d4423fc95e18cc38
Jul 20 19:56:50.919779 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.919751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2d4nx" event={"ID":"7dbf6118-6ad4-4780-8f5c-4034bdb30e25","Type":"ContainerStarted","Data":"f88ca617aff2625d2c202bd96bbbdb8bb52531ebd7d121c56ae9996e86497c0a"}
Jul 20 19:56:50.920974 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.920952    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79" event={"ID":"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1","Type":"ContainerStarted","Data":"1b2b277fb2ced50f03d8acc4683ebe312b1babae7d316f21d4423fc95e18cc38"}
Jul 20 19:56:50.922165 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.922140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx" event={"ID":"1d556cc5-0f02-471f-83b5-ba063ca86391","Type":"ContainerStarted","Data":"2e0df6e33b82a726d92c3ba196bb0a0beb0da4e42b7df1394b0ae43655289335"}
Jul 20 19:56:50.924743 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.924699    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf" event={"ID":"d2c32f51-016d-419b-b2c1-19d1c71af987","Type":"ContainerStarted","Data":"9e82ae14701fa6b44db2150a610af815250b017a60563817cd9673ce6582b697"}
Jul 20 19:56:50.925016 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.924995    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wph6n"]
Jul 20 19:56:50.926301 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.926275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" event={"ID":"9925e645-3cc0-4d07-b219-eb32d0710984","Type":"ContainerStarted","Data":"954b9bd1201ef0bc044dc25b3f3c16fe2b293d758369608f2ff8431a02df4f45"}
Jul 20 19:56:50.929856 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.929828    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf362015d_26e7_4cb2_9dda_100e6f42d877.slice/crio-af82ffcc6c1679b7ca4873a64caa131f11324b964d25e1fc833585091831f96f WatchSource:0}: Error finding container af82ffcc6c1679b7ca4873a64caa131f11324b964d25e1fc833585091831f96f: Status 404 returned error can't find the container with id af82ffcc6c1679b7ca4873a64caa131f11324b964d25e1fc833585091831f96f
Jul 20 19:56:50.938891 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.938797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4"]
Jul 20 19:56:50.941354 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:56:50.941329    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48352dd7_c97e_4a7b_a268_7d089909d34a.slice/crio-21eef8bcd76a4b82c7e4f5e6a2262e5a85ee287e231ba251ae8bbac198766193 WatchSource:0}: Error finding container 21eef8bcd76a4b82c7e4f5e6a2262e5a85ee287e231ba251ae8bbac198766193: Status 404 returned error can't find the container with id 21eef8bcd76a4b82c7e4f5e6a2262e5a85ee287e231ba251ae8bbac198766193
Jul 20 19:56:50.984297 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.984265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:50.984464 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.984373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:50.984464 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:50.984406    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:50.984464 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984441    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:56:50.984464 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984462    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6688b656cd-pxppf: secret "image-registry-tls" not found
Jul 20 19:56:50.984655 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984517    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:56:50.984655 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984563    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls podName:c20762f3-f694-4f22-bf76-f14bcca7c20e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.984543903 +0000 UTC m=+36.567774775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls") pod "image-registry-6688b656cd-pxppf" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e") : secret "image-registry-tls" not found
Jul 20 19:56:50.984655 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984584    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:56:50.984655 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984585    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls podName:697da59a-495e-47c3-8bbb-e63fc4e4f508 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.984575856 +0000 UTC m=+36.567806725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xmchw" (UID: "697da59a-495e-47c3-8bbb-e63fc4e4f508") : secret "samples-operator-tls" not found
Jul 20 19:56:50.984655 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:50.984651    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert podName:26a48c4d-665f-4265-9fc3-ca5602e33a7e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:51.984616927 +0000 UTC m=+36.567847794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kjwp5" (UID: "26a48c4d-665f-4265-9fc3-ca5602e33a7e") : secret "networking-console-plugin-cert" not found
Jul 20 19:56:51.085559 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.085515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:51.085747 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.085566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:51.085747 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.085610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:51.085747 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.085640    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:51.085747 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085675    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:52.085656943 +0000 UTC m=+36.668887809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : configmap references non-existent config key: service-ca.crt
Jul 20 19:56:51.086039 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085748    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:51.086039 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085759    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:56:51.086039 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085748    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:56:51.086039 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085792    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls podName:4bbe953b-222d-480e-8a1d-db3bf388f7c9 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:52.085781159 +0000 UTC m=+36.669012026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hcst6" (UID: "4bbe953b-222d-480e-8a1d-db3bf388f7c9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:51.086039 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085804    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls podName:4e992044-c007-471a-b45d-2214076982eb nodeName:}" failed. No retries permitted until 2026-07-20 19:56:52.085798639 +0000 UTC m=+36.669029505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls") pod "dns-default-q8gn8" (UID: "4e992044-c007-471a-b45d-2214076982eb") : secret "dns-default-metrics-tls" not found
Jul 20 19:56:51.086039 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.085817    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:52.085808502 +0000 UTC m=+36.669039368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : secret "router-metrics-certs-default" not found
Jul 20 19:56:51.719188 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.719155    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:56:51.719947 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.719794    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:51.720294 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.720264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:56:51.722425 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.722206    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:56:51.723349 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.722959    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qx848\""
Jul 20 19:56:51.723349 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.722980    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mmqwm\""
Jul 20 19:56:51.723349 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.723196    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:56:51.756635 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.756448    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:56:51.936132 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.936050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wph6n" event={"ID":"f362015d-26e7-4cb2-9dda-100e6f42d877","Type":"ContainerStarted","Data":"af82ffcc6c1679b7ca4873a64caa131f11324b964d25e1fc833585091831f96f"}
Jul 20 19:56:51.938006 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.937935    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4" event={"ID":"48352dd7-c97e-4a7b-a268-7d089909d34a","Type":"ContainerStarted","Data":"21eef8bcd76a4b82c7e4f5e6a2262e5a85ee287e231ba251ae8bbac198766193"}
Jul 20 19:56:51.949582 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.949513    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w85j4"]
Jul 20 19:56:51.993719 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.993638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:51.993881 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.993755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:51.993881 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:51.993786    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:51.994041 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.993995    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:56:51.994091 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.994058    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert podName:26a48c4d-665f-4265-9fc3-ca5602e33a7e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:53.994039206 +0000 UTC m=+38.577270084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kjwp5" (UID: "26a48c4d-665f-4265-9fc3-ca5602e33a7e") : secret "networking-console-plugin-cert" not found
Jul 20 19:56:51.995368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.994456    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:56:51.995368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.994476    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6688b656cd-pxppf: secret "image-registry-tls" not found
Jul 20 19:56:51.995368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.994521    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls podName:c20762f3-f694-4f22-bf76-f14bcca7c20e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:53.994504427 +0000 UTC m=+38.577735301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls") pod "image-registry-6688b656cd-pxppf" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e") : secret "image-registry-tls" not found
Jul 20 19:56:51.995368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.994579    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:56:51.995368 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:51.994612    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls podName:697da59a-495e-47c3-8bbb-e63fc4e4f508 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:53.994601235 +0000 UTC m=+38.577832102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xmchw" (UID: "697da59a-495e-47c3-8bbb-e63fc4e4f508") : secret "samples-operator-tls" not found
Jul 20 19:56:52.095037 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:52.095000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:52.095214 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:52.095062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:52.095214 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:52.095157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:52.095214 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:52.095182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:52.095385 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095316    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:56:52.095385 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095381    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:54.095362899 +0000 UTC m=+38.678593768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : secret "router-metrics-certs-default" not found
Jul 20 19:56:52.095805 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095785    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:56:52.095908 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095836    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls podName:4e992044-c007-471a-b45d-2214076982eb nodeName:}" failed. No retries permitted until 2026-07-20 19:56:54.095820972 +0000 UTC m=+38.679051840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls") pod "dns-default-q8gn8" (UID: "4e992044-c007-471a-b45d-2214076982eb") : secret "dns-default-metrics-tls" not found
Jul 20 19:56:52.095908 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095888    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:52.096028 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095924    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls podName:4bbe953b-222d-480e-8a1d-db3bf388f7c9 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:54.095914263 +0000 UTC m=+38.679145133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hcst6" (UID: "4bbe953b-222d-480e-8a1d-db3bf388f7c9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:52.096028 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:52.095997    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:54.095986811 +0000 UTC m=+38.679217679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : configmap references non-existent config key: service-ca.crt
Jul 20 19:56:52.946690 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:52.946619    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w85j4" event={"ID":"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2","Type":"ContainerStarted","Data":"0d77991068fd2ca119b8f3ebc73044113edc2264c7f97529e8929494a2e7922a"}
Jul 20 19:56:53.953752 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:53.953143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf" event={"ID":"d2c32f51-016d-419b-b2c1-19d1c71af987","Type":"ContainerStarted","Data":"fbae4503a358d596b98f6a1c854dd9a909ad988a895f1d00fff3b2a079893d55"}
Jul 20 19:56:53.972330 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:53.971775    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-stftf" podStartSLOduration=10.490865712 podStartE2EDuration="12.971750311s" totalImagesPullingTime="2.480884599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:53.97108986 +0000 UTC m=+38.554320755" watchObservedRunningTime="2026-07-20 19:56:53.971750311 +0000 UTC m=+38.554981216"
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.017739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.017845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.017852    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.017876    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6688b656cd-pxppf: secret "image-registry-tls" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.017938    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls podName:c20762f3-f694-4f22-bf76-f14bcca7c20e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.017922409 +0000 UTC m=+42.601153275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls") pod "image-registry-6688b656cd-pxppf" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e") : secret "image-registry-tls" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.017959    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.018011    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert podName:26a48c4d-665f-4265-9fc3-ca5602e33a7e nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.017994881 +0000 UTC m=+42.601225752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kjwp5" (UID: "26a48c4d-665f-4265-9fc3-ca5602e33a7e") : secret "networking-console-plugin-cert" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.018074    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.018106    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls podName:697da59a-495e-47c3-8bbb-e63fc4e4f508 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.018095652 +0000 UTC m=+42.601326522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xmchw" (UID: "697da59a-495e-47c3-8bbb-e63fc4e4f508") : secret "samples-operator-tls" not found
Jul 20 19:56:54.018256 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.017874    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:54.120236 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.119972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:54.120236 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.120182    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:54.120236 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.120228    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:54.120560 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.120278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:54.120560 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:54.120353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:54.120560 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.120526    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:56:54.120752 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.120593    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls podName:4e992044-c007-471a-b45d-2214076982eb nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.12056778 +0000 UTC m=+42.703798663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls") pod "dns-default-q8gn8" (UID: "4e992044-c007-471a-b45d-2214076982eb") : secret "dns-default-metrics-tls" not found
Jul 20 19:56:54.121239 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.120867    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls podName:4bbe953b-222d-480e-8a1d-db3bf388f7c9 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.120845661 +0000 UTC m=+42.704076543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hcst6" (UID: "4bbe953b-222d-480e-8a1d-db3bf388f7c9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:54.121239 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.120972    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.120960798 +0000 UTC m=+42.704191678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : configmap references non-existent config key: service-ca.crt
Jul 20 19:56:54.121239 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.121116    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:56:54.121239 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:54.121198    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:58.121182102 +0000 UTC m=+42.704412972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : secret "router-metrics-certs-default" not found
Jul 20 19:56:58.053503 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.053458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.053570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.053603    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053634    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053655    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6688b656cd-pxppf: secret "image-registry-tls" not found
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053689    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053699    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053710    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls podName:c20762f3-f694-4f22-bf76-f14bcca7c20e nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.053694923 +0000 UTC m=+50.636925790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls") pod "image-registry-6688b656cd-pxppf" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e") : secret "image-registry-tls" not found
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053764    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert podName:26a48c4d-665f-4265-9fc3-ca5602e33a7e nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.053747967 +0000 UTC m=+50.636978834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kjwp5" (UID: "26a48c4d-665f-4265-9fc3-ca5602e33a7e") : secret "networking-console-plugin-cert" not found
Jul 20 19:56:58.054087 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.053788    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls podName:697da59a-495e-47c3-8bbb-e63fc4e4f508 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.053779669 +0000 UTC m=+50.637010536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xmchw" (UID: "697da59a-495e-47c3-8bbb-e63fc4e4f508") : secret "samples-operator-tls" not found
Jul 20 19:56:58.154110 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.154071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:58.154303 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.154122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:56:58.154303 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.154168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:56:58.154303 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:56:58.154205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:56:58.154303 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154287    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:58.154303 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154292    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:56:58.154554 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154333    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.154310918 +0000 UTC m=+50.737541798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : configmap references non-existent config key: service-ca.crt
Jul 20 19:56:58.154554 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154360    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls podName:4bbe953b-222d-480e-8a1d-db3bf388f7c9 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.154350832 +0000 UTC m=+50.737581700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hcst6" (UID: "4bbe953b-222d-480e-8a1d-db3bf388f7c9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:56:58.154554 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154376    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.154367839 +0000 UTC m=+50.737598709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : secret "router-metrics-certs-default" not found
Jul 20 19:56:58.154554 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154382    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:56:58.154554 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:56:58.154426    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls podName:4e992044-c007-471a-b45d-2214076982eb nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.154410571 +0000 UTC m=+50.737641451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls") pod "dns-default-q8gn8" (UID: "4e992044-c007-471a-b45d-2214076982eb") : secret "dns-default-metrics-tls" not found
Jul 20 19:57:00.974263 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:00.974223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wph6n" event={"ID":"f362015d-26e7-4cb2-9dda-100e6f42d877","Type":"ContainerStarted","Data":"77a82bf5d1024f5bbbb2a2a442a5d6d23544224e597b0e196834575e61f28a28"}
Jul 20 19:57:00.979970 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:00.979075    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" event={"ID":"9925e645-3cc0-4d07-b219-eb32d0710984","Type":"ContainerStarted","Data":"702c11f47f32979ad5dd526c430ab70d309c9802e1c9a8311d96b6d8403acdbb"}
Jul 20 19:57:00.988611 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:00.988554    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:57:00.990206 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:00.989907    2572 patch_prober.go:28] interesting pod/console-operator-565b7b569d-rtjdf container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 20 19:57:00.990206 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:00.989974    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" podUID="9925e645-3cc0-4d07-b219-eb32d0710984" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 20 19:57:01.004911 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.004705    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wph6n" podStartSLOduration=1.1420066389999999 podStartE2EDuration="11.00468427s" totalImagesPullingTime="9.862677631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:01.004656524 +0000 UTC m=+45.587887413" watchObservedRunningTime="2026-07-20 19:57:01.00468427 +0000 UTC m=+45.587915179"
Jul 20 19:57:01.021454 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.021263    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" podStartSLOduration=10.103333565 podStartE2EDuration="20.021241637s" totalImagesPullingTime="9.917908072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:01.020542592 +0000 UTC m=+45.603773497" watchObservedRunningTime="2026-07-20 19:57:01.021241637 +0000 UTC m=+45.604472523"
Jul 20 19:57:01.992642 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.992610    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/0.log"
Jul 20 19:57:01.993120 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.992652    2572 generic.go:356] "Generic (PLEG): container finished" podID="9925e645-3cc0-4d07-b219-eb32d0710984" containerID="702c11f47f32979ad5dd526c430ab70d309c9802e1c9a8311d96b6d8403acdbb" exitCode=255
Jul 20 19:57:01.993120 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.992683    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" event={"ID":"9925e645-3cc0-4d07-b219-eb32d0710984","Type":"ContainerDied","Data":"702c11f47f32979ad5dd526c430ab70d309c9802e1c9a8311d96b6d8403acdbb"}
Jul 20 19:57:01.993120 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.993005    2572 scope.go:117] "RemoveContainer" containerID="702c11f47f32979ad5dd526c430ab70d309c9802e1c9a8311d96b6d8403acdbb"
Jul 20 19:57:01.994343 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.994316    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w85j4" event={"ID":"c0ce5dad-5ef7-4f53-b4e5-e4f265c99da2","Type":"ContainerStarted","Data":"4b46cd0f047a261d8a200249910a8b481fd46bf581475c3cb840967ed526743b"}
Jul 20 19:57:01.994466 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.994370    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:57:01.997798 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.997774    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a56d85e-03d1-4801-af1f-1ab780210e98" containerID="5089627a84f08da1cc8d1c92a77fc50bd5cdd2c746f04146594123c230e35663" exitCode=0
Jul 20 19:57:01.997911 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.997860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerDied","Data":"5089627a84f08da1cc8d1c92a77fc50bd5cdd2c746f04146594123c230e35663"}
Jul 20 19:57:01.999621 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:01.999603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2d4nx" event={"ID":"7dbf6118-6ad4-4780-8f5c-4034bdb30e25","Type":"ContainerStarted","Data":"90bd9d24ca2510c167706f3f76e02e8d9b221118f2bc6be7b101c453e01bc3e8"}
Jul 20 19:57:02.001710 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.001651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4" event={"ID":"48352dd7-c97e-4a7b-a268-7d089909d34a","Type":"ContainerStarted","Data":"8e79ff80ebc85cb6426964035824bdd695bf2737a425eeccda4c30a199bd4f18"}
Jul 20 19:57:02.003247 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.003226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79" event={"ID":"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1","Type":"ContainerStarted","Data":"76bc9fa8748c3173da2243125f7a5ee19a6e11f118a62bc040418d6b32c6694d"}
Jul 20 19:57:02.005717 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.005696    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx" event={"ID":"1d556cc5-0f02-471f-83b5-ba063ca86391","Type":"ContainerStarted","Data":"8986776cd1a130ca4e1566ad34a3e32b5873cc0f0ebb83a9db0a76bfedec1bcd"}
Jul 20 19:57:02.052321 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.052280    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w85j4" podStartSLOduration=36.207284644 podStartE2EDuration="45.052264256s" totalImagesPullingTime="8.844979612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:02.049901514 +0000 UTC m=+46.633132407" watchObservedRunningTime="2026-07-20 19:57:02.052264256 +0000 UTC m=+46.635495178"
Jul 20 19:57:02.070223 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.070067    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-2d4nx" podStartSLOduration=11.165817289 podStartE2EDuration="21.070044562s" totalImagesPullingTime="9.904227273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:02.068661787 +0000 UTC m=+46.651892676" watchObservedRunningTime="2026-07-20 19:57:02.070044562 +0000 UTC m=+46.653275450"
Jul 20 19:57:02.095045 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.094616    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79" podStartSLOduration=11.214306499 podStartE2EDuration="21.094593788s" totalImagesPullingTime="9.880287289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:02.093468237 +0000 UTC m=+46.676699192" watchObservedRunningTime="2026-07-20 19:57:02.094593788 +0000 UTC m=+46.677824678"
Jul 20 19:57:02.114431 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.114377    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8dc4" podStartSLOduration=11.262469986 podStartE2EDuration="21.114357955s" totalImagesPullingTime="9.851887969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:02.112667423 +0000 UTC m=+46.695898314" watchObservedRunningTime="2026-07-20 19:57:02.114357955 +0000 UTC m=+46.697588846"
Jul 20 19:57:02.132713 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.132662    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx" podStartSLOduration=11.190596858 podStartE2EDuration="21.132647256s" totalImagesPullingTime="9.942050398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:02.131662136 +0000 UTC m=+46.714893023" watchObservedRunningTime="2026-07-20 19:57:02.132647256 +0000 UTC m=+46.715878122"
Jul 20 19:57:02.185715 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.185681    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6ctkx"]
Jul 20 19:57:02.205585 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.205554    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.206587 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.206563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6ctkx"]
Jul 20 19:57:02.208779 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.208576    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-84blb\""
Jul 20 19:57:02.208779 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.208664    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 19:57:02.209399 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.209377    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 19:57:02.294572 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.294540    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.294749 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.294661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x452w\" (UniqueName: \"kubernetes.io/projected/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-api-access-x452w\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.294793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.294757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e0c7885-61aa-4f29-995b-aea292b196ff-crio-socket\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.294793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.294785    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e0c7885-61aa-4f29-995b-aea292b196ff-data-volume\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.294869 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.294802    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.395971 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.395888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e0c7885-61aa-4f29-995b-aea292b196ff-crio-socket\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.395971 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.395922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e0c7885-61aa-4f29-995b-aea292b196ff-data-volume\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.395971 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.395943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.395997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.396016    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e0c7885-61aa-4f29-995b-aea292b196ff-crio-socket\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.396087    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.396097    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x452w\" (UniqueName: \"kubernetes.io/projected/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-api-access-x452w\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.396120    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.396140    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:02.896124189 +0000 UTC m=+47.479355055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : configmap "kube-rbac-proxy" not found
Jul 20 19:57:02.396182 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.396170    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:02.896155585 +0000 UTC m=+47.479386468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:02.396424 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.396228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e0c7885-61aa-4f29-995b-aea292b196ff-data-volume\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.405920 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.405898    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x452w\" (UniqueName: \"kubernetes.io/projected/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-api-access-x452w\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.901083 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.901045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.901258 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:02.901110    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:02.901258 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.901180    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:57:02.901258 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.901211    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:02.901258 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.901230    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:03.901215528 +0000 UTC m=+48.484446395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : configmap "kube-rbac-proxy" not found
Jul 20 19:57:02.901393 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:02.901276    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:03.901261178 +0000 UTC m=+48.484492065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:03.015070 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.015042    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 19:57:03.015497 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.015479    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/0.log"
Jul 20 19:57:03.015558 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.015523    2572 generic.go:356] "Generic (PLEG): container finished" podID="9925e645-3cc0-4d07-b219-eb32d0710984" containerID="fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce" exitCode=255
Jul 20 19:57:03.015626 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.015600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" event={"ID":"9925e645-3cc0-4d07-b219-eb32d0710984","Type":"ContainerDied","Data":"fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce"}
Jul 20 19:57:03.015699 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.015683    2572 scope.go:117] "RemoveContainer" containerID="702c11f47f32979ad5dd526c430ab70d309c9802e1c9a8311d96b6d8403acdbb"
Jul 20 19:57:03.015867 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.015845    2572 scope.go:117] "RemoveContainer" containerID="fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce"
Jul 20 19:57:03.016071 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:03.016047    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-rtjdf_openshift-console-operator(9925e645-3cc0-4d07-b219-eb32d0710984)\"" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" podUID="9925e645-3cc0-4d07-b219-eb32d0710984"
Jul 20 19:57:03.018580 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.018553    2572 generic.go:356] "Generic (PLEG): container finished" podID="8a56d85e-03d1-4801-af1f-1ab780210e98" containerID="27c9a90a4fcc9d17d7c58e6d55cc2a39eae882727c5f701079466544ef20c4c3" exitCode=0
Jul 20 19:57:03.018714 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.018577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerDied","Data":"27c9a90a4fcc9d17d7c58e6d55cc2a39eae882727c5f701079466544ef20c4c3"}
Jul 20 19:57:03.595037 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.594983    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9h22n_8c9992d0-737f-460d-91e2-c99281caa72b/dns-node-resolver/0.log"
Jul 20 19:57:03.910638 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.910547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:03.910811 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:03.910697    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:03.910811 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:03.910742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:03.910881 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:03.910839    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:57:03.910881 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:03.910842    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:05.910826648 +0000 UTC m=+50.494057514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:03.910949 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:03.910902    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:05.910888377 +0000 UTC m=+50.494119248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : configmap "kube-rbac-proxy" not found
Jul 20 19:57:04.025276 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:04.025244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" event={"ID":"8a56d85e-03d1-4801-af1f-1ab780210e98","Type":"ContainerStarted","Data":"9c99dcdf4b26384b8f8a3f75e04a03264aca4d6c4a06744061696dcde4f152a0"}
Jul 20 19:57:04.026669 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:04.026652    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 19:57:04.026970 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:04.026956    2572 scope.go:117] "RemoveContainer" containerID="fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce"
Jul 20 19:57:04.027124 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:04.027104    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-rtjdf_openshift-console-operator(9925e645-3cc0-4d07-b219-eb32d0710984)\"" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" podUID="9925e645-3cc0-4d07-b219-eb32d0710984"
Jul 20 19:57:04.051646 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:04.051594    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s2hb5" podStartSLOduration=16.497612886 podStartE2EDuration="47.051577878s" totalImagesPullingTime="30.553964992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:04.049049652 +0000 UTC m=+48.632280541" watchObservedRunningTime="2026-07-20 19:57:04.051577878 +0000 UTC m=+48.634808784"
Jul 20 19:57:04.794933 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:04.794903    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fzhh6_e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4/node-ca/0.log"
Jul 20 19:57:05.400275 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:05.400240    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wph6n_f362015d-26e7-4cb2-9dda-100e6f42d877/serve-healthcheck-canary/0.log"
Jul 20 19:57:05.930804 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:05.930767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:05.930959 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:05.930830    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:05.930959 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:05.930943    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:05.931024 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:05.930972    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:57:05.931024 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:05.931002    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:09.930988125 +0000 UTC m=+54.514218994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:05.931024 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:05.931020    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:09.931007676 +0000 UTC m=+54.514238542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : configmap "kube-rbac-proxy" not found
Jul 20 19:57:06.132784 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.132754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:57:06.132950 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.132795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:57:06.132950 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.132938    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:57:06.133080 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.133025    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls podName:697da59a-495e-47c3-8bbb-e63fc4e4f508 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.133007463 +0000 UTC m=+66.716238351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xmchw" (UID: "697da59a-495e-47c3-8bbb-e63fc4e4f508") : secret "samples-operator-tls" not found
Jul 20 19:57:06.133080 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.133050    2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:57:06.133080 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.133071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:57:06.133202 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.133116    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert podName:26a48c4d-665f-4265-9fc3-ca5602e33a7e nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.133098867 +0000 UTC m=+66.716329758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-kjwp5" (UID: "26a48c4d-665f-4265-9fc3-ca5602e33a7e") : secret "networking-console-plugin-cert" not found
Jul 20 19:57:06.133202 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.133155    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:57:06.133202 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.133165    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6688b656cd-pxppf: secret "image-registry-tls" not found
Jul 20 19:57:06.133202 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.133200    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls podName:c20762f3-f694-4f22-bf76-f14bcca7c20e nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.133188914 +0000 UTC m=+66.716419796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls") pod "image-registry-6688b656cd-pxppf" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e") : secret "image-registry-tls" not found
Jul 20 19:57:06.234080 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.234001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:57:06.234080 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.234051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:57:06.234266 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234132    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:57:06.234266 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234144    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:57:06.234266 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234188    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls podName:4bbe953b-222d-480e-8a1d-db3bf388f7c9 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.234174391 +0000 UTC m=+66.817405271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hcst6" (UID: "4bbe953b-222d-480e-8a1d-db3bf388f7c9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:57:06.234266 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234207    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls podName:4e992044-c007-471a-b45d-2214076982eb nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.23419494 +0000 UTC m=+66.817425806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls") pod "dns-default-q8gn8" (UID: "4e992044-c007-471a-b45d-2214076982eb") : secret "dns-default-metrics-tls" not found
Jul 20 19:57:06.234442 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.234274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:06.234442 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:06.234297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:06.234442 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234385    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:57:06.234442 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234408    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.234400846 +0000 UTC m=+66.817631712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : secret "router-metrics-certs-default" not found
Jul 20 19:57:06.234442 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:06.234430    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle podName:59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:22.234412503 +0000 UTC m=+66.817643386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle") pod "router-default-5458484848-8v9pn" (UID: "59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86") : configmap references non-existent config key: service-ca.crt
Jul 20 19:57:09.968546 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:09.968506    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:09.969152 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:09.968781    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:09.969152 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:09.968922    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:09.969152 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:09.968981    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls podName:1e0c7885-61aa-4f29-995b-aea292b196ff nodeName:}" failed. No retries permitted until 2026-07-20 19:57:17.968967622 +0000 UTC m=+62.552198489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6ctkx" (UID: "1e0c7885-61aa-4f29-995b-aea292b196ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:57:09.969152 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:09.969102    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e0c7885-61aa-4f29-995b-aea292b196ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:10.611640 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:10.611604    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:57:10.612074 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:10.612060    2572 scope.go:117] "RemoveContainer" containerID="fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce"
Jul 20 19:57:10.612243 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:10.612224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-rtjdf_openshift-console-operator(9925e645-3cc0-4d07-b219-eb32d0710984)\"" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" podUID="9925e645-3cc0-4d07-b219-eb32d0710984"
Jul 20 19:57:10.988617 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:10.988530    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:57:11.055537 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:11.055514    2572 scope.go:117] "RemoveContainer" containerID="fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce"
Jul 20 19:57:11.055700 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:11.055679    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-rtjdf_openshift-console-operator(9925e645-3cc0-4d07-b219-eb32d0710984)\"" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" podUID="9925e645-3cc0-4d07-b219-eb32d0710984"
Jul 20 19:57:17.919107 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:17.919078    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-79v8f"
Jul 20 19:57:18.041096 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:18.041060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:18.043285 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:18.043255    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e0c7885-61aa-4f29-995b-aea292b196ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6ctkx\" (UID: \"1e0c7885-61aa-4f29-995b-aea292b196ff\") " pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:18.220950 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:18.220865    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-84blb\""
Jul 20 19:57:18.229497 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:18.229466    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6ctkx"
Jul 20 19:57:18.350814 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:18.350780    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6ctkx"]
Jul 20 19:57:18.353831 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:18.353801    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0c7885_61aa_4f29_995b_aea292b196ff.slice/crio-11cc1306b642f4db6b96cea2391fbc57ea43593c449c10ce9e326f665b482f3f WatchSource:0}: Error finding container 11cc1306b642f4db6b96cea2391fbc57ea43593c449c10ce9e326f665b482f3f: Status 404 returned error can't find the container with id 11cc1306b642f4db6b96cea2391fbc57ea43593c449c10ce9e326f665b482f3f
Jul 20 19:57:19.083112 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:19.083038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6ctkx" event={"ID":"1e0c7885-61aa-4f29-995b-aea292b196ff","Type":"ContainerStarted","Data":"11cc1306b642f4db6b96cea2391fbc57ea43593c449c10ce9e326f665b482f3f"}
Jul 20 19:57:21.719539 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:21.719505    2572 scope.go:117] "RemoveContainer" containerID="fdd9309515120fe78b040f2d4c7a85acba4b6250159df21ae44ed8320eabf4ce"
Jul 20 19:57:22.182208 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.182163    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:57:22.182393 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.182292    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:57:22.182393 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.182325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:57:22.185127 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.185103    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26a48c4d-665f-4265-9fc3-ca5602e33a7e-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-kjwp5\" (UID: \"26a48c4d-665f-4265-9fc3-ca5602e33a7e\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:57:22.185249 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.185108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"image-registry-6688b656cd-pxppf\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") " pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:57:22.185249 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.185108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/697da59a-495e-47c3-8bbb-e63fc4e4f508-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xmchw\" (UID: \"697da59a-495e-47c3-8bbb-e63fc4e4f508\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:57:22.283301 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.283259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:22.283301 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.283304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:22.283553 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.283410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:57:22.283553 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.283447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:57:22.284102 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.284044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-service-ca-bundle\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:22.286145 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.286092    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bbe953b-222d-480e-8a1d-db3bf388f7c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hcst6\" (UID: \"4bbe953b-222d-480e-8a1d-db3bf388f7c9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:57:22.286145 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.286111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e992044-c007-471a-b45d-2214076982eb-metrics-tls\") pod \"dns-default-q8gn8\" (UID: \"4e992044-c007-471a-b45d-2214076982eb\") " pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:57:22.286324 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.286171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86-metrics-certs\") pod \"router-default-5458484848-8v9pn\" (UID: \"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86\") " pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:22.383898 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.383862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:57:22.387741 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.387702    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:57:22.387860 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.387817    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f5clj\""
Jul 20 19:57:22.392618 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.392601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"
Jul 20 19:57:22.393539 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.393526    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xzmhf\""
Jul 20 19:57:22.396918 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.396888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6fe97ec9-b7e1-496f-add0-f616a228e390-original-pull-secret\") pod \"global-pull-secret-syncer-9hj8b\" (UID: \"6fe97ec9-b7e1-496f-add0-f616a228e390\") " pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:57:22.401790 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.401774    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:57:22.433688 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.433645    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8z4s8\""
Jul 20 19:57:22.441567 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.441549    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"
Jul 20 19:57:22.459664 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.459644    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6qw82\""
Jul 20 19:57:22.467453 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.467434    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"
Jul 20 19:57:22.467763 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.467744    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fzgwk\""
Jul 20 19:57:22.476217 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.476196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:57:22.476459 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.476442    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z652g\""
Jul 20 19:57:22.484763 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.484742    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:22.484976 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.484958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:57:22.487198 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.487178    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:57:22.498480 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.498456    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ceedd5-55de-41d6-a0a0-45de41a8b261-metrics-certs\") pod \"network-metrics-daemon-47d7r\" (UID: \"b2ceedd5-55de-41d6-a0a0-45de41a8b261\") " pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:57:22.640818 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.640787    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mmqwm\""
Jul 20 19:57:22.648762 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.648737    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47d7r"
Jul 20 19:57:22.654888 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.654858    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9hj8b"
Jul 20 19:57:22.914793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:22.914693    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5"]
Jul 20 19:57:23.134500 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:23.134464    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a48c4d_665f_4265_9fc3_ca5602e33a7e.slice/crio-c32b6fd03c7b26f80a06b5f88fc4794f1eaa83adb7ec4fa5faadb40327ccf865 WatchSource:0}: Error finding container c32b6fd03c7b26f80a06b5f88fc4794f1eaa83adb7ec4fa5faadb40327ccf865: Status 404 returned error can't find the container with id c32b6fd03c7b26f80a06b5f88fc4794f1eaa83adb7ec4fa5faadb40327ccf865
Jul 20 19:57:23.365135 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.365014    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6688b656cd-pxppf"]
Jul 20 19:57:23.374296 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:23.374209    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20762f3_f694_4f22_bf76_f14bcca7c20e.slice/crio-f2a04b9d9a1163fdbab48ffffa6f0c7b8757bbcb05a4518ead18aa1ad260f878 WatchSource:0}: Error finding container f2a04b9d9a1163fdbab48ffffa6f0c7b8757bbcb05a4518ead18aa1ad260f878: Status 404 returned error can't find the container with id f2a04b9d9a1163fdbab48ffffa6f0c7b8757bbcb05a4518ead18aa1ad260f878
Jul 20 19:57:23.385547 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.385469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw"]
Jul 20 19:57:23.619231 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.619177    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9hj8b"]
Jul 20 19:57:23.623585 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.623483    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6"]
Jul 20 19:57:23.626918 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.625740    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q8gn8"]
Jul 20 19:57:23.634883 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:23.634855    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e992044_c007_471a_b45d_2214076982eb.slice/crio-0bbb0164ebe72e528218d1b3fc4883ec1ea3d4771d6e3e9027bd092875089358 WatchSource:0}: Error finding container 0bbb0164ebe72e528218d1b3fc4883ec1ea3d4771d6e3e9027bd092875089358: Status 404 returned error can't find the container with id 0bbb0164ebe72e528218d1b3fc4883ec1ea3d4771d6e3e9027bd092875089358
Jul 20 19:57:23.635867 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:23.635845    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbe953b_222d_480e_8a1d_db3bf388f7c9.slice/crio-3813d024b72b5510d6ea048472fdabc95297d0b3141b8070910f77cd0f0bfbe3 WatchSource:0}: Error finding container 3813d024b72b5510d6ea048472fdabc95297d0b3141b8070910f77cd0f0bfbe3: Status 404 returned error can't find the container with id 3813d024b72b5510d6ea048472fdabc95297d0b3141b8070910f77cd0f0bfbe3
Jul 20 19:57:23.648529 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.648501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5458484848-8v9pn"]
Jul 20 19:57:23.651331 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:23.651307    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47d7r"]
Jul 20 19:57:23.652337 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:23.652305    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ebc42a_ddc7_4a6a_95f1_cc8a3e382b86.slice/crio-362120692add78c7412a036d723e09db73303a1779161a282e505423581e086b WatchSource:0}: Error finding container 362120692add78c7412a036d723e09db73303a1779161a282e505423581e086b: Status 404 returned error can't find the container with id 362120692add78c7412a036d723e09db73303a1779161a282e505423581e086b
Jul 20 19:57:23.655198 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:23.655148    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ceedd5_55de_41d6_a0a0_45de41a8b261.slice/crio-c268d636e242c55d8eabe656ec18d72784ce5c026e1b816fa66da342583e60fd WatchSource:0}: Error finding container c268d636e242c55d8eabe656ec18d72784ce5c026e1b816fa66da342583e60fd: Status 404 returned error can't find the container with id c268d636e242c55d8eabe656ec18d72784ce5c026e1b816fa66da342583e60fd
Jul 20 19:57:24.108409 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.107949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6688b656cd-pxppf" event={"ID":"c20762f3-f694-4f22-bf76-f14bcca7c20e","Type":"ContainerStarted","Data":"962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155"}
Jul 20 19:57:24.108409 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.108013    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6688b656cd-pxppf" event={"ID":"c20762f3-f694-4f22-bf76-f14bcca7c20e","Type":"ContainerStarted","Data":"f2a04b9d9a1163fdbab48ffffa6f0c7b8757bbcb05a4518ead18aa1ad260f878"}
Jul 20 19:57:24.108409 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.108169    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:57:24.113192 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.113167    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 19:57:24.113313 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.113257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf" event={"ID":"9925e645-3cc0-4d07-b219-eb32d0710984","Type":"ContainerStarted","Data":"cdd07032e61c3191aac02eedfc01308b73568dba8c72d476229679639ab8978e"}
Jul 20 19:57:24.115242 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.115187    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:57:24.117630 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.117568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9hj8b" event={"ID":"6fe97ec9-b7e1-496f-add0-f616a228e390","Type":"ContainerStarted","Data":"cbd94cbfa8a090ffa92f4803321b75bbb4fb59de5cbefab839765fbd8a926f77"}
Jul 20 19:57:24.120462 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.119972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5458484848-8v9pn" event={"ID":"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86","Type":"ContainerStarted","Data":"c0543922c739e3e3dffc273ac5b7dea1b73a99153283cc0ec5a5d4fcdaa72090"}
Jul 20 19:57:24.120462 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.120010    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5458484848-8v9pn" event={"ID":"59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86","Type":"ContainerStarted","Data":"362120692add78c7412a036d723e09db73303a1779161a282e505423581e086b"}
Jul 20 19:57:24.124141 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.124068    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw" event={"ID":"697da59a-495e-47c3-8bbb-e63fc4e4f508","Type":"ContainerStarted","Data":"32749764f417f3ebdcce9b68d25c494908c6ba000d5b5e44df3bce363f6959be"}
Jul 20 19:57:24.126109 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.126038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47d7r" event={"ID":"b2ceedd5-55de-41d6-a0a0-45de41a8b261","Type":"ContainerStarted","Data":"c268d636e242c55d8eabe656ec18d72784ce5c026e1b816fa66da342583e60fd"}
Jul 20 19:57:24.129290 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.129239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5" event={"ID":"26a48c4d-665f-4265-9fc3-ca5602e33a7e","Type":"ContainerStarted","Data":"c32b6fd03c7b26f80a06b5f88fc4794f1eaa83adb7ec4fa5faadb40327ccf865"}
Jul 20 19:57:24.130285 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.129458    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6688b656cd-pxppf" podStartSLOduration=67.129441406 podStartE2EDuration="1m7.129441406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:24.128053477 +0000 UTC m=+68.711284365" watchObservedRunningTime="2026-07-20 19:57:24.129441406 +0000 UTC m=+68.712672293"
Jul 20 19:57:24.133930 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.133858    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6ctkx" event={"ID":"1e0c7885-61aa-4f29-995b-aea292b196ff","Type":"ContainerStarted","Data":"08aaf21d4ca6b3ba198b2d062b3bde0c735ad76a936eedbcd63553354c00c79d"}
Jul 20 19:57:24.135941 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.135896    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6" event={"ID":"4bbe953b-222d-480e-8a1d-db3bf388f7c9","Type":"ContainerStarted","Data":"3813d024b72b5510d6ea048472fdabc95297d0b3141b8070910f77cd0f0bfbe3"}
Jul 20 19:57:24.140438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.140378    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q8gn8" event={"ID":"4e992044-c007-471a-b45d-2214076982eb","Type":"ContainerStarted","Data":"0bbb0164ebe72e528218d1b3fc4883ec1ea3d4771d6e3e9027bd092875089358"}
Jul 20 19:57:24.163185 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.162585    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5458484848-8v9pn" podStartSLOduration=43.162562461 podStartE2EDuration="43.162562461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:24.161446648 +0000 UTC m=+68.744677537" watchObservedRunningTime="2026-07-20 19:57:24.162562461 +0000 UTC m=+68.745793349"
Jul 20 19:57:24.485902 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.485779    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:24.489450 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.489187    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:24.622812 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:24.622578    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-rtjdf"
Jul 20 19:57:25.146029 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.145998    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:25.147953 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.147690    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5458484848-8v9pn"
Jul 20 19:57:25.534375 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.534040    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"]
Jul 20 19:57:25.539304 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.538285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.548426 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.546610    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 19:57:25.548426 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.546919    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 19:57:25.548426 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.547143    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 19:57:25.548426 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.547428    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 19:57:25.562479 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.562442    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"]
Jul 20 19:57:25.616168 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.616099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8e31a582-ba6f-43f4-b121-bd6bda991b3e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.616346 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.616277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e31a582-ba6f-43f4-b121-bd6bda991b3e-tmp\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.616346 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.616310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c96m7\" (UniqueName: \"kubernetes.io/projected/8e31a582-ba6f-43f4-b121-bd6bda991b3e-kube-api-access-c96m7\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.633375 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.633342    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-484mh"]
Jul 20 19:57:25.636766 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.636741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:25.640905 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.640098    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 19:57:25.640905 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.640439    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 19:57:25.640905 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.640671    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6jvwh\""
Jul 20 19:57:25.660287 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.660237    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-484mh"]
Jul 20 19:57:25.718637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.717767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8e31a582-ba6f-43f4-b121-bd6bda991b3e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.718637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.717825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e31a582-ba6f-43f4-b121-bd6bda991b3e-tmp\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.718637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.717861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c96m7\" (UniqueName: \"kubernetes.io/projected/8e31a582-ba6f-43f4-b121-bd6bda991b3e-kube-api-access-c96m7\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.718637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.717898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sm7d\" (UniqueName: \"kubernetes.io/projected/1194b684-4a02-4d92-800b-0d4fca7bb2fe-kube-api-access-4sm7d\") pod \"downloads-5bc67dcd46-484mh\" (UID: \"1194b684-4a02-4d92-800b-0d4fca7bb2fe\") " pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:25.719005 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.718803    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e31a582-ba6f-43f4-b121-bd6bda991b3e-tmp\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.723675 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.723628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8e31a582-ba6f-43f4-b121-bd6bda991b3e-klusterlet-config\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.740080 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.740020    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c96m7\" (UniqueName: \"kubernetes.io/projected/8e31a582-ba6f-43f4-b121-bd6bda991b3e-kube-api-access-c96m7\") pod \"klusterlet-addon-workmgr-6745fbc88c-7g662\" (UID: \"8e31a582-ba6f-43f4-b121-bd6bda991b3e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.819043 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.818945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sm7d\" (UniqueName: \"kubernetes.io/projected/1194b684-4a02-4d92-800b-0d4fca7bb2fe-kube-api-access-4sm7d\") pod \"downloads-5bc67dcd46-484mh\" (UID: \"1194b684-4a02-4d92-800b-0d4fca7bb2fe\") " pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:25.829686 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.829628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sm7d\" (UniqueName: \"kubernetes.io/projected/1194b684-4a02-4d92-800b-0d4fca7bb2fe-kube-api-access-4sm7d\") pod \"downloads-5bc67dcd46-484mh\" (UID: \"1194b684-4a02-4d92-800b-0d4fca7bb2fe\") " pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:25.860673 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.860626    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:25.951438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:25.951390    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:30.739164 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:30.739115    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-484mh"]
Jul 20 19:57:31.421168 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:31.421134    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1194b684_4a02_4d92_800b_0d4fca7bb2fe.slice/crio-6df1fce56cad8820f70e1f23c724fde6645c64fcff8bed631d9ba1cc844fd67c WatchSource:0}: Error finding container 6df1fce56cad8820f70e1f23c724fde6645c64fcff8bed631d9ba1cc844fd67c: Status 404 returned error can't find the container with id 6df1fce56cad8820f70e1f23c724fde6645c64fcff8bed631d9ba1cc844fd67c
Jul 20 19:57:31.738559 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:31.738497    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"]
Jul 20 19:57:32.175525 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.175485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6ctkx" event={"ID":"1e0c7885-61aa-4f29-995b-aea292b196ff","Type":"ContainerStarted","Data":"62962eb165ae5749fc9266d1c452d5d958983d7ee7b35881586b4bd21fa1c1c0"}
Jul 20 19:57:32.177261 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.177172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6" event={"ID":"4bbe953b-222d-480e-8a1d-db3bf388f7c9","Type":"ContainerStarted","Data":"5fb1cd056a3f7fc8b9d55062812f2a6bd3f60b8fcdd03fa442a638d2078612cd"}
Jul 20 19:57:32.178462 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.178434    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-484mh" event={"ID":"1194b684-4a02-4d92-800b-0d4fca7bb2fe","Type":"ContainerStarted","Data":"6df1fce56cad8820f70e1f23c724fde6645c64fcff8bed631d9ba1cc844fd67c"}
Jul 20 19:57:32.180057 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.180010    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9hj8b" event={"ID":"6fe97ec9-b7e1-496f-add0-f616a228e390","Type":"ContainerStarted","Data":"3fc4b09c4a49adc4ccb9720a5d06fed0d7b13251b8e220f3e1696b8a476cd5df"}
Jul 20 19:57:32.181994 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.181971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw" event={"ID":"697da59a-495e-47c3-8bbb-e63fc4e4f508","Type":"ContainerStarted","Data":"5f80882b52f33d056d0335fbcb01d6f788022fb64047b8910b98b9e9dee6f895"}
Jul 20 19:57:32.182107 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.182021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw" event={"ID":"697da59a-495e-47c3-8bbb-e63fc4e4f508","Type":"ContainerStarted","Data":"4220685e9c579bdedb4de1c2d67628ffa07924d6f2fe9b9244fc1bb52c8dfc40"}
Jul 20 19:57:32.183776 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.183752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47d7r" event={"ID":"b2ceedd5-55de-41d6-a0a0-45de41a8b261","Type":"ContainerStarted","Data":"5b96808e105d548ae2a2696f2ac0ebdb619d8e7227d8cb2fddb9d92cf47a6011"}
Jul 20 19:57:32.183874 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.183801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47d7r" event={"ID":"b2ceedd5-55de-41d6-a0a0-45de41a8b261","Type":"ContainerStarted","Data":"75b3dd562e4864e65f83db071ab557823c1afe85e9313198268f57a70527cace"}
Jul 20 19:57:32.185207 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.185184    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5" event={"ID":"26a48c4d-665f-4265-9fc3-ca5602e33a7e","Type":"ContainerStarted","Data":"7919999278f643aea5f151b115b06a34ce03854b9d9cfa09422d427dd284758a"}
Jul 20 19:57:32.186358 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.186339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662" event={"ID":"8e31a582-ba6f-43f4-b121-bd6bda991b3e","Type":"ContainerStarted","Data":"0d48171ce9faf5ba00d38119ebf3a0322eea6908d2884a3d4a7913c24167b6a6"}
Jul 20 19:57:32.188456 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.188432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q8gn8" event={"ID":"4e992044-c007-471a-b45d-2214076982eb","Type":"ContainerStarted","Data":"5a6607d8c8b5a1dde3ef25b9fc49749bf2bb723ca42e9062b22fc514bd6725e2"}
Jul 20 19:57:32.188538 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.188475    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q8gn8" event={"ID":"4e992044-c007-471a-b45d-2214076982eb","Type":"ContainerStarted","Data":"fed33163ddb09b66d997d6aa54b190b0a3f5ce0c482bbd231f9dee488d4a703d"}
Jul 20 19:57:32.188882 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.188867    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:57:32.194184 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.194078    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hcst6" podStartSLOduration=43.25326531 podStartE2EDuration="51.194059057s" totalImagesPullingTime="7.940793747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.192934875 +0000 UTC m=+76.776165762" watchObservedRunningTime="2026-07-20 19:57:32.194059057 +0000 UTC m=+76.777289945"
Jul 20 19:57:32.209492 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.209428    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9hj8b" podStartSLOduration=67.263720733 podStartE2EDuration="1m15.209407551s" totalImagesPullingTime="7.945686818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.208829452 +0000 UTC m=+76.792060343" watchObservedRunningTime="2026-07-20 19:57:32.209407551 +0000 UTC m=+76.792638437"
Jul 20 19:57:32.227387 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.227339    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q8gn8" podStartSLOduration=34.602709797 podStartE2EDuration="42.227324005s" totalImagesPullingTime="7.624614208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.226335526 +0000 UTC m=+76.809566414" watchObservedRunningTime="2026-07-20 19:57:32.227324005 +0000 UTC m=+76.810554893"
Jul 20 19:57:32.243447 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.243387    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xmchw" podStartSLOduration=43.425794247 podStartE2EDuration="51.243365795s" totalImagesPullingTime="7.817571548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.242190464 +0000 UTC m=+76.825421354" watchObservedRunningTime="2026-07-20 19:57:32.243365795 +0000 UTC m=+76.826596684"
Jul 20 19:57:32.269539 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.269481    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-47d7r" podStartSLOduration=67.665174737 podStartE2EDuration="1m15.269466455s" totalImagesPullingTime="7.604291718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.268170786 +0000 UTC m=+76.851401672" watchObservedRunningTime="2026-07-20 19:57:32.269466455 +0000 UTC m=+76.852697342"
Jul 20 19:57:32.291308 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:32.290942    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-kjwp5" podStartSLOduration=45.39945333 podStartE2EDuration="51.290886921s" totalImagesPullingTime="5.891433591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.289303885 +0000 UTC m=+76.872534774" watchObservedRunningTime="2026-07-20 19:57:32.290886921 +0000 UTC m=+76.874117810"
Jul 20 19:57:33.021589 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:33.021065    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w85j4"
Jul 20 19:57:39.236418 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:39.236372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6ctkx" event={"ID":"1e0c7885-61aa-4f29-995b-aea292b196ff","Type":"ContainerStarted","Data":"f3c63a0c46b51cf973c0d6e2700ae0076f18ca80182dc6fe7a080c22561dabca"}
Jul 20 19:57:39.238084 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:39.238025    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662" event={"ID":"8e31a582-ba6f-43f4-b121-bd6bda991b3e","Type":"ContainerStarted","Data":"0a75dd80747e6093a9d00829e53f89b27e5357cbf4f2da6f951d7f8af614fc7b"}
Jul 20 19:57:39.238216 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:39.238191    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:39.240443 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:39.240419    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662"
Jul 20 19:57:39.256261 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:39.256205    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6ctkx" podStartSLOduration=17.650727692 podStartE2EDuration="37.25618658s" totalImagesPullingTime="19.605458888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:57:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:39.254922946 +0000 UTC m=+83.838153835" watchObservedRunningTime="2026-07-20 19:57:39.25618658 +0000 UTC m=+83.839417467"
Jul 20 19:57:39.272634 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:39.272564    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6745fbc88c-7g662" podStartSLOduration=7.76497692 podStartE2EDuration="14.272539834s" totalImagesPullingTime="6.507562914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:39.271584226 +0000 UTC m=+83.854815144" watchObservedRunningTime="2026-07-20 19:57:39.272539834 +0000 UTC m=+83.855770724"
Jul 20 19:57:43.215640 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.215610    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q8gn8"
Jul 20 19:57:43.751706 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.751670    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fm6mp"]
Jul 20 19:57:43.758317 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.758289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.761240 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.761189    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hqfdn\""
Jul 20 19:57:43.761240 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.761241    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 19:57:43.761884 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.761847    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 19:57:43.762001 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.761894    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 19:57:43.762001 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.761854    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 19:57:43.764512 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764489    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-textfile\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-tls\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-sys\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-root\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764637 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-metrics-client-ca\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764886 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-accelerators-collector-config\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764886 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764794    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8hnh\" (UniqueName: \"kubernetes.io/projected/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-kube-api-access-s8hnh\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.764886 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.764816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-wtmp\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865371 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865371 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865380    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-textfile\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-tls\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-sys\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-root\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-metrics-client-ca\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-accelerators-collector-config\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8hnh\" (UniqueName: \"kubernetes.io/projected/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-kube-api-access-s8hnh\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865560    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-sys\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-wtmp\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:43.865666    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865688    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-wtmp\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.865793 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-root\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.866300 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.865767    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-textfile\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.866300 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:57:43.866280    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-tls podName:e91712e2-7a9f-4b2e-90a6-6d171a9c2e94 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:44.366251248 +0000 UTC m=+88.949482121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-tls") pod "node-exporter-fm6mp" (UID: "e91712e2-7a9f-4b2e-90a6-6d171a9c2e94") : secret "node-exporter-tls" not found
Jul 20 19:57:43.866620 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.866580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-metrics-client-ca\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.868432 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.866805    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-accelerators-collector-config\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.869531 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.868887    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:43.882336 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:43.882308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8hnh\" (UniqueName: \"kubernetes.io/projected/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-kube-api-access-s8hnh\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:44.371158 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:44.371112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-tls\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:44.374071 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:44.374006    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91712e2-7a9f-4b2e-90a6-6d171a9c2e94-node-exporter-tls\") pod \"node-exporter-fm6mp\" (UID: \"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94\") " pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:44.669381 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:44.669285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fm6mp"
Jul 20 19:57:45.151064 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:45.151033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:57:48.716126 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:48.716093    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6688b656cd-pxppf"]
Jul 20 19:57:49.077880 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:57:49.077847    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91712e2_7a9f_4b2e_90a6_6d171a9c2e94.slice/crio-083e8025c740e91b043b3847c21396437ade8eed97abac2991d11ac943f96718 WatchSource:0}: Error finding container 083e8025c740e91b043b3847c21396437ade8eed97abac2991d11ac943f96718: Status 404 returned error can't find the container with id 083e8025c740e91b043b3847c21396437ade8eed97abac2991d11ac943f96718
Jul 20 19:57:49.286326 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:49.286288    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6mp" event={"ID":"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94","Type":"ContainerStarted","Data":"083e8025c740e91b043b3847c21396437ade8eed97abac2991d11ac943f96718"}
Jul 20 19:57:50.293559 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:50.293518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-484mh" event={"ID":"1194b684-4a02-4d92-800b-0d4fca7bb2fe","Type":"ContainerStarted","Data":"ef7eaa79432a7365e09dc93a888458f35f17312a8ac3558627b3be821c4a79a1"}
Jul 20 19:57:50.294038 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:50.293762    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:50.311148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:50.311115    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-484mh"
Jul 20 19:57:50.317893 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:50.317839    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-484mh" podStartSLOduration=7.295300027 podStartE2EDuration="25.317817713s" totalImagesPullingTime="18.022517686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:50.315240615 +0000 UTC m=+94.898471521" watchObservedRunningTime="2026-07-20 19:57:50.317817713 +0000 UTC m=+94.901048599"
Jul 20 19:57:51.300349 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:51.300301    2572 generic.go:356] "Generic (PLEG): container finished" podID="e91712e2-7a9f-4b2e-90a6-6d171a9c2e94" containerID="ececd94e570f9480c79d8025bba81996d7fcbec574ea747423185b02050718e5" exitCode=0
Jul 20 19:57:51.300845 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:51.300391    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6mp" event={"ID":"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94","Type":"ContainerDied","Data":"ececd94e570f9480c79d8025bba81996d7fcbec574ea747423185b02050718e5"}
Jul 20 19:57:52.309539 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:52.309490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6mp" event={"ID":"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94","Type":"ContainerStarted","Data":"079e79a3fff58ad112749e412d31474de3a7d091e3e1e6afb85717f84213a56c"}
Jul 20 19:57:52.310016 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:52.309600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fm6mp" event={"ID":"e91712e2-7a9f-4b2e-90a6-6d171a9c2e94","Type":"ContainerStarted","Data":"6d79dfbfe6a5f83721d7d2e33b5a79ecc563a6bfe2856838013461b7d78f7a31"}
Jul 20 19:57:52.328038 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:57:52.327977    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fm6mp" podStartSLOduration=7.8668577079999995 podStartE2EDuration="9.327959518s" totalImagesPullingTime="1.357302295s" totalInitContainerRuntime="103.799515ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:52.327274323 +0000 UTC m=+96.910505215" watchObservedRunningTime="2026-07-20 19:57:52.327959518 +0000 UTC m=+96.911190406"
Jul 20 19:58:13.742228 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:13.742181    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6688b656cd-pxppf" podUID="c20762f3-f694-4f22-bf76-f14bcca7c20e" containerName="registry" containerID="cri-o://962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155" gracePeriod=30
Jul 20 19:58:14.021071 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.020995    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:58:14.124405 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124371    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-image-registry-private-configuration\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124579 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124419    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-bound-sa-token\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124579 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124461    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124579 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124488    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-certificates\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124579 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124515    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c20762f3-f694-4f22-bf76-f14bcca7c20e-ca-trust-extracted\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124579 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-installation-pull-secrets\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124849 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124586    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-trusted-ca\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.124849 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124608    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rwn\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-kube-api-access-59rwn\") pod \"c20762f3-f694-4f22-bf76-f14bcca7c20e\" (UID: \"c20762f3-f694-4f22-bf76-f14bcca7c20e\") "
Jul 20 19:58:14.125087 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.124969    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:58:14.125472 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.125441    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:58:14.127035 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.126999    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:58:14.127152 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.127082    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:58:14.127258 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.127230    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-kube-api-access-59rwn" (OuterVolumeSpecName: "kube-api-access-59rwn") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "kube-api-access-59rwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:58:14.127376 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.127232    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:58:14.127376 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.127299    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:58:14.133328 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.133289    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20762f3-f694-4f22-bf76-f14bcca7c20e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c20762f3-f694-4f22-bf76-f14bcca7c20e" (UID: "c20762f3-f694-4f22-bf76-f14bcca7c20e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:14.225689 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225657    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-image-registry-private-configuration\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225689 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225686    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-bound-sa-token\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225689 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225698    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225935 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225707    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-registry-certificates\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225935 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225716    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c20762f3-f694-4f22-bf76-f14bcca7c20e-ca-trust-extracted\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225935 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225737    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c20762f3-f694-4f22-bf76-f14bcca7c20e-installation-pull-secrets\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225935 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225746    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c20762f3-f694-4f22-bf76-f14bcca7c20e-trusted-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.225935 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.225753    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rwn\" (UniqueName: \"kubernetes.io/projected/c20762f3-f694-4f22-bf76-f14bcca7c20e-kube-api-access-59rwn\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 19:58:14.392148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.392110    2572 generic.go:356] "Generic (PLEG): container finished" podID="c20762f3-f694-4f22-bf76-f14bcca7c20e" containerID="962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155" exitCode=0
Jul 20 19:58:14.392148 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.392160    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6688b656cd-pxppf"
Jul 20 19:58:14.392361 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.392171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6688b656cd-pxppf" event={"ID":"c20762f3-f694-4f22-bf76-f14bcca7c20e","Type":"ContainerDied","Data":"962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155"}
Jul 20 19:58:14.392361 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.392220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6688b656cd-pxppf" event={"ID":"c20762f3-f694-4f22-bf76-f14bcca7c20e","Type":"ContainerDied","Data":"f2a04b9d9a1163fdbab48ffffa6f0c7b8757bbcb05a4518ead18aa1ad260f878"}
Jul 20 19:58:14.392361 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.392248    2572 scope.go:117] "RemoveContainer" containerID="962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155"
Jul 20 19:58:14.400739 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.400699    2572 scope.go:117] "RemoveContainer" containerID="962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155"
Jul 20 19:58:14.401003 ip-10-0-128-178 kubenswrapper[2572]: E0720 19:58:14.400977    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155\": container with ID starting with 962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155 not found: ID does not exist" containerID="962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155"
Jul 20 19:58:14.401091 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.401010    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155"} err="failed to get container status \"962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155\": rpc error: code = NotFound desc = could not find container \"962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155\": container with ID starting with 962fd67c2fc5de434f95d19cad0a064aa2c51908dc2aa1459f154c10dcced155 not found: ID does not exist"
Jul 20 19:58:14.412638 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.412614    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6688b656cd-pxppf"]
Jul 20 19:58:14.416546 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.416509    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6688b656cd-pxppf"]
Jul 20 19:58:14.723776 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:14.723681    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c20762f3-f694-4f22-bf76-f14bcca7c20e" path="/var/lib/kubelet/pods/c20762f3-f694-4f22-bf76-f14bcca7c20e/volumes"
Jul 20 19:58:22.423997 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:22.423963    2572 generic.go:356] "Generic (PLEG): container finished" podID="9f9d45ea-8cc0-46ba-b7b3-da28821e45f1" containerID="76bc9fa8748c3173da2243125f7a5ee19a6e11f118a62bc040418d6b32c6694d" exitCode=0
Jul 20 19:58:22.424400 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:22.424026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79" event={"ID":"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1","Type":"ContainerDied","Data":"76bc9fa8748c3173da2243125f7a5ee19a6e11f118a62bc040418d6b32c6694d"}
Jul 20 19:58:22.424400 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:22.424317    2572 scope.go:117] "RemoveContainer" containerID="76bc9fa8748c3173da2243125f7a5ee19a6e11f118a62bc040418d6b32c6694d"
Jul 20 19:58:23.429934 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:23.429895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ptz79" event={"ID":"9f9d45ea-8cc0-46ba-b7b3-da28821e45f1","Type":"ContainerStarted","Data":"0a0d09bbb7756136c4619867d6c8d16e3c83cfe92e2f408f015470c486439c3c"}
Jul 20 19:58:27.445438 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:27.445405    2572 generic.go:356] "Generic (PLEG): container finished" podID="1d556cc5-0f02-471f-83b5-ba063ca86391" containerID="8986776cd1a130ca4e1566ad34a3e32b5873cc0f0ebb83a9db0a76bfedec1bcd" exitCode=0
Jul 20 19:58:27.445917 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:27.445485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx" event={"ID":"1d556cc5-0f02-471f-83b5-ba063ca86391","Type":"ContainerDied","Data":"8986776cd1a130ca4e1566ad34a3e32b5873cc0f0ebb83a9db0a76bfedec1bcd"}
Jul 20 19:58:27.445917 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:27.445832    2572 scope.go:117] "RemoveContainer" containerID="8986776cd1a130ca4e1566ad34a3e32b5873cc0f0ebb83a9db0a76bfedec1bcd"
Jul 20 19:58:28.451874 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:28.451835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jn9cx" event={"ID":"1d556cc5-0f02-471f-83b5-ba063ca86391","Type":"ContainerStarted","Data":"aa0475566c3cc1d9e33268d839b4383e156b5455144009351f079b1a6d40fc37"}
Jul 20 19:58:32.467347 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:32.467311    2572 generic.go:356] "Generic (PLEG): container finished" podID="7dbf6118-6ad4-4780-8f5c-4034bdb30e25" containerID="90bd9d24ca2510c167706f3f76e02e8d9b221118f2bc6be7b101c453e01bc3e8" exitCode=0
Jul 20 19:58:32.467748 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:32.467355    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2d4nx" event={"ID":"7dbf6118-6ad4-4780-8f5c-4034bdb30e25","Type":"ContainerDied","Data":"90bd9d24ca2510c167706f3f76e02e8d9b221118f2bc6be7b101c453e01bc3e8"}
Jul 20 19:58:32.467748 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:32.467707    2572 scope.go:117] "RemoveContainer" containerID="90bd9d24ca2510c167706f3f76e02e8d9b221118f2bc6be7b101c453e01bc3e8"
Jul 20 19:58:33.472405 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:58:33.472371    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2d4nx" event={"ID":"7dbf6118-6ad4-4780-8f5c-4034bdb30e25","Type":"ContainerStarted","Data":"3d9bb9953f748505fc13f6f575a7e4769716cfc00feadadb36e78075fa8b170d"}
Jul 20 19:59:08.313317 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.313236    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69ff497588-6jlmq"]
Jul 20 19:59:08.313709 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.313529    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20762f3-f694-4f22-bf76-f14bcca7c20e" containerName="registry"
Jul 20 19:59:08.313709 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.313539    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20762f3-f694-4f22-bf76-f14bcca7c20e" containerName="registry"
Jul 20 19:59:08.313709 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.313596    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20762f3-f694-4f22-bf76-f14bcca7c20e" containerName="registry"
Jul 20 19:59:08.315420 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.315394    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.317660 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.317643    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 19:59:08.318101 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.318074    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 19:59:08.318196 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.318155    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 19:59:08.318196 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.318168    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 19:59:08.318343 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.318327    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jv6m6\""
Jul 20 19:59:08.320823 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.320804    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 19:59:08.336115 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.336085    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 19:59:08.369893 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.369855    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69ff497588-6jlmq"]
Jul 20 19:59:08.460086 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz4pt\" (UniqueName: \"kubernetes.io/projected/4b6c80cf-c71e-43cc-8067-25d16a074edc-kube-api-access-nz4pt\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460086 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-metrics-client-ca\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460335 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-serving-certs-ca-bundle\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460335 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-telemeter-client-tls\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460335 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460193    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-federate-client-tls\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460335 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460256    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-secret-telemeter-client\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460335 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.460515 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.460336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.561709 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.561664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz4pt\" (UniqueName: \"kubernetes.io/projected/4b6c80cf-c71e-43cc-8067-25d16a074edc-kube-api-access-nz4pt\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.561709 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.561712    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-metrics-client-ca\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.561935 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.561912    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-serving-certs-ca-bundle\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.561994 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.561953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-telemeter-client-tls\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.562039 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.561991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-federate-client-tls\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.562039 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.562030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-secret-telemeter-client\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.562126 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.562056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.562216 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.562191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.562541 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.562512    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-metrics-client-ca\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.562663 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.562632    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-serving-certs-ca-bundle\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.563145 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.563122    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6c80cf-c71e-43cc-8067-25d16a074edc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.564487 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.564427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-telemeter-client-tls\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.564583 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.564516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.564859 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.564841    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-federate-client-tls\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.564964 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.564941    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4b6c80cf-c71e-43cc-8067-25d16a074edc-secret-telemeter-client\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.570305 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.570280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz4pt\" (UniqueName: \"kubernetes.io/projected/4b6c80cf-c71e-43cc-8067-25d16a074edc-kube-api-access-nz4pt\") pod \"telemeter-client-69ff497588-6jlmq\" (UID: \"4b6c80cf-c71e-43cc-8067-25d16a074edc\") " pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.624686 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.624603    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq"
Jul 20 19:59:08.759143 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:08.759111    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69ff497588-6jlmq"]
Jul 20 19:59:08.762009 ip-10-0-128-178 kubenswrapper[2572]: W0720 19:59:08.761982    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6c80cf_c71e_43cc_8067_25d16a074edc.slice/crio-1153bec3fe8939a9e687ba2ed145e4528be10bcde8d3f6e2e80cb9d196590498 WatchSource:0}: Error finding container 1153bec3fe8939a9e687ba2ed145e4528be10bcde8d3f6e2e80cb9d196590498: Status 404 returned error can't find the container with id 1153bec3fe8939a9e687ba2ed145e4528be10bcde8d3f6e2e80cb9d196590498
Jul 20 19:59:09.605861 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:09.605824    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq" event={"ID":"4b6c80cf-c71e-43cc-8067-25d16a074edc","Type":"ContainerStarted","Data":"1153bec3fe8939a9e687ba2ed145e4528be10bcde8d3f6e2e80cb9d196590498"}
Jul 20 19:59:10.610808 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:10.610772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq" event={"ID":"4b6c80cf-c71e-43cc-8067-25d16a074edc","Type":"ContainerStarted","Data":"65ccd616b48ac0f7c6d4d51871543ccdfccddb4274f66cfaa3ce486655bb7fbd"}
Jul 20 19:59:12.621396 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:12.621363    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq" event={"ID":"4b6c80cf-c71e-43cc-8067-25d16a074edc","Type":"ContainerStarted","Data":"0a4192576ce133020c0ac70bda6fe004670f6f0cafce739f04826a7c3baa6863"}
Jul 20 19:59:12.621779 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:12.621421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq" event={"ID":"4b6c80cf-c71e-43cc-8067-25d16a074edc","Type":"ContainerStarted","Data":"f6a3e8b528ea3c2d7aef315350b27d6167f395f442ebd2a62882d4105150e504"}
Jul 20 19:59:12.670645 ip-10-0-128-178 kubenswrapper[2572]: I0720 19:59:12.670591    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69ff497588-6jlmq" podStartSLOduration=1.872193931 podStartE2EDuration="4.670576025s" totalImagesPullingTime="2.798382094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:12.669889127 +0000 UTC m=+177.253120016" watchObservedRunningTime="2026-07-20 19:59:12.670576025 +0000 UTC m=+177.253806913"
Jul 20 20:01:16.623279 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:16.623245    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:01:16.625755 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:16.625711    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:01:16.633815 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:16.633784    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 20:01:34.060548 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.060510    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"]
Jul 20 20:01:34.063849 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.063829    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.066351 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.066326    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 20:01:34.066465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.066363    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 20:01:34.066927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.066912    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hrzfj\""
Jul 20 20:01:34.074707 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.074680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"]
Jul 20 20:01:34.207421 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.207378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vds5\" (UniqueName: \"kubernetes.io/projected/d83da389-7774-44d8-9202-888e30f162ae-kube-api-access-6vds5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.207601 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.207433    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.207601 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.207503    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.308875 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.308837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.309098 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.308903    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vds5\" (UniqueName: \"kubernetes.io/projected/d83da389-7774-44d8-9202-888e30f162ae-kube-api-access-6vds5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.309098 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.308934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.309311 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.309287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.309311 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.309306    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.318115 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.318049    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vds5\" (UniqueName: \"kubernetes.io/projected/d83da389-7774-44d8-9202-888e30f162ae-kube-api-access-6vds5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.372620 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.372594    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:34.501967 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.501801    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"]
Jul 20 20:01:34.504622 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:01:34.504596    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83da389_7774_44d8_9202_888e30f162ae.slice/crio-46457d0a4ae45cd6f86ce22103db705b806e652a6d673ca2142ba896942ffbd3 WatchSource:0}: Error finding container 46457d0a4ae45cd6f86ce22103db705b806e652a6d673ca2142ba896942ffbd3: Status 404 returned error can't find the container with id 46457d0a4ae45cd6f86ce22103db705b806e652a6d673ca2142ba896942ffbd3
Jul 20 20:01:34.506531 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:34.506515    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:01:35.141285 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:35.141244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8" event={"ID":"d83da389-7774-44d8-9202-888e30f162ae","Type":"ContainerStarted","Data":"46457d0a4ae45cd6f86ce22103db705b806e652a6d673ca2142ba896942ffbd3"}
Jul 20 20:01:41.167008 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:41.166969    2572 generic.go:356] "Generic (PLEG): container finished" podID="d83da389-7774-44d8-9202-888e30f162ae" containerID="f80824f25d631aa31f2f60535fbb154a8278c3751b7cdca79fc90fc6a1ce22d0" exitCode=0
Jul 20 20:01:41.167387 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:41.167064    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8" event={"ID":"d83da389-7774-44d8-9202-888e30f162ae","Type":"ContainerDied","Data":"f80824f25d631aa31f2f60535fbb154a8278c3751b7cdca79fc90fc6a1ce22d0"}
Jul 20 20:01:44.180092 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:44.180060    2572 generic.go:356] "Generic (PLEG): container finished" podID="d83da389-7774-44d8-9202-888e30f162ae" containerID="06c628e456906402d9beb91e54d72a424b75add12afd877b92638cd73b9d70cc" exitCode=0
Jul 20 20:01:44.180477 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:44.180146    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8" event={"ID":"d83da389-7774-44d8-9202-888e30f162ae","Type":"ContainerDied","Data":"06c628e456906402d9beb91e54d72a424b75add12afd877b92638cd73b9d70cc"}
Jul 20 20:01:51.209175 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:51.209098    2572 generic.go:356] "Generic (PLEG): container finished" podID="d83da389-7774-44d8-9202-888e30f162ae" containerID="9ba7e0a5c9ba63679af55f15355529d7ffa277c16147f0bb3c27f33102b9ab7f" exitCode=0
Jul 20 20:01:51.209175 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:51.209154    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8" event={"ID":"d83da389-7774-44d8-9202-888e30f162ae","Type":"ContainerDied","Data":"9ba7e0a5c9ba63679af55f15355529d7ffa277c16147f0bb3c27f33102b9ab7f"}
Jul 20 20:01:52.332253 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.332226    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:52.456980 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.456934    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vds5\" (UniqueName: \"kubernetes.io/projected/d83da389-7774-44d8-9202-888e30f162ae-kube-api-access-6vds5\") pod \"d83da389-7774-44d8-9202-888e30f162ae\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") "
Jul 20 20:01:52.457178 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.457013    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-util\") pod \"d83da389-7774-44d8-9202-888e30f162ae\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") "
Jul 20 20:01:52.457178 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.457038    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-bundle\") pod \"d83da389-7774-44d8-9202-888e30f162ae\" (UID: \"d83da389-7774-44d8-9202-888e30f162ae\") "
Jul 20 20:01:52.457712 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.457685    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-bundle" (OuterVolumeSpecName: "bundle") pod "d83da389-7774-44d8-9202-888e30f162ae" (UID: "d83da389-7774-44d8-9202-888e30f162ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:01:52.459187 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.459156    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83da389-7774-44d8-9202-888e30f162ae-kube-api-access-6vds5" (OuterVolumeSpecName: "kube-api-access-6vds5") pod "d83da389-7774-44d8-9202-888e30f162ae" (UID: "d83da389-7774-44d8-9202-888e30f162ae"). InnerVolumeSpecName "kube-api-access-6vds5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:01:52.461075 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.461052    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-util" (OuterVolumeSpecName: "util") pod "d83da389-7774-44d8-9202-888e30f162ae" (UID: "d83da389-7774-44d8-9202-888e30f162ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:01:52.558043 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.558008    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vds5\" (UniqueName: \"kubernetes.io/projected/d83da389-7774-44d8-9202-888e30f162ae-kube-api-access-6vds5\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:01:52.558043 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.558034    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:01:52.558235 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:52.558062    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d83da389-7774-44d8-9202-888e30f162ae-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:01:53.217940 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:53.217902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8" event={"ID":"d83da389-7774-44d8-9202-888e30f162ae","Type":"ContainerDied","Data":"46457d0a4ae45cd6f86ce22103db705b806e652a6d673ca2142ba896942ffbd3"}
Jul 20 20:01:53.218113 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:53.217962    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46457d0a4ae45cd6f86ce22103db705b806e652a6d673ca2142ba896942ffbd3"
Jul 20 20:01:53.218113 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:53.217923    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754086jm8"
Jul 20 20:01:57.289181 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289149    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"]
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289452    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="pull"
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289463    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="pull"
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289470    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="extract"
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289476    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="extract"
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289494    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="util"
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289499    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="util"
Jul 20 20:01:57.289542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.289544    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83da389-7774-44d8-9202-888e30f162ae" containerName="extract"
Jul 20 20:01:57.293074 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.293058    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.295351 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.295330    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 20:01:57.295673 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.295656    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p74wc\""
Jul 20 20:01:57.295748 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.295656    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 20:01:57.305772 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.305748    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"]
Jul 20 20:01:57.394391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.394355    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vngj2\" (UniqueName: \"kubernetes.io/projected/db4ea960-01cd-43c4-a747-8ec519faeab2-kube-api-access-vngj2\") pod \"cert-manager-operator-controller-manager-55c444bf86-rh5bh\" (UID: \"db4ea960-01cd-43c4-a747-8ec519faeab2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.394559 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.394434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db4ea960-01cd-43c4-a747-8ec519faeab2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rh5bh\" (UID: \"db4ea960-01cd-43c4-a747-8ec519faeab2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.495631 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.495589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db4ea960-01cd-43c4-a747-8ec519faeab2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rh5bh\" (UID: \"db4ea960-01cd-43c4-a747-8ec519faeab2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.495746 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.495650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vngj2\" (UniqueName: \"kubernetes.io/projected/db4ea960-01cd-43c4-a747-8ec519faeab2-kube-api-access-vngj2\") pod \"cert-manager-operator-controller-manager-55c444bf86-rh5bh\" (UID: \"db4ea960-01cd-43c4-a747-8ec519faeab2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.496035 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.495997    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db4ea960-01cd-43c4-a747-8ec519faeab2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rh5bh\" (UID: \"db4ea960-01cd-43c4-a747-8ec519faeab2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.504595 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.504577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vngj2\" (UniqueName: \"kubernetes.io/projected/db4ea960-01cd-43c4-a747-8ec519faeab2-kube-api-access-vngj2\") pod \"cert-manager-operator-controller-manager-55c444bf86-rh5bh\" (UID: \"db4ea960-01cd-43c4-a747-8ec519faeab2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.602297 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.602273    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"
Jul 20 20:01:57.735706 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:57.735675    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh"]
Jul 20 20:01:57.739254 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:01:57.739229    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4ea960_01cd_43c4_a747_8ec519faeab2.slice/crio-61a073225ca16c2942d06520889f22e1f3a08ee1eee8e4bdd58f8c4914b4f8c3 WatchSource:0}: Error finding container 61a073225ca16c2942d06520889f22e1f3a08ee1eee8e4bdd58f8c4914b4f8c3: Status 404 returned error can't find the container with id 61a073225ca16c2942d06520889f22e1f3a08ee1eee8e4bdd58f8c4914b4f8c3
Jul 20 20:01:58.240621 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:01:58.240581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh" event={"ID":"db4ea960-01cd-43c4-a747-8ec519faeab2","Type":"ContainerStarted","Data":"61a073225ca16c2942d06520889f22e1f3a08ee1eee8e4bdd58f8c4914b4f8c3"}
Jul 20 20:02:00.251128 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:00.251090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh" event={"ID":"db4ea960-01cd-43c4-a747-8ec519faeab2","Type":"ContainerStarted","Data":"b7a96c6eff6fae63a43f7d881f03c6929ad502ec5d40a45ffa9270dcfdc3d1c0"}
Jul 20 20:02:00.272757 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:00.272693    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rh5bh" podStartSLOduration=1.544577174 podStartE2EDuration="3.272676541s" totalImagesPullingTime="1.728099367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:00.271016456 +0000 UTC m=+344.854247344" watchObservedRunningTime="2026-07-20 20:02:00.272676541 +0000 UTC m=+344.855907428"
Jul 20 20:02:01.464930 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.464892    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"]
Jul 20 20:02:01.468401 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.468383    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.470636 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.470610    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hrzfj\""
Jul 20 20:02:01.470762 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.470652    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 20:02:01.471168 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.471152    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 20:02:01.481709 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.481682    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"]
Jul 20 20:02:01.527603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.527569    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.527788 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.527697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.527788 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.527745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbzs\" (UniqueName: \"kubernetes.io/projected/0184aace-f062-41f7-a577-ac3c84c2d5fe-kube-api-access-sqbzs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.628148 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.628094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.628349 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.628167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbzs\" (UniqueName: \"kubernetes.io/projected/0184aace-f062-41f7-a577-ac3c84c2d5fe-kube-api-access-sqbzs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.628349 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.628205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.628572 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.628551    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.628612 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.628568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.638843 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.638816    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbzs\" (UniqueName: \"kubernetes.io/projected/0184aace-f062-41f7-a577-ac3c84c2d5fe-kube-api-access-sqbzs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.777763 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.777658    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:01.912460 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:01.912428    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"]
Jul 20 20:02:01.915375 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:01.915340    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0184aace_f062_41f7_a577_ac3c84c2d5fe.slice/crio-30e69ca5988487da05ee0ee53a468e59ef713a4387faded9b5283cae01745cba WatchSource:0}: Error finding container 30e69ca5988487da05ee0ee53a468e59ef713a4387faded9b5283cae01745cba: Status 404 returned error can't find the container with id 30e69ca5988487da05ee0ee53a468e59ef713a4387faded9b5283cae01745cba
Jul 20 20:02:02.262234 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:02.262205    2572 generic.go:356] "Generic (PLEG): container finished" podID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerID="2bbe1c5e8606299322be06c43c2e9653e8047d245116f0610805f612b7380380" exitCode=0
Jul 20 20:02:02.262413 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:02.262256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt" event={"ID":"0184aace-f062-41f7-a577-ac3c84c2d5fe","Type":"ContainerDied","Data":"2bbe1c5e8606299322be06c43c2e9653e8047d245116f0610805f612b7380380"}
Jul 20 20:02:02.262413 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:02.262306    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt" event={"ID":"0184aace-f062-41f7-a577-ac3c84c2d5fe","Type":"ContainerStarted","Data":"30e69ca5988487da05ee0ee53a468e59ef713a4387faded9b5283cae01745cba"}
Jul 20 20:02:03.915966 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.915927    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ljp5n"]
Jul 20 20:02:03.919268 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.919245    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:03.921745 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.921702    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 20:02:03.922231 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.922212    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 20:02:03.922320 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.922244    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rrfbj\""
Jul 20 20:02:03.929785 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.929761    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ljp5n"]
Jul 20 20:02:03.944038 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.944000    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/418a9d77-0e2b-449a-ba06-2eea50a0d964-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ljp5n\" (UID: \"418a9d77-0e2b-449a-ba06-2eea50a0d964\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:03.944176 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:03.944090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f98nr\" (UniqueName: \"kubernetes.io/projected/418a9d77-0e2b-449a-ba06-2eea50a0d964-kube-api-access-f98nr\") pod \"cert-manager-webhook-6486ffd997-ljp5n\" (UID: \"418a9d77-0e2b-449a-ba06-2eea50a0d964\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:04.044842 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:04.044801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/418a9d77-0e2b-449a-ba06-2eea50a0d964-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ljp5n\" (UID: \"418a9d77-0e2b-449a-ba06-2eea50a0d964\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:04.045020 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:04.044945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f98nr\" (UniqueName: \"kubernetes.io/projected/418a9d77-0e2b-449a-ba06-2eea50a0d964-kube-api-access-f98nr\") pod \"cert-manager-webhook-6486ffd997-ljp5n\" (UID: \"418a9d77-0e2b-449a-ba06-2eea50a0d964\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:04.057125 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:04.057079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f98nr\" (UniqueName: \"kubernetes.io/projected/418a9d77-0e2b-449a-ba06-2eea50a0d964-kube-api-access-f98nr\") pod \"cert-manager-webhook-6486ffd997-ljp5n\" (UID: \"418a9d77-0e2b-449a-ba06-2eea50a0d964\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:04.057624 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:04.057601    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/418a9d77-0e2b-449a-ba06-2eea50a0d964-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ljp5n\" (UID: \"418a9d77-0e2b-449a-ba06-2eea50a0d964\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:04.238097 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:04.238014    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:04.703505 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:04.703480    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ljp5n"]
Jul 20 20:02:04.706866 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:04.706840    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod418a9d77_0e2b_449a_ba06_2eea50a0d964.slice/crio-59155e7629ddf2595be3e8e57aea1c0cb7783280919c6c45560cbf6289b55233 WatchSource:0}: Error finding container 59155e7629ddf2595be3e8e57aea1c0cb7783280919c6c45560cbf6289b55233: Status 404 returned error can't find the container with id 59155e7629ddf2595be3e8e57aea1c0cb7783280919c6c45560cbf6289b55233
Jul 20 20:02:05.277479 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:05.277444    2572 generic.go:356] "Generic (PLEG): container finished" podID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerID="4504da9fd65ef7646be804f4fe08af38382d11aae01b205572cd646f6a65891a" exitCode=0
Jul 20 20:02:05.277890 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:05.277530    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt" event={"ID":"0184aace-f062-41f7-a577-ac3c84c2d5fe","Type":"ContainerDied","Data":"4504da9fd65ef7646be804f4fe08af38382d11aae01b205572cd646f6a65891a"}
Jul 20 20:02:05.278751 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:05.278717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n" event={"ID":"418a9d77-0e2b-449a-ba06-2eea50a0d964","Type":"ContainerStarted","Data":"59155e7629ddf2595be3e8e57aea1c0cb7783280919c6c45560cbf6289b55233"}
Jul 20 20:02:06.285918 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:06.285885    2572 generic.go:356] "Generic (PLEG): container finished" podID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerID="a687903be4d6870d8b085039e9a94d25fe96779a78672421dbba8ccf4557aef9" exitCode=0
Jul 20 20:02:06.286333 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:06.285981    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt" event={"ID":"0184aace-f062-41f7-a577-ac3c84c2d5fe","Type":"ContainerDied","Data":"a687903be4d6870d8b085039e9a94d25fe96779a78672421dbba8ccf4557aef9"}
Jul 20 20:02:07.429917 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.429892    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:07.472444 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.472406    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-bundle\") pod \"0184aace-f062-41f7-a577-ac3c84c2d5fe\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") "
Jul 20 20:02:07.472611 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.472521    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqbzs\" (UniqueName: \"kubernetes.io/projected/0184aace-f062-41f7-a577-ac3c84c2d5fe-kube-api-access-sqbzs\") pod \"0184aace-f062-41f7-a577-ac3c84c2d5fe\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") "
Jul 20 20:02:07.472611 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.472548    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-util\") pod \"0184aace-f062-41f7-a577-ac3c84c2d5fe\" (UID: \"0184aace-f062-41f7-a577-ac3c84c2d5fe\") "
Jul 20 20:02:07.472971 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.472940    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-bundle" (OuterVolumeSpecName: "bundle") pod "0184aace-f062-41f7-a577-ac3c84c2d5fe" (UID: "0184aace-f062-41f7-a577-ac3c84c2d5fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:02:07.474600 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.474578    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0184aace-f062-41f7-a577-ac3c84c2d5fe-kube-api-access-sqbzs" (OuterVolumeSpecName: "kube-api-access-sqbzs") pod "0184aace-f062-41f7-a577-ac3c84c2d5fe" (UID: "0184aace-f062-41f7-a577-ac3c84c2d5fe"). InnerVolumeSpecName "kube-api-access-sqbzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:02:07.477011 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.476981    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-util" (OuterVolumeSpecName: "util") pod "0184aace-f062-41f7-a577-ac3c84c2d5fe" (UID: "0184aace-f062-41f7-a577-ac3c84c2d5fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:02:07.574080 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.573983    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:02:07.574080 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.574024    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqbzs\" (UniqueName: \"kubernetes.io/projected/0184aace-f062-41f7-a577-ac3c84c2d5fe-kube-api-access-sqbzs\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:02:07.574080 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:07.574039    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0184aace-f062-41f7-a577-ac3c84c2d5fe-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:02:08.296057 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:08.296027    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt"
Jul 20 20:02:08.296248 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:08.296028    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nhlt" event={"ID":"0184aace-f062-41f7-a577-ac3c84c2d5fe","Type":"ContainerDied","Data":"30e69ca5988487da05ee0ee53a468e59ef713a4387faded9b5283cae01745cba"}
Jul 20 20:02:08.296248 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:08.296164    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30e69ca5988487da05ee0ee53a468e59ef713a4387faded9b5283cae01745cba"
Jul 20 20:02:08.297549 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:08.297529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n" event={"ID":"418a9d77-0e2b-449a-ba06-2eea50a0d964","Type":"ContainerStarted","Data":"3a0fc84b67d870c84d11820c5657ffbb172ddc355ee47c94e08d5082495dc171"}
Jul 20 20:02:08.297703 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:08.297689    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:08.316581 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:08.316539    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n" podStartSLOduration=2.657609652 podStartE2EDuration="5.316525037s" totalImagesPullingTime="2.658915385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:08.314821229 +0000 UTC m=+352.898052116" watchObservedRunningTime="2026-07-20 20:02:08.316525037 +0000 UTC m=+352.899755925"
Jul 20 20:02:14.305005 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:14.304973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ljp5n"
Jul 20 20:02:20.876363 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876330    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"]
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876631    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="util"
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876642    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="util"
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876658    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="pull"
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876662    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="pull"
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876672    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="extract"
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876677    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="extract"
Jul 20 20:02:20.876775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.876741    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0184aace-f062-41f7-a577-ac3c84c2d5fe" containerName="extract"
Jul 20 20:02:20.881073 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.881055    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:20.883299 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.883281    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 20:02:20.883364 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.883306    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 20:02:20.884002 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.883984    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hrzfj\""
Jul 20 20:02:20.888614 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.888593    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"]
Jul 20 20:02:20.977903 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.977867    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:20.978079 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.977923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4gtj\" (UniqueName: \"kubernetes.io/projected/0104eaf8-a010-430a-8969-140b3724cdf7-kube-api-access-d4gtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:20.978079 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:20.978002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.079051 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.079015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4gtj\" (UniqueName: \"kubernetes.io/projected/0104eaf8-a010-430a-8969-140b3724cdf7-kube-api-access-d4gtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.079176 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.079070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.079176 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.079132    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.079493 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.079471    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.079526 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.079515    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.087862 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.087831    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4gtj\" (UniqueName: \"kubernetes.io/projected/0104eaf8-a010-430a-8969-140b3724cdf7-kube-api-access-d4gtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.190653 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.190572    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:21.318704 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.318677    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"]
Jul 20 20:02:21.320991 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:21.320966    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0104eaf8_a010_430a_8969_140b3724cdf7.slice/crio-e7d53c8da00fc2dcbc1f7c385f9d4228fed001afb3ec3d81af435f6308b17ec5 WatchSource:0}: Error finding container e7d53c8da00fc2dcbc1f7c385f9d4228fed001afb3ec3d81af435f6308b17ec5: Status 404 returned error can't find the container with id e7d53c8da00fc2dcbc1f7c385f9d4228fed001afb3ec3d81af435f6308b17ec5
Jul 20 20:02:21.351777 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.351744    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8" event={"ID":"0104eaf8-a010-430a-8969-140b3724cdf7","Type":"ContainerStarted","Data":"e7d53c8da00fc2dcbc1f7c385f9d4228fed001afb3ec3d81af435f6308b17ec5"}
Jul 20 20:02:21.791417 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.791380    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6vl8n"]
Jul 20 20:02:21.794135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.794113    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:21.796968 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.796945    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ph6j2\""
Jul 20 20:02:21.817326 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.817298    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6vl8n"]
Jul 20 20:02:21.885511 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.885480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktpb5\" (UniqueName: \"kubernetes.io/projected/690df742-3511-4b53-832a-dec24b80c5a3-kube-api-access-ktpb5\") pod \"cert-manager-55b4d954d5-6vl8n\" (UID: \"690df742-3511-4b53-832a-dec24b80c5a3\") " pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:21.885889 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.885533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690df742-3511-4b53-832a-dec24b80c5a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-6vl8n\" (UID: \"690df742-3511-4b53-832a-dec24b80c5a3\") " pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:21.986489 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.986441    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktpb5\" (UniqueName: \"kubernetes.io/projected/690df742-3511-4b53-832a-dec24b80c5a3-kube-api-access-ktpb5\") pod \"cert-manager-55b4d954d5-6vl8n\" (UID: \"690df742-3511-4b53-832a-dec24b80c5a3\") " pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:21.986758 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.986516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690df742-3511-4b53-832a-dec24b80c5a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-6vl8n\" (UID: \"690df742-3511-4b53-832a-dec24b80c5a3\") " pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:21.994514 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.994487    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/690df742-3511-4b53-832a-dec24b80c5a3-bound-sa-token\") pod \"cert-manager-55b4d954d5-6vl8n\" (UID: \"690df742-3511-4b53-832a-dec24b80c5a3\") " pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:21.994685 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:21.994668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktpb5\" (UniqueName: \"kubernetes.io/projected/690df742-3511-4b53-832a-dec24b80c5a3-kube-api-access-ktpb5\") pod \"cert-manager-55b4d954d5-6vl8n\" (UID: \"690df742-3511-4b53-832a-dec24b80c5a3\") " pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:22.102953 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.102922    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6vl8n"
Jul 20 20:02:22.241498 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.241459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6vl8n"]
Jul 20 20:02:22.244343 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:22.244313    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod690df742_3511_4b53_832a_dec24b80c5a3.slice/crio-0ecf283714f6c6f0cd5e2c32af75a53bc3554a5b2535e0b35023a20c0b952351 WatchSource:0}: Error finding container 0ecf283714f6c6f0cd5e2c32af75a53bc3554a5b2535e0b35023a20c0b952351: Status 404 returned error can't find the container with id 0ecf283714f6c6f0cd5e2c32af75a53bc3554a5b2535e0b35023a20c0b952351
Jul 20 20:02:22.357568 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.357533    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6vl8n" event={"ID":"690df742-3511-4b53-832a-dec24b80c5a3","Type":"ContainerStarted","Data":"e049e0614eead283887d1af7bff63bf89d0bd1c8867d09f4041ef84bcaff036a"}
Jul 20 20:02:22.357751 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.357576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6vl8n" event={"ID":"690df742-3511-4b53-832a-dec24b80c5a3","Type":"ContainerStarted","Data":"0ecf283714f6c6f0cd5e2c32af75a53bc3554a5b2535e0b35023a20c0b952351"}
Jul 20 20:02:22.359011 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.358988    2572 generic.go:356] "Generic (PLEG): container finished" podID="0104eaf8-a010-430a-8969-140b3724cdf7" containerID="abe09c30a37cf7adfb428f4a0e0529b75a035317b1faa7d925e3ae16ecd07cf2" exitCode=0
Jul 20 20:02:22.359107 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.359055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8" event={"ID":"0104eaf8-a010-430a-8969-140b3724cdf7","Type":"ContainerDied","Data":"abe09c30a37cf7adfb428f4a0e0529b75a035317b1faa7d925e3ae16ecd07cf2"}
Jul 20 20:02:22.375304 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:22.375256    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6vl8n" podStartSLOduration=1.375237662 podStartE2EDuration="1.375237662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:22.374811186 +0000 UTC m=+366.958042087" watchObservedRunningTime="2026-07-20 20:02:22.375237662 +0000 UTC m=+366.958468551"
Jul 20 20:02:23.365433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:23.365398    2572 generic.go:356] "Generic (PLEG): container finished" podID="0104eaf8-a010-430a-8969-140b3724cdf7" containerID="9d6c6b8a04b5b1c1a34ee85f0d4b73cb8a7be2edddc4688da6c75fb9e01a9e22" exitCode=0
Jul 20 20:02:23.365866 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:23.365485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8" event={"ID":"0104eaf8-a010-430a-8969-140b3724cdf7","Type":"ContainerDied","Data":"9d6c6b8a04b5b1c1a34ee85f0d4b73cb8a7be2edddc4688da6c75fb9e01a9e22"}
Jul 20 20:02:24.372129 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:24.372090    2572 generic.go:356] "Generic (PLEG): container finished" podID="0104eaf8-a010-430a-8969-140b3724cdf7" containerID="037034dfc1afc5989d9022d029a9958e5dda6d8404e903b0abca1d09d20669b5" exitCode=0
Jul 20 20:02:24.372578 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:24.372170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8" event={"ID":"0104eaf8-a010-430a-8969-140b3724cdf7","Type":"ContainerDied","Data":"037034dfc1afc5989d9022d029a9958e5dda6d8404e903b0abca1d09d20669b5"}
Jul 20 20:02:25.523191 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.523163    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:25.613715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.613678    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-bundle\") pod \"0104eaf8-a010-430a-8969-140b3724cdf7\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") "
Jul 20 20:02:25.613931 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.613774    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4gtj\" (UniqueName: \"kubernetes.io/projected/0104eaf8-a010-430a-8969-140b3724cdf7-kube-api-access-d4gtj\") pod \"0104eaf8-a010-430a-8969-140b3724cdf7\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") "
Jul 20 20:02:25.613931 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.613806    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-util\") pod \"0104eaf8-a010-430a-8969-140b3724cdf7\" (UID: \"0104eaf8-a010-430a-8969-140b3724cdf7\") "
Jul 20 20:02:25.614481 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.614451    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-bundle" (OuterVolumeSpecName: "bundle") pod "0104eaf8-a010-430a-8969-140b3724cdf7" (UID: "0104eaf8-a010-430a-8969-140b3724cdf7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:02:25.615824 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.615787    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0104eaf8-a010-430a-8969-140b3724cdf7-kube-api-access-d4gtj" (OuterVolumeSpecName: "kube-api-access-d4gtj") pod "0104eaf8-a010-430a-8969-140b3724cdf7" (UID: "0104eaf8-a010-430a-8969-140b3724cdf7"). InnerVolumeSpecName "kube-api-access-d4gtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:02:25.619344 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.619318    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-util" (OuterVolumeSpecName: "util") pod "0104eaf8-a010-430a-8969-140b3724cdf7" (UID: "0104eaf8-a010-430a-8969-140b3724cdf7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:02:25.714430 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.714349    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4gtj\" (UniqueName: \"kubernetes.io/projected/0104eaf8-a010-430a-8969-140b3724cdf7-kube-api-access-d4gtj\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:02:25.714430 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.714375    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:02:25.714430 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:25.714384    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0104eaf8-a010-430a-8969-140b3724cdf7-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:02:26.383593 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:26.383562    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8"
Jul 20 20:02:26.383593 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:26.383569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp8cq8" event={"ID":"0104eaf8-a010-430a-8969-140b3724cdf7","Type":"ContainerDied","Data":"e7d53c8da00fc2dcbc1f7c385f9d4228fed001afb3ec3d81af435f6308b17ec5"}
Jul 20 20:02:26.383876 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:26.383615    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7d53c8da00fc2dcbc1f7c385f9d4228fed001afb3ec3d81af435f6308b17ec5"
Jul 20 20:02:34.092075 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092040    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"]
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092331    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="extract"
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092342    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="extract"
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092362    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="util"
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092367    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="util"
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092373    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="pull"
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092378    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="pull"
Jul 20 20:02:34.092465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.092429    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0104eaf8-a010-430a-8969-140b3724cdf7" containerName="extract"
Jul 20 20:02:34.098746 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.098711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.102559 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.102526    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 20:02:34.102559 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.102544    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w6tt6\""
Jul 20 20:02:34.102761 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.102674    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 20:02:34.102831 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.102781    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 20:02:34.105843 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.105827    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 20:02:34.124393 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.124367    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"]
Jul 20 20:02:34.183762 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.183704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrcts\" (UniqueName: \"kubernetes.io/projected/52b2355f-8022-4084-ab80-8bad0093772f-kube-api-access-nrcts\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.183930 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.183772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/52b2355f-8022-4084-ab80-8bad0093772f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.183930 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.183835    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52b2355f-8022-4084-ab80-8bad0093772f-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.183930 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.183870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/52b2355f-8022-4084-ab80-8bad0093772f-manifests\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.184031 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.183944    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52b2355f-8022-4084-ab80-8bad0093772f-tmp\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.285125 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.285084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52b2355f-8022-4084-ab80-8bad0093772f-tmp\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.285366 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.285151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrcts\" (UniqueName: \"kubernetes.io/projected/52b2355f-8022-4084-ab80-8bad0093772f-kube-api-access-nrcts\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.285366 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.285184    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/52b2355f-8022-4084-ab80-8bad0093772f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.285366 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.285208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52b2355f-8022-4084-ab80-8bad0093772f-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.285366 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.285349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/52b2355f-8022-4084-ab80-8bad0093772f-manifests\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.285683 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.285654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/52b2355f-8022-4084-ab80-8bad0093772f-manifests\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.287289 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.287270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52b2355f-8022-4084-ab80-8bad0093772f-tmp\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.287664 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.287641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/52b2355f-8022-4084-ab80-8bad0093772f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.287713 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.287664    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52b2355f-8022-4084-ab80-8bad0093772f-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.300367 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.300346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrcts\" (UniqueName: \"kubernetes.io/projected/52b2355f-8022-4084-ab80-8bad0093772f-kube-api-access-nrcts\") pod \"opendatahub-operator-controller-manager-77cb6d7555-dx7q8\" (UID: \"52b2355f-8022-4084-ab80-8bad0093772f\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.409330 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.409298    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:34.562283 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:34.562259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"]
Jul 20 20:02:34.565017 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:34.564994    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b2355f_8022_4084_ab80_8bad0093772f.slice/crio-36420c39417376f0388b1e6d91a7c22c0bee5fb9984eb8914f79e65d6406ebb5 WatchSource:0}: Error finding container 36420c39417376f0388b1e6d91a7c22c0bee5fb9984eb8914f79e65d6406ebb5: Status 404 returned error can't find the container with id 36420c39417376f0388b1e6d91a7c22c0bee5fb9984eb8914f79e65d6406ebb5
Jul 20 20:02:35.428171 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:35.428134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8" event={"ID":"52b2355f-8022-4084-ab80-8bad0093772f","Type":"ContainerStarted","Data":"36420c39417376f0388b1e6d91a7c22c0bee5fb9984eb8914f79e65d6406ebb5"}
Jul 20 20:02:38.444861 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:38.444826    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8" event={"ID":"52b2355f-8022-4084-ab80-8bad0093772f","Type":"ContainerStarted","Data":"67d6b5e8fce2424e499c787a687f4287c2e31392b94b0f132ad346979ad103b6"}
Jul 20 20:02:39.455449 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:39.455408    2572 generic.go:356] "Generic (PLEG): container finished" podID="52b2355f-8022-4084-ab80-8bad0093772f" containerID="67d6b5e8fce2424e499c787a687f4287c2e31392b94b0f132ad346979ad103b6" exitCode=0
Jul 20 20:02:39.455904 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:39.455485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8" event={"ID":"52b2355f-8022-4084-ab80-8bad0093772f","Type":"ContainerDied","Data":"67d6b5e8fce2424e499c787a687f4287c2e31392b94b0f132ad346979ad103b6"}
Jul 20 20:02:40.462608 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:40.462575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8" event={"ID":"52b2355f-8022-4084-ab80-8bad0093772f","Type":"ContainerStarted","Data":"bf1f92ca757182bf71e4079c4dceda482a09accbf74d92832e18e1f42969ed4b"}
Jul 20 20:02:40.463005 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:40.462657    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:40.500116 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:40.500056    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8" podStartSLOduration=1.971669704 podStartE2EDuration="6.50003666s" totalImagesPullingTime="3.474509549s" totalInitContainerRuntime="1.053857407s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:40.499441083 +0000 UTC m=+385.082671961" watchObservedRunningTime="2026-07-20 20:02:40.50003666 +0000 UTC m=+385.083267548"
Jul 20 20:02:51.469181 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:51.469152    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-dx7q8"
Jul 20 20:02:54.126686 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.126649    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"]
Jul 20 20:02:54.134844 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.134820    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.137329 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.137307    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 20:02:54.137329 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.137324    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8tkln\""
Jul 20 20:02:54.140348 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.140331    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 20:02:54.162161 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.162135    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"]
Jul 20 20:02:54.251280 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.251246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f4d8b41-6984-47ee-be59-c5ef241b4d59-tmp\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.251280 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.251282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4d8b41-6984-47ee-be59-c5ef241b4d59-tls-certs\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.251480 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.251302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmrhh\" (UniqueName: \"kubernetes.io/projected/7f4d8b41-6984-47ee-be59-c5ef241b4d59-kube-api-access-cmrhh\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.352530 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.352493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f4d8b41-6984-47ee-be59-c5ef241b4d59-tmp\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.352530 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.352533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4d8b41-6984-47ee-be59-c5ef241b4d59-tls-certs\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.352767 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.352559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmrhh\" (UniqueName: \"kubernetes.io/projected/7f4d8b41-6984-47ee-be59-c5ef241b4d59-kube-api-access-cmrhh\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.354789 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.354755    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f4d8b41-6984-47ee-be59-c5ef241b4d59-tmp\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.354987 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.354969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4d8b41-6984-47ee-be59-c5ef241b4d59-tls-certs\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.363826 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.363800    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmrhh\" (UniqueName: \"kubernetes.io/projected/7f4d8b41-6984-47ee-be59-c5ef241b4d59-kube-api-access-cmrhh\") pod \"kube-auth-proxy-66fb5dc8ff-w9qtg\" (UID: \"7f4d8b41-6984-47ee-be59-c5ef241b4d59\") " pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.444962 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.444878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"
Jul 20 20:02:54.580256 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:54.580228    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg"]
Jul 20 20:02:54.583529 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:54.583493    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4d8b41_6984_47ee_be59_c5ef241b4d59.slice/crio-72ac84ee9ef8f54daecfbec3aed195d71e7ed3e31b8ed8d492cc01b66d9d5605 WatchSource:0}: Error finding container 72ac84ee9ef8f54daecfbec3aed195d71e7ed3e31b8ed8d492cc01b66d9d5605: Status 404 returned error can't find the container with id 72ac84ee9ef8f54daecfbec3aed195d71e7ed3e31b8ed8d492cc01b66d9d5605
Jul 20 20:02:55.085478 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.085445    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ndvn2"]
Jul 20 20:02:55.089918 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.089892    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.094018 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.093996    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 20:02:55.095128 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.095110    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wtt4n\""
Jul 20 20:02:55.114235 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.114203    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ndvn2"]
Jul 20 20:02:55.259213 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.259181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdefb31a-a504-4945-b71f-61776f9a1731-tls-certs\") pod \"model-serving-api-54d89bd5fc-ndvn2\" (UID: \"cdefb31a-a504-4945-b71f-61776f9a1731\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.259585 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.259244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pn2f\" (UniqueName: \"kubernetes.io/projected/cdefb31a-a504-4945-b71f-61776f9a1731-kube-api-access-8pn2f\") pod \"model-serving-api-54d89bd5fc-ndvn2\" (UID: \"cdefb31a-a504-4945-b71f-61776f9a1731\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.360348 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.360311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pn2f\" (UniqueName: \"kubernetes.io/projected/cdefb31a-a504-4945-b71f-61776f9a1731-kube-api-access-8pn2f\") pod \"model-serving-api-54d89bd5fc-ndvn2\" (UID: \"cdefb31a-a504-4945-b71f-61776f9a1731\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.360529 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.360404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdefb31a-a504-4945-b71f-61776f9a1731-tls-certs\") pod \"model-serving-api-54d89bd5fc-ndvn2\" (UID: \"cdefb31a-a504-4945-b71f-61776f9a1731\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.363324 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.363295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdefb31a-a504-4945-b71f-61776f9a1731-tls-certs\") pod \"model-serving-api-54d89bd5fc-ndvn2\" (UID: \"cdefb31a-a504-4945-b71f-61776f9a1731\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.375093 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.375044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pn2f\" (UniqueName: \"kubernetes.io/projected/cdefb31a-a504-4945-b71f-61776f9a1731-kube-api-access-8pn2f\") pod \"model-serving-api-54d89bd5fc-ndvn2\" (UID: \"cdefb31a-a504-4945-b71f-61776f9a1731\") " pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.400888 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.400859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:55.532926 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.532717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg" event={"ID":"7f4d8b41-6984-47ee-be59-c5ef241b4d59","Type":"ContainerStarted","Data":"72ac84ee9ef8f54daecfbec3aed195d71e7ed3e31b8ed8d492cc01b66d9d5605"}
Jul 20 20:02:55.601531 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.601490    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ndvn2"]
Jul 20 20:02:55.607580 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:55.607554    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdefb31a_a504_4945_b71f_61776f9a1731.slice/crio-05e0924684d0e9aa1b3c051337bc735218f86d54f9d33764331c4be7751bb546 WatchSource:0}: Error finding container 05e0924684d0e9aa1b3c051337bc735218f86d54f9d33764331c4be7751bb546: Status 404 returned error can't find the container with id 05e0924684d0e9aa1b3c051337bc735218f86d54f9d33764331c4be7751bb546
Jul 20 20:02:55.867254 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.867175    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"]
Jul 20 20:02:55.871573 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.871556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.874236 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.874214    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 20:02:55.874577 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.874559    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 20:02:55.874677 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.874613    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 20:02:55.874927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.874910    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 20:02:55.875013 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.874943    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9gdqj\""
Jul 20 20:02:55.892879 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.892858    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"]
Jul 20 20:02:55.966288 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.966288 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966296    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.966522 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9wh\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-kube-api-access-nk9wh\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.966522 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-token\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.966522 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-cacerts\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.966522 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966466    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc5f738b-96c5-4520-a508-12ce17b6d94b-local-certs\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:55.966666 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:55.966528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067656 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9wh\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-kube-api-access-nk9wh\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067656 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-token\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-cacerts\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc5f738b-96c5-4520-a508-12ce17b6d94b-local-certs\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.067927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.067808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.068434 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.068402    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.069984 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.069963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc5f738b-96c5-4520-a508-12ce17b6d94b-local-certs\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.070063 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.070022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.070463 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.070435    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.070538 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.070441    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-cacerts\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.083302 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.083279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-token\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.083476 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.083459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9wh\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-kube-api-access-nk9wh\") pod \"istiod-openshift-gateway-7574459656-stdw2\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.181091 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.181004    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:02:56.326183 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.326112    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"]
Jul 20 20:02:56.330616 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:02:56.330588    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5f738b_96c5_4520_a508_12ce17b6d94b.slice/crio-361094031da56fa52103a4efc5ecaf7ab70a2e346cb1f88b391c3236001ecd28 WatchSource:0}: Error finding container 361094031da56fa52103a4efc5ecaf7ab70a2e346cb1f88b391c3236001ecd28: Status 404 returned error can't find the container with id 361094031da56fa52103a4efc5ecaf7ab70a2e346cb1f88b391c3236001ecd28
Jul 20 20:02:56.540793 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.540688    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2" event={"ID":"cdefb31a-a504-4945-b71f-61776f9a1731","Type":"ContainerStarted","Data":"05e0924684d0e9aa1b3c051337bc735218f86d54f9d33764331c4be7751bb546"}
Jul 20 20:02:56.542324 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:56.542293    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2" event={"ID":"bc5f738b-96c5-4520-a508-12ce17b6d94b","Type":"ContainerStarted","Data":"361094031da56fa52103a4efc5ecaf7ab70a2e346cb1f88b391c3236001ecd28"}
Jul 20 20:02:58.556685 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:58.556629    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2" event={"ID":"cdefb31a-a504-4945-b71f-61776f9a1731","Type":"ContainerStarted","Data":"0d05ae818105d8737ca69ba6b30d5bfaf27ac3b9c233ea604df0c39f7402672f"}
Jul 20 20:02:58.557142 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:58.556769    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:02:58.558461 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:58.558433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg" event={"ID":"7f4d8b41-6984-47ee-be59-c5ef241b4d59","Type":"ContainerStarted","Data":"31d83695c9301c90d5931bf763dba448dc6fcd3187bbd8306a77d886ac2f0738"}
Jul 20 20:02:58.607678 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:58.607619    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2" podStartSLOduration=1.4746562970000001 podStartE2EDuration="3.607600158s" totalImagesPullingTime="2.132943861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:58.607498081 +0000 UTC m=+403.190728969" watchObservedRunningTime="2026-07-20 20:02:58.607600158 +0000 UTC m=+403.190831064"
Jul 20 20:02:58.638541 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:58.638482    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66fb5dc8ff-w9qtg" podStartSLOduration=1.47784262 podStartE2EDuration="4.638465006s" totalImagesPullingTime="3.160622386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:58.637885749 +0000 UTC m=+403.221116639" watchObservedRunningTime="2026-07-20 20:02:58.638465006 +0000 UTC m=+403.221695912"
Jul 20 20:02:59.190124 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:59.190084    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 20:02:59.190189 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:59.190159    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 20:02:59.564560 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:59.564467    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2" event={"ID":"bc5f738b-96c5-4520-a508-12ce17b6d94b","Type":"ContainerStarted","Data":"d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e"}
Jul 20 20:02:59.565007 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:02:59.564690    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:03:00.570944 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:00.570916    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:03:00.607016 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:00.606966    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2" podStartSLOduration=2.752521001 podStartE2EDuration="5.606948511s" totalImagesPullingTime="2.85442751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:59.587230708 +0000 UTC m=+404.170461595" watchObservedRunningTime="2026-07-20 20:03:00.606948511 +0000 UTC m=+405.190179398"
Jul 20 20:03:06.714822 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.714786    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"]
Jul 20 20:03:06.721870 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.721849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:06.724380 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.724359    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 20:03:06.725415 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.725398    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gbbzb\""
Jul 20 20:03:06.756889 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.756862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"]
Jul 20 20:03:06.791262 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.791232    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"]
Jul 20 20:03:06.794418 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.794403    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:06.800823 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.800805    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 20:03:06.800987 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.800968    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-56n5x\""
Jul 20 20:03:06.817941 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.817911    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"]
Jul 20 20:03:06.860574 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.860544    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26be718-040e-426b-995a-b229d07aeaa4-cert\") pod \"kserve-controller-manager-d6f4b65b8-bhqcj\" (UID: \"a26be718-040e-426b-995a-b229d07aeaa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:06.860753 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.860618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwpft\" (UniqueName: \"kubernetes.io/projected/a26be718-040e-426b-995a-b229d07aeaa4-kube-api-access-dwpft\") pod \"kserve-controller-manager-d6f4b65b8-bhqcj\" (UID: \"a26be718-040e-426b-995a-b229d07aeaa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:06.961163 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.961125    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b86b374-6ac7-468e-95e3-13f7d08f619e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9d697\" (UID: \"2b86b374-6ac7-468e-95e3-13f7d08f619e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:06.961331 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.961175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwpft\" (UniqueName: \"kubernetes.io/projected/a26be718-040e-426b-995a-b229d07aeaa4-kube-api-access-dwpft\") pod \"kserve-controller-manager-d6f4b65b8-bhqcj\" (UID: \"a26be718-040e-426b-995a-b229d07aeaa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:06.961331 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.961245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqq9k\" (UniqueName: \"kubernetes.io/projected/2b86b374-6ac7-468e-95e3-13f7d08f619e-kube-api-access-qqq9k\") pod \"llmisvc-controller-manager-777c6bd7d5-9d697\" (UID: \"2b86b374-6ac7-468e-95e3-13f7d08f619e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:06.961331 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.961311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26be718-040e-426b-995a-b229d07aeaa4-cert\") pod \"kserve-controller-manager-d6f4b65b8-bhqcj\" (UID: \"a26be718-040e-426b-995a-b229d07aeaa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:06.963586 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.963567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26be718-040e-426b-995a-b229d07aeaa4-cert\") pod \"kserve-controller-manager-d6f4b65b8-bhqcj\" (UID: \"a26be718-040e-426b-995a-b229d07aeaa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:06.972603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:06.972547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwpft\" (UniqueName: \"kubernetes.io/projected/a26be718-040e-426b-995a-b229d07aeaa4-kube-api-access-dwpft\") pod \"kserve-controller-manager-d6f4b65b8-bhqcj\" (UID: \"a26be718-040e-426b-995a-b229d07aeaa4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:07.032036 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.032003    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:07.062590 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.062559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqq9k\" (UniqueName: \"kubernetes.io/projected/2b86b374-6ac7-468e-95e3-13f7d08f619e-kube-api-access-qqq9k\") pod \"llmisvc-controller-manager-777c6bd7d5-9d697\" (UID: \"2b86b374-6ac7-468e-95e3-13f7d08f619e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:07.062697 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.062629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b86b374-6ac7-468e-95e3-13f7d08f619e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9d697\" (UID: \"2b86b374-6ac7-468e-95e3-13f7d08f619e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:07.064809 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.064786    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b86b374-6ac7-468e-95e3-13f7d08f619e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9d697\" (UID: \"2b86b374-6ac7-468e-95e3-13f7d08f619e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:07.074825 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.074711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqq9k\" (UniqueName: \"kubernetes.io/projected/2b86b374-6ac7-468e-95e3-13f7d08f619e-kube-api-access-qqq9k\") pod \"llmisvc-controller-manager-777c6bd7d5-9d697\" (UID: \"2b86b374-6ac7-468e-95e3-13f7d08f619e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:07.104516 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.104487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:07.185452 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.185421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"]
Jul 20 20:03:07.186786 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:03:07.186697    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26be718_040e_426b_995a_b229d07aeaa4.slice/crio-64d03a746dd0be39ce7d36687e350679f0fd7ff076d7aca651ba04f88237c9db WatchSource:0}: Error finding container 64d03a746dd0be39ce7d36687e350679f0fd7ff076d7aca651ba04f88237c9db: Status 404 returned error can't find the container with id 64d03a746dd0be39ce7d36687e350679f0fd7ff076d7aca651ba04f88237c9db
Jul 20 20:03:07.266947 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.266921    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"]
Jul 20 20:03:07.268985 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:03:07.268956    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b86b374_6ac7_468e_95e3_13f7d08f619e.slice/crio-2a0adebba65b79ec8d000a6a99fa32c44748be5ba08a0ec9608c3249569141f1 WatchSource:0}: Error finding container 2a0adebba65b79ec8d000a6a99fa32c44748be5ba08a0ec9608c3249569141f1: Status 404 returned error can't find the container with id 2a0adebba65b79ec8d000a6a99fa32c44748be5ba08a0ec9608c3249569141f1
Jul 20 20:03:07.603336 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.603302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697" event={"ID":"2b86b374-6ac7-468e-95e3-13f7d08f619e","Type":"ContainerStarted","Data":"2a0adebba65b79ec8d000a6a99fa32c44748be5ba08a0ec9608c3249569141f1"}
Jul 20 20:03:07.604525 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:07.604500    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj" event={"ID":"a26be718-040e-426b-995a-b229d07aeaa4","Type":"ContainerStarted","Data":"64d03a746dd0be39ce7d36687e350679f0fd7ff076d7aca651ba04f88237c9db"}
Jul 20 20:03:09.571010 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:09.570977    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ndvn2"
Jul 20 20:03:10.262818 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:10.262713    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"]
Jul 20 20:03:10.262984 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:10.262962    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2" podUID="bc5f738b-96c5-4520-a508-12ce17b6d94b" containerName="discovery" containerID="cri-o://d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e" gracePeriod=30
Jul 20 20:03:10.623305 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:10.623271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj" event={"ID":"a26be718-040e-426b-995a-b229d07aeaa4","Type":"ContainerStarted","Data":"ff81519328470d6257ff9483413a2627d7cf4fded7d0344553308b430d0d22fa"}
Jul 20 20:03:10.623808 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:10.623533    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:10.683882 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:10.683814    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj" podStartSLOduration=1.9392937890000002 podStartE2EDuration="4.683795204s" totalImagesPullingTime="2.744501415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:10.682064195 +0000 UTC m=+415.265295098" watchObservedRunningTime="2026-07-20 20:03:10.683795204 +0000 UTC m=+415.267026156"
Jul 20 20:03:11.002959 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.002936    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:03:11.098893 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.098867    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc5f738b-96c5-4520-a508-12ce17b6d94b-local-certs\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.098905    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-kubeconfig\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.098949    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-dns-cert\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.098974    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-token\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.098989    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-cacerts\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.099016    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9wh\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-kube-api-access-nk9wh\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099324 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.099073    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-ca-configmap\") pod \"bc5f738b-96c5-4520-a508-12ce17b6d94b\" (UID: \"bc5f738b-96c5-4520-a508-12ce17b6d94b\") "
Jul 20 20:03:11.099657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.099549    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:03:11.101412 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.101380    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:03:11.101412 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.101394    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc5f738b-96c5-4520-a508-12ce17b6d94b-local-certs" (OuterVolumeSpecName: "local-certs") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:03:11.101518 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.101438    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-cacerts" (OuterVolumeSpecName: "cacerts") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:03:11.101518 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.101468    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:03:11.101595 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.101561    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:03:11.101625 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.101596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-kube-api-access-nk9wh" (OuterVolumeSpecName: "kube-api-access-nk9wh") pod "bc5f738b-96c5-4520-a508-12ce17b6d94b" (UID: "bc5f738b-96c5-4520-a508-12ce17b6d94b"). InnerVolumeSpecName "kube-api-access-nk9wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199837    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-dns-cert\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199867    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-token\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199877    2572 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-cacerts\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199885    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9wh\" (UniqueName: \"kubernetes.io/projected/bc5f738b-96c5-4520-a508-12ce17b6d94b-kube-api-access-nk9wh\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199894    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-csr-ca-configmap\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199902    2572 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc5f738b-96c5-4520-a508-12ce17b6d94b-local-certs\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.199923 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.199912    2572 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc5f738b-96c5-4520-a508-12ce17b6d94b-istio-kubeconfig\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:11.629663 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.629632    2572 generic.go:356] "Generic (PLEG): container finished" podID="bc5f738b-96c5-4520-a508-12ce17b6d94b" containerID="d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e" exitCode=0
Jul 20 20:03:11.630198 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.629673    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"
Jul 20 20:03:11.630198 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.629741    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2" event={"ID":"bc5f738b-96c5-4520-a508-12ce17b6d94b","Type":"ContainerDied","Data":"d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e"}
Jul 20 20:03:11.630198 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.629802    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-stdw2" event={"ID":"bc5f738b-96c5-4520-a508-12ce17b6d94b","Type":"ContainerDied","Data":"361094031da56fa52103a4efc5ecaf7ab70a2e346cb1f88b391c3236001ecd28"}
Jul 20 20:03:11.630198 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.629830    2572 scope.go:117] "RemoveContainer" containerID="d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e"
Jul 20 20:03:11.631421 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.631390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697" event={"ID":"2b86b374-6ac7-468e-95e3-13f7d08f619e","Type":"ContainerStarted","Data":"026c88b1eb93cfd8b68d1f7fcb3abcbd090380414f12d7b8903bb4df905bfa8a"}
Jul 20 20:03:11.638657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.638643    2572 scope.go:117] "RemoveContainer" containerID="d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e"
Jul 20 20:03:11.638912 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:03:11.638894    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e\": container with ID starting with d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e not found: ID does not exist" containerID="d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e"
Jul 20 20:03:11.638971 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.638918    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e"} err="failed to get container status \"d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e\": rpc error: code = NotFound desc = could not find container \"d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e\": container with ID starting with d3577ff5f7c2ea7bb47a8fd9c880e4d723fccc5867156da87ed3b81d0af0ab0e not found: ID does not exist"
Jul 20 20:03:11.705612 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.705564    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697" podStartSLOduration=2.093813469 podStartE2EDuration="5.705549538s" totalImagesPullingTime="3.611736069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:11.703045189 +0000 UTC m=+416.286276076" watchObservedRunningTime="2026-07-20 20:03:11.705549538 +0000 UTC m=+416.288780425"
Jul 20 20:03:11.742076 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.742050    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"]
Jul 20 20:03:11.760772 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:11.760742    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-stdw2"]
Jul 20 20:03:12.636691 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:12.636662    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:12.724511 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:12.724474    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc5f738b-96c5-4520-a508-12ce17b6d94b" path="/var/lib/kubelet/pods/bc5f738b-96c5-4520-a508-12ce17b6d94b/volumes"
Jul 20 20:03:41.636892 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:41.636808    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bhqcj"
Jul 20 20:03:43.644285 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:43.644254    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9d697"
Jul 20 20:03:55.019395 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.019352    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krqpg"]
Jul 20 20:03:55.019819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.019739    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc5f738b-96c5-4520-a508-12ce17b6d94b" containerName="discovery"
Jul 20 20:03:55.019819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.019751    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc5f738b-96c5-4520-a508-12ce17b6d94b" containerName="discovery"
Jul 20 20:03:55.019819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.019809    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc5f738b-96c5-4520-a508-12ce17b6d94b" containerName="discovery"
Jul 20 20:03:55.023667 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.023634    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:55.026088 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.026064    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 20:03:55.026088 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.026077    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 20:03:55.026877 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.026860    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5f8mb\""
Jul 20 20:03:55.031867 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.031707    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krqpg"]
Jul 20 20:03:55.166769 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.166704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7c2x\" (UniqueName: \"kubernetes.io/projected/3b120ca5-49d1-40e4-87b3-d153ddad9a09-kube-api-access-b7c2x\") pod \"kuadrant-operator-catalog-krqpg\" (UID: \"3b120ca5-49d1-40e4-87b3-d153ddad9a09\") " pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:55.267929 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.267883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7c2x\" (UniqueName: \"kubernetes.io/projected/3b120ca5-49d1-40e4-87b3-d153ddad9a09-kube-api-access-b7c2x\") pod \"kuadrant-operator-catalog-krqpg\" (UID: \"3b120ca5-49d1-40e4-87b3-d153ddad9a09\") " pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:55.280648 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.280579    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7c2x\" (UniqueName: \"kubernetes.io/projected/3b120ca5-49d1-40e4-87b3-d153ddad9a09-kube-api-access-b7c2x\") pod \"kuadrant-operator-catalog-krqpg\" (UID: \"3b120ca5-49d1-40e4-87b3-d153ddad9a09\") " pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:55.335242 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.335203    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:55.396254 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.396221    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krqpg"]
Jul 20 20:03:55.466485 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.466454    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krqpg"]
Jul 20 20:03:55.470214 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:03:55.470179    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b120ca5_49d1_40e4_87b3_d153ddad9a09.slice/crio-45dc20ebd74b7a42e16aabc570edc27e22ef33e107995903fd860e2a113f1a6b WatchSource:0}: Error finding container 45dc20ebd74b7a42e16aabc570edc27e22ef33e107995903fd860e2a113f1a6b: Status 404 returned error can't find the container with id 45dc20ebd74b7a42e16aabc570edc27e22ef33e107995903fd860e2a113f1a6b
Jul 20 20:03:55.600491 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.600458    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qrxrt"]
Jul 20 20:03:55.603150 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.603135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:03:55.612531 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.612507    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qrxrt"]
Jul 20 20:03:55.771949 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.771913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzb8b\" (UniqueName: \"kubernetes.io/projected/1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d-kube-api-access-tzb8b\") pod \"kuadrant-operator-catalog-qrxrt\" (UID: \"1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d\") " pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:03:55.839203 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.839172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-krqpg" event={"ID":"3b120ca5-49d1-40e4-87b3-d153ddad9a09","Type":"ContainerStarted","Data":"45dc20ebd74b7a42e16aabc570edc27e22ef33e107995903fd860e2a113f1a6b"}
Jul 20 20:03:55.872556 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.872470    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzb8b\" (UniqueName: \"kubernetes.io/projected/1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d-kube-api-access-tzb8b\") pod \"kuadrant-operator-catalog-qrxrt\" (UID: \"1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d\") " pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:03:55.881242 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.881220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzb8b\" (UniqueName: \"kubernetes.io/projected/1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d-kube-api-access-tzb8b\") pod \"kuadrant-operator-catalog-qrxrt\" (UID: \"1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d\") " pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:03:55.912833 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:55.912794    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:03:56.043235 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:56.043211    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qrxrt"]
Jul 20 20:03:56.045217 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:03:56.045185    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c46eaaa_bcab_4ab0_9fd7_c65f3749eb6d.slice/crio-6210f199e4d85574c44f10723bf16f358ecf13e23d25edbd05948e2c48706c37 WatchSource:0}: Error finding container 6210f199e4d85574c44f10723bf16f358ecf13e23d25edbd05948e2c48706c37: Status 404 returned error can't find the container with id 6210f199e4d85574c44f10723bf16f358ecf13e23d25edbd05948e2c48706c37
Jul 20 20:03:56.846685 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:56.846648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt" event={"ID":"1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d","Type":"ContainerStarted","Data":"6210f199e4d85574c44f10723bf16f358ecf13e23d25edbd05948e2c48706c37"}
Jul 20 20:03:58.859168 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:58.859125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt" event={"ID":"1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d","Type":"ContainerStarted","Data":"ddbcf503c3289e997d032a41993c3faa36fab84bd90c7ef6e0fe9406d2c989c1"}
Jul 20 20:03:58.860626 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:58.860603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-krqpg" event={"ID":"3b120ca5-49d1-40e4-87b3-d153ddad9a09","Type":"ContainerStarted","Data":"e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79"}
Jul 20 20:03:58.860762 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:58.860686    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-krqpg" podUID="3b120ca5-49d1-40e4-87b3-d153ddad9a09" containerName="registry-server" containerID="cri-o://e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79" gracePeriod=2
Jul 20 20:03:58.874808 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:58.874756    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt" podStartSLOduration=2.095284707 podStartE2EDuration="3.874713068s" totalImagesPullingTime="1.779428361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:58.873970201 +0000 UTC m=+463.457201083" watchObservedRunningTime="2026-07-20 20:03:58.874713068 +0000 UTC m=+463.457943959"
Jul 20 20:03:58.889159 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:58.889028    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-krqpg" podStartSLOduration=1.537853916 podStartE2EDuration="3.889011051s" totalImagesPullingTime="2.351157135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:58.888615716 +0000 UTC m=+463.471846603" watchObservedRunningTime="2026-07-20 20:03:58.889011051 +0000 UTC m=+463.472241938"
Jul 20 20:03:59.120342 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.120281    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:59.302105 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.302068    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7c2x\" (UniqueName: \"kubernetes.io/projected/3b120ca5-49d1-40e4-87b3-d153ddad9a09-kube-api-access-b7c2x\") pod \"3b120ca5-49d1-40e4-87b3-d153ddad9a09\" (UID: \"3b120ca5-49d1-40e4-87b3-d153ddad9a09\") "
Jul 20 20:03:59.304392 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.304361    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b120ca5-49d1-40e4-87b3-d153ddad9a09-kube-api-access-b7c2x" (OuterVolumeSpecName: "kube-api-access-b7c2x") pod "3b120ca5-49d1-40e4-87b3-d153ddad9a09" (UID: "3b120ca5-49d1-40e4-87b3-d153ddad9a09"). InnerVolumeSpecName "kube-api-access-b7c2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:03:59.403330 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.403247    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7c2x\" (UniqueName: \"kubernetes.io/projected/3b120ca5-49d1-40e4-87b3-d153ddad9a09-kube-api-access-b7c2x\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:03:59.866306 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.866268    2572 generic.go:356] "Generic (PLEG): container finished" podID="3b120ca5-49d1-40e4-87b3-d153ddad9a09" containerID="e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79" exitCode=0
Jul 20 20:03:59.866715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.866320    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-krqpg"
Jul 20 20:03:59.866715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.866351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-krqpg" event={"ID":"3b120ca5-49d1-40e4-87b3-d153ddad9a09","Type":"ContainerDied","Data":"e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79"}
Jul 20 20:03:59.866715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.866400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-krqpg" event={"ID":"3b120ca5-49d1-40e4-87b3-d153ddad9a09","Type":"ContainerDied","Data":"45dc20ebd74b7a42e16aabc570edc27e22ef33e107995903fd860e2a113f1a6b"}
Jul 20 20:03:59.866715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.866420    2572 scope.go:117] "RemoveContainer" containerID="e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79"
Jul 20 20:03:59.875885 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.875869    2572 scope.go:117] "RemoveContainer" containerID="e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79"
Jul 20 20:03:59.876116 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:03:59.876101    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79\": container with ID starting with e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79 not found: ID does not exist" containerID="e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79"
Jul 20 20:03:59.876161 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.876123    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79"} err="failed to get container status \"e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79\": rpc error: code = NotFound desc = could not find container \"e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79\": container with ID starting with e6235fe67b7f5f7f8053917f7282fa3e383aa7608b0f66ee4845f8bce8e9ea79 not found: ID does not exist"
Jul 20 20:03:59.888414 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.888392    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krqpg"]
Jul 20 20:03:59.892940 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:03:59.892915    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-krqpg"]
Jul 20 20:04:00.724530 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:00.724496    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b120ca5-49d1-40e4-87b3-d153ddad9a09" path="/var/lib/kubelet/pods/3b120ca5-49d1-40e4-87b3-d153ddad9a09/volumes"
Jul 20 20:04:05.913886 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:05.913851    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:04:05.914287 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:05.913925    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:04:05.935913 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:05.935887    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:04:06.921979 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:06.921952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qrxrt"
Jul 20 20:04:10.809687 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.809651    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"]
Jul 20 20:04:10.810091 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.809996    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b120ca5-49d1-40e4-87b3-d153ddad9a09" containerName="registry-server"
Jul 20 20:04:10.810091 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.810007    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b120ca5-49d1-40e4-87b3-d153ddad9a09" containerName="registry-server"
Jul 20 20:04:10.810091 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.810067    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b120ca5-49d1-40e4-87b3-d153ddad9a09" containerName="registry-server"
Jul 20 20:04:10.813115 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.813099    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.815340 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.815314    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6r4\""
Jul 20 20:04:10.821383 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.821364    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"]
Jul 20 20:04:10.897028 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.896998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.897214 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.897069    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qknxz\" (UniqueName: \"kubernetes.io/projected/fed2a53d-1fad-401f-a7f0-0e849501a1a4-kube-api-access-qknxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.897214 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.897167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.998048 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.998011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qknxz\" (UniqueName: \"kubernetes.io/projected/fed2a53d-1fad-401f-a7f0-0e849501a1a4-kube-api-access-qknxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.998230 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.998059    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.998230 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.998101    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.998488 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.998467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:10.998534 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:10.998477    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:11.006898 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.006871    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qknxz\" (UniqueName: \"kubernetes.io/projected/fed2a53d-1fad-401f-a7f0-0e849501a1a4-kube-api-access-qknxz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:11.122716 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.122681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:11.259903 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.259867    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"]
Jul 20 20:04:11.262499 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:11.262472    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed2a53d_1fad_401f_a7f0_0e849501a1a4.slice/crio-beead16f80f45586a248171594130fc1f8e77bb9966cbddeca6a87cb550387d7 WatchSource:0}: Error finding container beead16f80f45586a248171594130fc1f8e77bb9966cbddeca6a87cb550387d7: Status 404 returned error can't find the container with id beead16f80f45586a248171594130fc1f8e77bb9966cbddeca6a87cb550387d7
Jul 20 20:04:11.608227 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.608192    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"]
Jul 20 20:04:11.611553 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.611537    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.619963 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.619940    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"]
Jul 20 20:04:11.704819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.704783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mdt\" (UniqueName: \"kubernetes.io/projected/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-kube-api-access-q6mdt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.704819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.704824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.705062 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.704894    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.806008 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.805974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.806171 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.806039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mdt\" (UniqueName: \"kubernetes.io/projected/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-kube-api-access-q6mdt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.806171 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.806068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.806346 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.806327    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.806459 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.806438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.814389 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.814364    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mdt\" (UniqueName: \"kubernetes.io/projected/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-kube-api-access-q6mdt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.920844 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.920760    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:11.924980 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.924953    2572 generic.go:356] "Generic (PLEG): container finished" podID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerID="ee9964fb57b999cefebab35c40441d3d86e03b1b6d28ce6825a66e3a4afd8a40" exitCode=0
Jul 20 20:04:11.925082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.925035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724" event={"ID":"fed2a53d-1fad-401f-a7f0-0e849501a1a4","Type":"ContainerDied","Data":"ee9964fb57b999cefebab35c40441d3d86e03b1b6d28ce6825a66e3a4afd8a40"}
Jul 20 20:04:11.925147 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:11.925093    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724" event={"ID":"fed2a53d-1fad-401f-a7f0-0e849501a1a4","Type":"ContainerStarted","Data":"beead16f80f45586a248171594130fc1f8e77bb9966cbddeca6a87cb550387d7"}
Jul 20 20:04:12.052889 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.052866    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"]
Jul 20 20:04:12.054965 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:12.054939    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4710d2b6_01c5_4b10_bcd8_f19e3a06ae4c.slice/crio-edca7594e2f704fa859efd03a040e68edf2836f59ab3153e3a9ab7ecb1a528d5 WatchSource:0}: Error finding container edca7594e2f704fa859efd03a040e68edf2836f59ab3153e3a9ab7ecb1a528d5: Status 404 returned error can't find the container with id edca7594e2f704fa859efd03a040e68edf2836f59ab3153e3a9ab7ecb1a528d5
Jul 20 20:04:12.486968 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.486921    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"]
Jul 20 20:04:12.492646 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.492613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.498828 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.498799    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"]
Jul 20 20:04:12.512979 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.512943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.513254 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.513225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.513361 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.513283    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6j9b\" (UniqueName: \"kubernetes.io/projected/50cd734a-afcb-4d95-8bab-ca5d88028b94-kube-api-access-g6j9b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.614549 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.614509    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.614811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.614561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6j9b\" (UniqueName: \"kubernetes.io/projected/50cd734a-afcb-4d95-8bab-ca5d88028b94-kube-api-access-g6j9b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.614811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.614602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.614932 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.614913    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.614968 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.614941    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.623249 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.623216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6j9b\" (UniqueName: \"kubernetes.io/projected/50cd734a-afcb-4d95-8bab-ca5d88028b94-kube-api-access-g6j9b\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.802383 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.802345    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:12.822289 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.822262    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"]
Jul 20 20:04:12.825862 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.825841    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:12.834546 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.834520    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"]
Jul 20 20:04:12.917473 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.917434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2294n\" (UniqueName: \"kubernetes.io/projected/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-kube-api-access-2294n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:12.917646 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.917585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:12.917716 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.917641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:12.931596 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.931562    2572 generic.go:356] "Generic (PLEG): container finished" podID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerID="d0fa42380224b3ad14fbe94c5f5e459776b06d3ea619ec6098315170f12bc6a4" exitCode=0
Jul 20 20:04:12.931773 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.931648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n" event={"ID":"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c","Type":"ContainerDied","Data":"d0fa42380224b3ad14fbe94c5f5e459776b06d3ea619ec6098315170f12bc6a4"}
Jul 20 20:04:12.931773 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.931709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n" event={"ID":"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c","Type":"ContainerStarted","Data":"edca7594e2f704fa859efd03a040e68edf2836f59ab3153e3a9ab7ecb1a528d5"}
Jul 20 20:04:12.933639 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.933609    2572 generic.go:356] "Generic (PLEG): container finished" podID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerID="5a5c6369d48a4257f1b4cd627c4d35585044669427366c697868e481e146317c" exitCode=0
Jul 20 20:04:12.933740 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.933674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724" event={"ID":"fed2a53d-1fad-401f-a7f0-0e849501a1a4","Type":"ContainerDied","Data":"5a5c6369d48a4257f1b4cd627c4d35585044669427366c697868e481e146317c"}
Jul 20 20:04:12.941166 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:12.941149    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"]
Jul 20 20:04:12.945846 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:12.945823    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cd734a_afcb_4d95_8bab_ca5d88028b94.slice/crio-5cbcb52c54e4307d2fd6cc7e7bd218c6f9092d611a24be1b63f122796860a2e7 WatchSource:0}: Error finding container 5cbcb52c54e4307d2fd6cc7e7bd218c6f9092d611a24be1b63f122796860a2e7: Status 404 returned error can't find the container with id 5cbcb52c54e4307d2fd6cc7e7bd218c6f9092d611a24be1b63f122796860a2e7
Jul 20 20:04:13.018842 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.018793    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.019017 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.018847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.019017 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.018910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2294n\" (UniqueName: \"kubernetes.io/projected/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-kube-api-access-2294n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.019391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.019277    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.019391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.019331    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.028178 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.028147    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2294n\" (UniqueName: \"kubernetes.io/projected/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-kube-api-access-2294n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.169685 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.169651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:13.301419 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.301388    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"]
Jul 20 20:04:13.303839 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:13.303798    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0381f4_82dd_4879_9a9a_2dd4db6fc127.slice/crio-7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb WatchSource:0}: Error finding container 7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb: Status 404 returned error can't find the container with id 7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb
Jul 20 20:04:13.939792 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.939754    2572 generic.go:356] "Generic (PLEG): container finished" podID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerID="e62a9cd26162f49597d4a766122acc80c693fb26d83a0100369495542d79c77e" exitCode=0
Jul 20 20:04:13.940232 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.939844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf" event={"ID":"8c0381f4-82dd-4879-9a9a-2dd4db6fc127","Type":"ContainerDied","Data":"e62a9cd26162f49597d4a766122acc80c693fb26d83a0100369495542d79c77e"}
Jul 20 20:04:13.940232 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.939903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf" event={"ID":"8c0381f4-82dd-4879-9a9a-2dd4db6fc127","Type":"ContainerStarted","Data":"7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb"}
Jul 20 20:04:13.942034 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.942009    2572 generic.go:356] "Generic (PLEG): container finished" podID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerID="4c5e737b8be91c437f4a1a74d6aa784a473ffaeabe6b4e864b4f3beecb9e94d9" exitCode=0
Jul 20 20:04:13.942152 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.942082    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724" event={"ID":"fed2a53d-1fad-401f-a7f0-0e849501a1a4","Type":"ContainerDied","Data":"4c5e737b8be91c437f4a1a74d6aa784a473ffaeabe6b4e864b4f3beecb9e94d9"}
Jul 20 20:04:13.943839 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.943816    2572 generic.go:356] "Generic (PLEG): container finished" podID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerID="ed95d4c936cfaa0d1a71206389e4621a745d918520bd4c589d0294c2773bd2e5" exitCode=0
Jul 20 20:04:13.943992 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.943917    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n" event={"ID":"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c","Type":"ContainerDied","Data":"ed95d4c936cfaa0d1a71206389e4621a745d918520bd4c589d0294c2773bd2e5"}
Jul 20 20:04:13.945510 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.945487    2572 generic.go:356] "Generic (PLEG): container finished" podID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerID="6710d2936f016f1d9a7321d879c9a54119df33db17ee07f0af983571630fa5ce" exitCode=0
Jul 20 20:04:13.945604 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.945515    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4" event={"ID":"50cd734a-afcb-4d95-8bab-ca5d88028b94","Type":"ContainerDied","Data":"6710d2936f016f1d9a7321d879c9a54119df33db17ee07f0af983571630fa5ce"}
Jul 20 20:04:13.945604 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:13.945557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4" event={"ID":"50cd734a-afcb-4d95-8bab-ca5d88028b94","Type":"ContainerStarted","Data":"5cbcb52c54e4307d2fd6cc7e7bd218c6f9092d611a24be1b63f122796860a2e7"}
Jul 20 20:04:14.952536 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:14.952448    2572 generic.go:356] "Generic (PLEG): container finished" podID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerID="7727fa2a3cccfd2dfdfcaf8ac513d7de78a1bdbc7a44f6c233e6e604e7ff6779" exitCode=0
Jul 20 20:04:14.952536 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:14.952518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n" event={"ID":"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c","Type":"ContainerDied","Data":"7727fa2a3cccfd2dfdfcaf8ac513d7de78a1bdbc7a44f6c233e6e604e7ff6779"}
Jul 20 20:04:14.954219 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:14.954196    2572 generic.go:356] "Generic (PLEG): container finished" podID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerID="04d166dbd43be2a0e27d5ab0d6387abe9a800312a3dca80d8157c80b58287dca" exitCode=0
Jul 20 20:04:14.954338 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:14.954223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4" event={"ID":"50cd734a-afcb-4d95-8bab-ca5d88028b94","Type":"ContainerDied","Data":"04d166dbd43be2a0e27d5ab0d6387abe9a800312a3dca80d8157c80b58287dca"}
Jul 20 20:04:14.956199 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:14.956175    2572 generic.go:356] "Generic (PLEG): container finished" podID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerID="14e11bcd2315b5f42dd109c14c1066864bbd345b852d0a4ad40863f74bd053fc" exitCode=0
Jul 20 20:04:14.956302 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:14.956215    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf" event={"ID":"8c0381f4-82dd-4879-9a9a-2dd4db6fc127","Type":"ContainerDied","Data":"14e11bcd2315b5f42dd109c14c1066864bbd345b852d0a4ad40863f74bd053fc"}
Jul 20 20:04:15.112986 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.112958    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:15.137585 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.137558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qknxz\" (UniqueName: \"kubernetes.io/projected/fed2a53d-1fad-401f-a7f0-0e849501a1a4-kube-api-access-qknxz\") pod \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") "
Jul 20 20:04:15.137775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.137614    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-bundle\") pod \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") "
Jul 20 20:04:15.137775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.137677    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-util\") pod \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\" (UID: \"fed2a53d-1fad-401f-a7f0-0e849501a1a4\") "
Jul 20 20:04:15.138177 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.138148    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-bundle" (OuterVolumeSpecName: "bundle") pod "fed2a53d-1fad-401f-a7f0-0e849501a1a4" (UID: "fed2a53d-1fad-401f-a7f0-0e849501a1a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:15.139603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.139575    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fed2a53d-1fad-401f-a7f0-0e849501a1a4-kube-api-access-qknxz" (OuterVolumeSpecName: "kube-api-access-qknxz") pod "fed2a53d-1fad-401f-a7f0-0e849501a1a4" (UID: "fed2a53d-1fad-401f-a7f0-0e849501a1a4"). InnerVolumeSpecName "kube-api-access-qknxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:04:15.143102 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.143076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-util" (OuterVolumeSpecName: "util") pod "fed2a53d-1fad-401f-a7f0-0e849501a1a4" (UID: "fed2a53d-1fad-401f-a7f0-0e849501a1a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:15.239013 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.238923    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:15.239013 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.238956    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qknxz\" (UniqueName: \"kubernetes.io/projected/fed2a53d-1fad-401f-a7f0-0e849501a1a4-kube-api-access-qknxz\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:15.239013 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.238970    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fed2a53d-1fad-401f-a7f0-0e849501a1a4-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:15.963316 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.963284    2572 generic.go:356] "Generic (PLEG): container finished" podID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerID="df0d309b0ad8f757772cc24cb6a9e33b083f83b1b7a31e1ae49854de872a33db" exitCode=0
Jul 20 20:04:15.963844 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.963400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4" event={"ID":"50cd734a-afcb-4d95-8bab-ca5d88028b94","Type":"ContainerDied","Data":"df0d309b0ad8f757772cc24cb6a9e33b083f83b1b7a31e1ae49854de872a33db"}
Jul 20 20:04:15.965577 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.965553    2572 generic.go:356] "Generic (PLEG): container finished" podID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerID="84c874a56213a7c81b44f01f856839d3283ba1b414d6430f34f31fb0a1805cd6" exitCode=0
Jul 20 20:04:15.965699 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.965628    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf" event={"ID":"8c0381f4-82dd-4879-9a9a-2dd4db6fc127","Type":"ContainerDied","Data":"84c874a56213a7c81b44f01f856839d3283ba1b414d6430f34f31fb0a1805cd6"}
Jul 20 20:04:15.967423 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.967405    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724"
Jul 20 20:04:15.967510 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.967467    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724" event={"ID":"fed2a53d-1fad-401f-a7f0-0e849501a1a4","Type":"ContainerDied","Data":"beead16f80f45586a248171594130fc1f8e77bb9966cbddeca6a87cb550387d7"}
Jul 20 20:04:15.967555 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:15.967515    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beead16f80f45586a248171594130fc1f8e77bb9966cbddeca6a87cb550387d7"
Jul 20 20:04:16.105127 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.105101    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:16.146212 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.146184    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6mdt\" (UniqueName: \"kubernetes.io/projected/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-kube-api-access-q6mdt\") pod \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") "
Jul 20 20:04:16.146360 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.146223    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-util\") pod \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") "
Jul 20 20:04:16.146360 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.146314    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-bundle\") pod \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\" (UID: \"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c\") "
Jul 20 20:04:16.146819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.146788    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-bundle" (OuterVolumeSpecName: "bundle") pod "4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" (UID: "4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:16.148368 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.148344    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-kube-api-access-q6mdt" (OuterVolumeSpecName: "kube-api-access-q6mdt") pod "4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" (UID: "4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c"). InnerVolumeSpecName "kube-api-access-q6mdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:04:16.151621 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.151595    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-util" (OuterVolumeSpecName: "util") pod "4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" (UID: "4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:16.247788 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.247700    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:16.247788 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.247780    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6mdt\" (UniqueName: \"kubernetes.io/projected/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-kube-api-access-q6mdt\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:16.247788 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.247791    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:16.974279 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.974190    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n"
Jul 20 20:04:16.974279 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.974209    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n" event={"ID":"4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c","Type":"ContainerDied","Data":"edca7594e2f704fa859efd03a040e68edf2836f59ab3153e3a9ab7ecb1a528d5"}
Jul 20 20:04:16.974279 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:16.974262    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edca7594e2f704fa859efd03a040e68edf2836f59ab3153e3a9ab7ecb1a528d5"
Jul 20 20:04:17.109933 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.109909    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:17.135641 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.135613    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:17.155629 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.155598    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-util\") pod \"50cd734a-afcb-4d95-8bab-ca5d88028b94\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") "
Jul 20 20:04:17.155895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.155641    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-util\") pod \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") "
Jul 20 20:04:17.155895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.155676    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6j9b\" (UniqueName: \"kubernetes.io/projected/50cd734a-afcb-4d95-8bab-ca5d88028b94-kube-api-access-g6j9b\") pod \"50cd734a-afcb-4d95-8bab-ca5d88028b94\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") "
Jul 20 20:04:17.155895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.155697    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-bundle\") pod \"50cd734a-afcb-4d95-8bab-ca5d88028b94\" (UID: \"50cd734a-afcb-4d95-8bab-ca5d88028b94\") "
Jul 20 20:04:17.155895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.155715    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-bundle\") pod \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") "
Jul 20 20:04:17.155895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.155758    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2294n\" (UniqueName: \"kubernetes.io/projected/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-kube-api-access-2294n\") pod \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\" (UID: \"8c0381f4-82dd-4879-9a9a-2dd4db6fc127\") "
Jul 20 20:04:17.158846 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.157502    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-bundle" (OuterVolumeSpecName: "bundle") pod "8c0381f4-82dd-4879-9a9a-2dd4db6fc127" (UID: "8c0381f4-82dd-4879-9a9a-2dd4db6fc127"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:17.158846 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.158326    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-bundle" (OuterVolumeSpecName: "bundle") pod "50cd734a-afcb-4d95-8bab-ca5d88028b94" (UID: "50cd734a-afcb-4d95-8bab-ca5d88028b94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:17.159411 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.159373    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cd734a-afcb-4d95-8bab-ca5d88028b94-kube-api-access-g6j9b" (OuterVolumeSpecName: "kube-api-access-g6j9b") pod "50cd734a-afcb-4d95-8bab-ca5d88028b94" (UID: "50cd734a-afcb-4d95-8bab-ca5d88028b94"). InnerVolumeSpecName "kube-api-access-g6j9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:04:17.159599 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.159573    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-kube-api-access-2294n" (OuterVolumeSpecName: "kube-api-access-2294n") pod "8c0381f4-82dd-4879-9a9a-2dd4db6fc127" (UID: "8c0381f4-82dd-4879-9a9a-2dd4db6fc127"). InnerVolumeSpecName "kube-api-access-2294n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:04:17.163587 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.163563    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-util" (OuterVolumeSpecName: "util") pod "50cd734a-afcb-4d95-8bab-ca5d88028b94" (UID: "50cd734a-afcb-4d95-8bab-ca5d88028b94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:17.164151 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.164129    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-util" (OuterVolumeSpecName: "util") pod "8c0381f4-82dd-4879-9a9a-2dd4db6fc127" (UID: "8c0381f4-82dd-4879-9a9a-2dd4db6fc127"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:04:17.257143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.257053    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6j9b\" (UniqueName: \"kubernetes.io/projected/50cd734a-afcb-4d95-8bab-ca5d88028b94-kube-api-access-g6j9b\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:17.257143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.257088    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:17.257143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.257098    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:17.257143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.257105    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2294n\" (UniqueName: \"kubernetes.io/projected/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-kube-api-access-2294n\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:17.257143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.257114    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50cd734a-afcb-4d95-8bab-ca5d88028b94-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:17.257143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.257122    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0381f4-82dd-4879-9a9a-2dd4db6fc127-util\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:04:17.981169 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.981142    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf"
Jul 20 20:04:17.981169 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.981164    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf" event={"ID":"8c0381f4-82dd-4879-9a9a-2dd4db6fc127","Type":"ContainerDied","Data":"7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb"}
Jul 20 20:04:17.981747 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.981211    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb"
Jul 20 20:04:17.983169 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.983137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4" event={"ID":"50cd734a-afcb-4d95-8bab-ca5d88028b94","Type":"ContainerDied","Data":"5cbcb52c54e4307d2fd6cc7e7bd218c6f9092d611a24be1b63f122796860a2e7"}
Jul 20 20:04:17.983292 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.983197    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cbcb52c54e4307d2fd6cc7e7bd218c6f9092d611a24be1b63f122796860a2e7"
Jul 20 20:04:17.983292 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:17.983154    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4"
Jul 20 20:04:18.027208 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:04:18.027170    2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0381f4_82dd_4879_9a9a_2dd4db6fc127.slice/crio-7ce5f9af9fd9993e9f90451816bad3834c7cd9d3f859eb8b9ea5041c1f854ecb\": RecentStats: unable to find data in memory cache]"
Jul 20 20:04:28.520049 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520012    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"]
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520349    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520359    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520369    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="pull"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520374    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="pull"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520384    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520390    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520397    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520401    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520411    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="extract"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520416    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="extract"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520421    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520426    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="util"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520432    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="pull"
Jul 20 20:04:28.520433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520438    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="pull"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520445    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520450    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520458    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="pull"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520463    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="pull"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520468    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520473    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520478    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="pull"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520483    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="pull"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520489    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520494    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520552    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="50cd734a-afcb-4d95-8bab-ca5d88028b94" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520559    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fed2a53d-1fad-401f-a7f0-0e849501a1a4" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520566    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0381f4-82dd-4879-9a9a-2dd4db6fc127" containerName="extract"
Jul 20 20:04:28.520845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.520572    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c" containerName="extract"
Jul 20 20:04:28.525462 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.525440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:28.527639 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.527615    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 20:04:28.527762 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.527669    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-c679s\""
Jul 20 20:04:28.534166 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.534137    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"]
Jul 20 20:04:28.655211 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.655184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prc98\" (UniqueName: \"kubernetes.io/projected/ee4b4996-3403-4344-bec2-3c0f98982a64-kube-api-access-prc98\") pod \"dns-operator-controller-manager-864dd78c4c-qhgmc\" (UID: \"ee4b4996-3403-4344-bec2-3c0f98982a64\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:28.755703 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.755664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prc98\" (UniqueName: \"kubernetes.io/projected/ee4b4996-3403-4344-bec2-3c0f98982a64-kube-api-access-prc98\") pod \"dns-operator-controller-manager-864dd78c4c-qhgmc\" (UID: \"ee4b4996-3403-4344-bec2-3c0f98982a64\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:28.767090 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.767060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prc98\" (UniqueName: \"kubernetes.io/projected/ee4b4996-3403-4344-bec2-3c0f98982a64-kube-api-access-prc98\") pod \"dns-operator-controller-manager-864dd78c4c-qhgmc\" (UID: \"ee4b4996-3403-4344-bec2-3c0f98982a64\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:28.836023 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.835934    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:28.978260 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:28.978233    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"]
Jul 20 20:04:28.980455 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:28.980423    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4b4996_3403_4344_bec2_3c0f98982a64.slice/crio-139c910787be677e6c69835354fd54e6648c8d5820643af8799406b2fbfa9571 WatchSource:0}: Error finding container 139c910787be677e6c69835354fd54e6648c8d5820643af8799406b2fbfa9571: Status 404 returned error can't find the container with id 139c910787be677e6c69835354fd54e6648c8d5820643af8799406b2fbfa9571
Jul 20 20:04:29.043767 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:29.043716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc" event={"ID":"ee4b4996-3403-4344-bec2-3c0f98982a64","Type":"ContainerStarted","Data":"139c910787be677e6c69835354fd54e6648c8d5820643af8799406b2fbfa9571"}
Jul 20 20:04:31.057473 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:31.057440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc" event={"ID":"ee4b4996-3403-4344-bec2-3c0f98982a64","Type":"ContainerStarted","Data":"ad37fbe09751af9aa48af35dac7a00dab59a6dff744020cd4957be994955d36b"}
Jul 20 20:04:32.063175 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:32.063140    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:32.080196 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:32.080140    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc" podStartSLOduration=2.071939947 podStartE2EDuration="4.080123186s" totalImagesPullingTime="2.008183239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:32.079199351 +0000 UTC m=+496.662430234" watchObservedRunningTime="2026-07-20 20:04:32.080123186 +0000 UTC m=+496.663354073"
Jul 20 20:04:33.116558 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.116519    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"]
Jul 20 20:04:33.120132 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.120108    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:33.122436 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.122410    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5cqth\""
Jul 20 20:04:33.131433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.131398    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"]
Jul 20 20:04:33.191922 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.191875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfz6\" (UniqueName: \"kubernetes.io/projected/356ba074-fff9-4c44-abcc-f231bf791f2a-kube-api-access-fnfz6\") pod \"authorino-operator-75cc8d5cb7-j2zbv\" (UID: \"356ba074-fff9-4c44-abcc-f231bf791f2a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:33.293070 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.293030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfz6\" (UniqueName: \"kubernetes.io/projected/356ba074-fff9-4c44-abcc-f231bf791f2a-kube-api-access-fnfz6\") pod \"authorino-operator-75cc8d5cb7-j2zbv\" (UID: \"356ba074-fff9-4c44-abcc-f231bf791f2a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:33.306990 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.306940    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfz6\" (UniqueName: \"kubernetes.io/projected/356ba074-fff9-4c44-abcc-f231bf791f2a-kube-api-access-fnfz6\") pod \"authorino-operator-75cc8d5cb7-j2zbv\" (UID: \"356ba074-fff9-4c44-abcc-f231bf791f2a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:33.431015 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.430915    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:33.579305 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:33.575270    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"]
Jul 20 20:04:33.581924 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:33.581890    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356ba074_fff9_4c44_abcc_f231bf791f2a.slice/crio-6b2d251f508e52c44041c619e0948520b463eb1984993c9b67505c76076cf09c WatchSource:0}: Error finding container 6b2d251f508e52c44041c619e0948520b463eb1984993c9b67505c76076cf09c: Status 404 returned error can't find the container with id 6b2d251f508e52c44041c619e0948520b463eb1984993c9b67505c76076cf09c
Jul 20 20:04:34.074577 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:34.074538    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv" event={"ID":"356ba074-fff9-4c44-abcc-f231bf791f2a","Type":"ContainerStarted","Data":"6b2d251f508e52c44041c619e0948520b463eb1984993c9b67505c76076cf09c"}
Jul 20 20:04:36.089502 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.089464    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv" event={"ID":"356ba074-fff9-4c44-abcc-f231bf791f2a","Type":"ContainerStarted","Data":"c9b7a958e9c3052d2313bd897f16de46a23ed109ab8e14fef756c566595b91aa"}
Jul 20 20:04:36.089954 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.089590    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:36.119828 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.119703    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv" podStartSLOduration=0.85072256 podStartE2EDuration="3.119685912s" totalImagesPullingTime="2.268963352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:36.117135764 +0000 UTC m=+500.700366653" watchObservedRunningTime="2026-07-20 20:04:36.119685912 +0000 UTC m=+500.702916799"
Jul 20 20:04:36.132124 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.132083    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"]
Jul 20 20:04:36.134547 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.134523    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:04:36.137105 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.137081    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fp6lt\""
Jul 20 20:04:36.146233 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.146190    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"]
Jul 20 20:04:36.217699 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.217662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggh5b\" (UniqueName: \"kubernetes.io/projected/bc670be6-da29-45a4-81cb-4539c4039b55-kube-api-access-ggh5b\") pod \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" (UID: \"bc670be6-da29-45a4-81cb-4539c4039b55\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:04:36.318936 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.318893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggh5b\" (UniqueName: \"kubernetes.io/projected/bc670be6-da29-45a4-81cb-4539c4039b55-kube-api-access-ggh5b\") pod \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" (UID: \"bc670be6-da29-45a4-81cb-4539c4039b55\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:04:36.329543 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.329511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggh5b\" (UniqueName: \"kubernetes.io/projected/bc670be6-da29-45a4-81cb-4539c4039b55-kube-api-access-ggh5b\") pod \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" (UID: \"bc670be6-da29-45a4-81cb-4539c4039b55\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:04:36.445060 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.444965    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:04:36.590843 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:36.590814    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"]
Jul 20 20:04:36.593184 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:36.593154    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc670be6_da29_45a4_81cb_4539c4039b55.slice/crio-c7c475ba5a57e0d40372f5851b21bace5a2bce79fe5a2f37ee87d36d1fc656e3 WatchSource:0}: Error finding container c7c475ba5a57e0d40372f5851b21bace5a2bce79fe5a2f37ee87d36d1fc656e3: Status 404 returned error can't find the container with id c7c475ba5a57e0d40372f5851b21bace5a2bce79fe5a2f37ee87d36d1fc656e3
Jul 20 20:04:37.099649 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:37.099600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn" event={"ID":"bc670be6-da29-45a4-81cb-4539c4039b55","Type":"ContainerStarted","Data":"c7c475ba5a57e0d40372f5851b21bace5a2bce79fe5a2f37ee87d36d1fc656e3"}
Jul 20 20:04:39.112032 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:39.111984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn" event={"ID":"bc670be6-da29-45a4-81cb-4539c4039b55","Type":"ContainerStarted","Data":"74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98"}
Jul 20 20:04:39.112506 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:39.112166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:04:39.131284 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:39.131228    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn" podStartSLOduration=1.631507864 podStartE2EDuration="3.13120767s" totalImagesPullingTime="1.499699806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:39.128866592 +0000 UTC m=+503.712097481" watchObservedRunningTime="2026-07-20 20:04:39.13120767 +0000 UTC m=+503.714438558"
Jul 20 20:04:41.283107 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.283061    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"]
Jul 20 20:04:41.285616 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.285593    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.291210 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.291186    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mnwvs\""
Jul 20 20:04:41.311257 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.311218    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"]
Jul 20 20:04:41.364055 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.364016    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.364245 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.364095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lz46\" (UniqueName: \"kubernetes.io/projected/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-kube-api-access-2lz46\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.465322 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.465264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.465461 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.465355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lz46\" (UniqueName: \"kubernetes.io/projected/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-kube-api-access-2lz46\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.465703 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.465676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.479391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.479351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lz46\" (UniqueName: \"kubernetes.io/projected/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-kube-api-access-2lz46\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.596528 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.596490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:41.746853 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:41.746822    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"]
Jul 20 20:04:41.749330 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:04:41.749300    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b6f8f0_daba_449f_974d_ac6b6c71bdc7.slice/crio-5a66109d727e83853c3d00346d233996f3275d51146c13d392c5d0f0d5121706 WatchSource:0}: Error finding container 5a66109d727e83853c3d00346d233996f3275d51146c13d392c5d0f0d5121706: Status 404 returned error can't find the container with id 5a66109d727e83853c3d00346d233996f3275d51146c13d392c5d0f0d5121706
Jul 20 20:04:42.130887 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:42.130851    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p" event={"ID":"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7","Type":"ContainerStarted","Data":"5a66109d727e83853c3d00346d233996f3275d51146c13d392c5d0f0d5121706"}
Jul 20 20:04:43.071082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:43.071044    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qhgmc"
Jul 20 20:04:47.103099 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:47.103061    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j2zbv"
Jul 20 20:04:49.180977 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:49.180940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p" event={"ID":"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7","Type":"ContainerStarted","Data":"8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3"}
Jul 20 20:04:49.181490 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:49.181130    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:04:49.205637 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:49.205578    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p" podStartSLOduration=1.434125795 podStartE2EDuration="8.20555945s" totalImagesPullingTime="6.771433655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:49.203868514 +0000 UTC m=+513.787099402" watchObservedRunningTime="2026-07-20 20:04:49.20555945 +0000 UTC m=+513.788790337"
Jul 20 20:04:50.120158 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:04:50.120126    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:00.189558 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:00.189518    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:01.551805 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.551761    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"]
Jul 20 20:05:01.573041 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.573008    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.575763 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.575704    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"]
Jul 20 20:05:01.673466 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.673424    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"]
Jul 20 20:05:01.673756 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:01.673737    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-lfcpb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938"
Jul 20 20:05:01.717012 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.716967    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"]
Jul 20 20:05:01.724906 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.724865    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:01.738019 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.737992    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"]
Jul 20 20:05:01.747071 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.747035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4392d5-b0a4-4f3d-abdd-4487e0726938-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.747228 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.747134    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfcpb\" (UniqueName: \"kubernetes.io/projected/fe4392d5-b0a4-4f3d-abdd-4487e0726938-kube-api-access-lfcpb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.848266 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.848221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfcpb\" (UniqueName: \"kubernetes.io/projected/fe4392d5-b0a4-4f3d-abdd-4487e0726938-kube-api-access-lfcpb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.848471 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.848285    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:01.848471 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.848422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77ws\" (UniqueName: \"kubernetes.io/projected/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-kube-api-access-v77ws\") pod \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:01.848629 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.848601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4392d5-b0a4-4f3d-abdd-4487e0726938-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.849008 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.848989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4392d5-b0a4-4f3d-abdd-4487e0726938-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.856874 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.856841    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfcpb\" (UniqueName: \"kubernetes.io/projected/fe4392d5-b0a4-4f3d-abdd-4487e0726938-kube-api-access-lfcpb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:01.949803 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.949713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:01.949979 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.949818    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77ws\" (UniqueName: \"kubernetes.io/projected/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-kube-api-access-v77ws\") pod \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:01.950114 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.950094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:01.960670 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:01.960630    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77ws\" (UniqueName: \"kubernetes.io/projected/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-kube-api-access-v77ws\") pod \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:02.034670 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.034631    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:02.122860 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.122748    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"]
Jul 20 20:05:02.129657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.129616    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"]
Jul 20 20:05:02.142350 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.142301    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"]
Jul 20 20:05:02.146127 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.146092    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"]
Jul 20 20:05:02.151067 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.150986    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"]
Jul 20 20:05:02.151241 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.151096    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.165390 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.165345    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"]
Jul 20 20:05:02.169513 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.169479    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"]
Jul 20 20:05:02.169756 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.169715    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" containerName="manager" containerID="cri-o://8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3" gracePeriod=2
Jul 20 20:05:02.179887 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.179767    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"]
Jul 20 20:05:02.185258 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.185210    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.191845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.191809    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"]
Jul 20 20:05:02.192090 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.192060    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" containerName="manager" containerID="cri-o://74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98" gracePeriod=2
Jul 20 20:05:02.194541 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.194486    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.197791 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.197753    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.198603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.198568    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"]
Jul 20 20:05:02.202337 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.202306    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"]
Jul 20 20:05:02.202886 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.202865    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" containerName="manager"
Jul 20 20:05:02.202886 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.202885    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" containerName="manager"
Jul 20 20:05:02.203052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.202908    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" containerName="manager"
Jul 20 20:05:02.203052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.202916    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" containerName="manager"
Jul 20 20:05:02.203052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.203017    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" containerName="manager"
Jul 20 20:05:02.203052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.203029    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" containerName="manager"
Jul 20 20:05:02.205398 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.205375    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.207447 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.207408    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.221947 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.221920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"]
Jul 20 20:05:02.224985 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.224951    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"]
Jul 20 20:05:02.227281 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.227260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:02.247653 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.247413    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.248559 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.248516    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"]
Jul 20 20:05:02.249426 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.249226    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.252139 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.252105    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d540243d-c552-4728-8136-b785b0962d5b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb2jh\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.252284 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.252162    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnfd\" (UniqueName: \"kubernetes.io/projected/d540243d-c552-4728-8136-b785b0962d5b-kube-api-access-fmnfd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb2jh\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.252284 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.252226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/387c12ce-5dd0-4710-b70e-3ad74715f0bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zndsk\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.252284 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.252269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmcz\" (UniqueName: \"kubernetes.io/projected/387c12ce-5dd0-4710-b70e-3ad74715f0bd-kube-api-access-6fmcz\") pod \"kuadrant-operator-controller-manager-55467d9f7-zndsk\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.252434 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.252353    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfxkl\" (UniqueName: \"kubernetes.io/projected/325914ec-da01-487a-92df-9356064075e1-kube-api-access-tfxkl\") pod \"limitador-operator-controller-manager-859d7b78bd-zh7d5\" (UID: \"325914ec-da01-487a-92df-9356064075e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:02.252864 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.252845    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:02.270316 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.270145    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.271827 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.271781    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.273562 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.273528    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.275140 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.275108    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:02.292107 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.292080    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:02.294120 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.294085    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.295810 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.295777    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:02.297344 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.297314    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.352969 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.352910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/387c12ce-5dd0-4710-b70e-3ad74715f0bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zndsk\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.352969 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.352952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmcz\" (UniqueName: \"kubernetes.io/projected/387c12ce-5dd0-4710-b70e-3ad74715f0bd-kube-api-access-6fmcz\") pod \"kuadrant-operator-controller-manager-55467d9f7-zndsk\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.353243 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.352995    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfxkl\" (UniqueName: \"kubernetes.io/projected/325914ec-da01-487a-92df-9356064075e1-kube-api-access-tfxkl\") pod \"limitador-operator-controller-manager-859d7b78bd-zh7d5\" (UID: \"325914ec-da01-487a-92df-9356064075e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:02.353243 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.353060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d540243d-c552-4728-8136-b785b0962d5b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb2jh\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.353243 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.353094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnfd\" (UniqueName: \"kubernetes.io/projected/d540243d-c552-4728-8136-b785b0962d5b-kube-api-access-fmnfd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb2jh\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.353401 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.353365    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/387c12ce-5dd0-4710-b70e-3ad74715f0bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zndsk\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.353652 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.353633    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d540243d-c552-4728-8136-b785b0962d5b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb2jh\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.363372 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.363343    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfxkl\" (UniqueName: \"kubernetes.io/projected/325914ec-da01-487a-92df-9356064075e1-kube-api-access-tfxkl\") pod \"limitador-operator-controller-manager-859d7b78bd-zh7d5\" (UID: \"325914ec-da01-487a-92df-9356064075e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:02.363888 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.363863    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnfd\" (UniqueName: \"kubernetes.io/projected/d540243d-c552-4728-8136-b785b0962d5b-kube-api-access-fmnfd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb2jh\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.364017 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.363986    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmcz\" (UniqueName: \"kubernetes.io/projected/387c12ce-5dd0-4710-b70e-3ad74715f0bd-kube-api-access-6fmcz\") pod \"kuadrant-operator-controller-manager-55467d9f7-zndsk\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.368656    2572 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gmwv8_kuadrant-system_84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6_0(dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gmwv8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca" Netns:"/var/run/netns/a7fcd358-87d3-4670-86b2-0d49e4418603" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-gmwv8;K8S_POD_INFRA_CONTAINER_ID=dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca;K8S_POD_UID=84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8 dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8 dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2e [10.132.0.46/23]
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:         '
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:  >
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.368791    2572 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gmwv8_kuadrant-system_84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6_0(dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gmwv8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca" Netns:"/var/run/netns/a7fcd358-87d3-4670-86b2-0d49e4418603" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-gmwv8;K8S_POD_INFRA_CONTAINER_ID=dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca;K8S_POD_UID=84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8 dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8 dcbf6fa6cdca0993c6448ee871e67ef0d3bc6c053936acf1502fb67385ed3cca network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2e [10.132.0.46/23]
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:         '
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 20 20:05:02.368839 ip-10-0-128-178 kubenswrapper[2572]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:02.424981 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.424950    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.427278 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.427243    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:02.428953 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.428929    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.431032 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.431011    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.454316 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.454288    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfcpb\" (UniqueName: \"kubernetes.io/projected/fe4392d5-b0a4-4f3d-abdd-4487e0726938-kube-api-access-lfcpb\") pod \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") "
Jul 20 20:05:02.454457 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.454351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4392d5-b0a4-4f3d-abdd-4487e0726938-extensions-socket-volume\") pod \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\" (UID: \"fe4392d5-b0a4-4f3d-abdd-4487e0726938\") "
Jul 20 20:05:02.454457 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.454383    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-extensions-socket-volume\") pod \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") "
Jul 20 20:05:02.454457 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.454403    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lz46\" (UniqueName: \"kubernetes.io/projected/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-kube-api-access-2lz46\") pod \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\" (UID: \"e6b6f8f0-daba-449f-974d-ac6b6c71bdc7\") "
Jul 20 20:05:02.454659 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.454635    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4392d5-b0a4-4f3d-abdd-4487e0726938-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe4392d5-b0a4-4f3d-abdd-4487e0726938" (UID: "fe4392d5-b0a4-4f3d-abdd-4487e0726938"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:02.454917 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.454891    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" (UID: "e6b6f8f0-daba-449f-974d-ac6b6c71bdc7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:02.456522 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.456491    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-kube-api-access-2lz46" (OuterVolumeSpecName: "kube-api-access-2lz46") pod "e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" (UID: "e6b6f8f0-daba-449f-974d-ac6b6c71bdc7"). InnerVolumeSpecName "kube-api-access-2lz46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:02.456674 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.456651    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4392d5-b0a4-4f3d-abdd-4487e0726938-kube-api-access-lfcpb" (OuterVolumeSpecName: "kube-api-access-lfcpb") pod "fe4392d5-b0a4-4f3d-abdd-4487e0726938" (UID: "fe4392d5-b0a4-4f3d-abdd-4487e0726938"). InnerVolumeSpecName "kube-api-access-lfcpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:02.461881 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.461850    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.463999 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.463958    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tvb6p\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:02.465514 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.465490    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw4qn\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:02.465584 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.465531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:02.467126 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:02.467094    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:02.555438 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.555403    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggh5b\" (UniqueName: \"kubernetes.io/projected/bc670be6-da29-45a4-81cb-4539c4039b55-kube-api-access-ggh5b\") pod \"bc670be6-da29-45a4-81cb-4539c4039b55\" (UID: \"bc670be6-da29-45a4-81cb-4539c4039b55\") "
Jul 20 20:05:02.555878 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.555698    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4392d5-b0a4-4f3d-abdd-4487e0726938-extensions-socket-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:02.555878 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.555753    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-extensions-socket-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:02.555878 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.555769    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lz46\" (UniqueName: \"kubernetes.io/projected/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7-kube-api-access-2lz46\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:02.555878 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.555783    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfcpb\" (UniqueName: \"kubernetes.io/projected/fe4392d5-b0a4-4f3d-abdd-4487e0726938-kube-api-access-lfcpb\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:02.558812 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.558783    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc670be6-da29-45a4-81cb-4539c4039b55-kube-api-access-ggh5b" (OuterVolumeSpecName: "kube-api-access-ggh5b") pod "bc670be6-da29-45a4-81cb-4539c4039b55" (UID: "bc670be6-da29-45a4-81cb-4539c4039b55"). InnerVolumeSpecName "kube-api-access-ggh5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:02.581977 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.581943    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:02.589376 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.589342    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:02.610313 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.610279    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"]
Jul 20 20:05:02.613880 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:05:02.613839    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387c12ce_5dd0_4710_b70e_3ad74715f0bd.slice/crio-0c4385a40eaf78c4643925826f18776f745afd17a008f5de85fed98c1011029c WatchSource:0}: Error finding container 0c4385a40eaf78c4643925826f18776f745afd17a008f5de85fed98c1011029c: Status 404 returned error can't find the container with id 0c4385a40eaf78c4643925826f18776f745afd17a008f5de85fed98c1011029c
Jul 20 20:05:02.657304 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.657255    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggh5b\" (UniqueName: \"kubernetes.io/projected/bc670be6-da29-45a4-81cb-4539c4039b55-kube-api-access-ggh5b\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:02.728688 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.728646    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc670be6-da29-45a4-81cb-4539c4039b55" path="/var/lib/kubelet/pods/bc670be6-da29-45a4-81cb-4539c4039b55/volumes"
Jul 20 20:05:02.729276 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.729245    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" path="/var/lib/kubelet/pods/e6b6f8f0-daba-449f-974d-ac6b6c71bdc7/volumes"
Jul 20 20:05:02.729801 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.729777    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" path="/var/lib/kubelet/pods/fe4392d5-b0a4-4f3d-abdd-4487e0726938/volumes"
Jul 20 20:05:02.761117 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.761093    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"]
Jul 20 20:05:02.763233 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:05:02.763208    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd540243d_c552_4728_8136_b785b0962d5b.slice/crio-d10420152bad662506a8539562a590e5cabad29d695de9109de85c934737663c WatchSource:0}: Error finding container d10420152bad662506a8539562a590e5cabad29d695de9109de85c934737663c: Status 404 returned error can't find the container with id d10420152bad662506a8539562a590e5cabad29d695de9109de85c934737663c
Jul 20 20:05:02.774868 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:02.774843    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"]
Jul 20 20:05:02.777225 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:05:02.777191    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325914ec_da01_487a_92df_9356064075e1.slice/crio-ac541d5022f8b07bfcaa75af6d19e3b6790aff026fcce4ff71bd016f1dad7903 WatchSource:0}: Error finding container ac541d5022f8b07bfcaa75af6d19e3b6790aff026fcce4ff71bd016f1dad7903: Status 404 returned error can't find the container with id ac541d5022f8b07bfcaa75af6d19e3b6790aff026fcce4ff71bd016f1dad7903
Jul 20 20:05:03.259335 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.259294    2572 generic.go:356] "Generic (PLEG): container finished" podID="bc670be6-da29-45a4-81cb-4539c4039b55" containerID="74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98" exitCode=0
Jul 20 20:05:03.259548 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.259365    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw4qn"
Jul 20 20:05:03.259548 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.259396    2572 scope.go:117] "RemoveContainer" containerID="74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98"
Jul 20 20:05:03.261309 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.261286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5" event={"ID":"325914ec-da01-487a-92df-9356064075e1","Type":"ContainerStarted","Data":"5246d022276545cdffd3093e19514a9941e93bb3950c69c18eca243d0e9a8299"}
Jul 20 20:05:03.261411 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.261368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5" event={"ID":"325914ec-da01-487a-92df-9356064075e1","Type":"ContainerStarted","Data":"ac541d5022f8b07bfcaa75af6d19e3b6790aff026fcce4ff71bd016f1dad7903"}
Jul 20 20:05:03.261674 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.261649    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:03.263348 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.263317    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh" event={"ID":"d540243d-c552-4728-8136-b785b0962d5b","Type":"ContainerStarted","Data":"8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05"}
Jul 20 20:05:03.263449 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.263367    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh" event={"ID":"d540243d-c552-4728-8136-b785b0962d5b","Type":"ContainerStarted","Data":"d10420152bad662506a8539562a590e5cabad29d695de9109de85c934737663c"}
Jul 20 20:05:03.263449 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.263396    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:03.264811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.264790    2572 generic.go:356] "Generic (PLEG): container finished" podID="e6b6f8f0-daba-449f-974d-ac6b6c71bdc7" containerID="8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3" exitCode=0
Jul 20 20:05:03.264895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.264838    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tvb6p"
Jul 20 20:05:03.266924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.266742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk" event={"ID":"387c12ce-5dd0-4710-b70e-3ad74715f0bd","Type":"ContainerStarted","Data":"1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a"}
Jul 20 20:05:03.266924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.266769    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:03.266924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.266793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk" event={"ID":"387c12ce-5dd0-4710-b70e-3ad74715f0bd","Type":"ContainerStarted","Data":"0c4385a40eaf78c4643925826f18776f745afd17a008f5de85fed98c1011029c"}
Jul 20 20:05:03.266924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.266911    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:03.267197 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.266931    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:03.269675 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.269651    2572 scope.go:117] "RemoveContainer" containerID="74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98"
Jul 20 20:05:03.269980 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:03.269961    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98\": container with ID starting with 74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98 not found: ID does not exist" containerID="74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98"
Jul 20 20:05:03.270067 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.269998    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98"} err="failed to get container status \"74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98\": rpc error: code = NotFound desc = could not find container \"74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98\": container with ID starting with 74f35eaf9cbf60c1a76dc1e062b3bed1b271a983304128a0aec4f94c87467a98 not found: ID does not exist"
Jul 20 20:05:03.270067 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.270016    2572 scope.go:117] "RemoveContainer" containerID="8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3"
Jul 20 20:05:03.277131 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.277100    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:03.282507 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.282486    2572 scope.go:117] "RemoveContainer" containerID="8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3"
Jul 20 20:05:03.282869 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:03.282850    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3\": container with ID starting with 8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3 not found: ID does not exist" containerID="8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3"
Jul 20 20:05:03.282921 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.282877    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3"} err="failed to get container status \"8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3\": rpc error: code = NotFound desc = could not find container \"8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3\": container with ID starting with 8baa1d843c4f3d9e2c4c42a08841a1673b8f8028cd37211089fabd6cc60b4ff3 not found: ID does not exist"
Jul 20 20:05:03.291811 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:03.291772    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:03.294336 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:03.294308    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:03.322164 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.322113    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk" podStartSLOduration=1.322095371 podStartE2EDuration="1.322095371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:03.320824825 +0000 UTC m=+527.904055713" watchObservedRunningTime="2026-07-20 20:05:03.322095371 +0000 UTC m=+527.905326344"
Jul 20 20:05:03.323912 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.323872    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5" podStartSLOduration=1.323860474 podStartE2EDuration="1.323860474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:03.289982456 +0000 UTC m=+527.873213345" watchObservedRunningTime="2026-07-20 20:05:03.323860474 +0000 UTC m=+527.907091423"
Jul 20 20:05:03.362811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.362772    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v77ws\" (UniqueName: \"kubernetes.io/projected/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-kube-api-access-v77ws\") pod \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") "
Jul 20 20:05:03.363015 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.362860    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-extensions-socket-volume\") pod \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\" (UID: \"84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6\") "
Jul 20 20:05:03.363153 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.363126    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" (UID: "84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:03.365051 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.365016    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-kube-api-access-v77ws" (OuterVolumeSpecName: "kube-api-access-v77ws") pod "84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" (UID: "84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6"). InnerVolumeSpecName "kube-api-access-v77ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:03.464239 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.464192    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v77ws\" (UniqueName: \"kubernetes.io/projected/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-kube-api-access-v77ws\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:03.464239 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:03.464231    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6-extensions-socket-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:04.274816 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:04.274777    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:04.277045 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:04.277017    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:04.278616 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:04.278595    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:04.282840 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:04.282808    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gmwv8\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gmwv8"
Jul 20 20:05:04.284308 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:04.284283    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kmtwm\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="fe4392d5-b0a4-4f3d-abdd-4487e0726938" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kmtwm"
Jul 20 20:05:04.725352 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:04.725314    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6" path="/var/lib/kubelet/pods/84cf3b99-15c3-464b-9f8b-3edc4c8ac0c6/volumes"
Jul 20 20:05:14.277055 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.276966    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:14.277055 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.277051    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:14.277676 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.277465    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zh7d5"
Jul 20 20:05:14.297090 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.296993    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh" podStartSLOduration=12.296970742 podStartE2EDuration="12.296970742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:03.342408455 +0000 UTC m=+527.925639344" watchObservedRunningTime="2026-07-20 20:05:14.296970742 +0000 UTC m=+538.880201632"
Jul 20 20:05:14.351679 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.351636    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"]
Jul 20 20:05:14.351985 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.351937    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh" podUID="d540243d-c552-4728-8136-b785b0962d5b" containerName="manager" containerID="cri-o://8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05" gracePeriod=10
Jul 20 20:05:14.610042 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.610014    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:14.618210 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.618178    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"]
Jul 20 20:05:14.618555 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.618543    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d540243d-c552-4728-8136-b785b0962d5b" containerName="manager"
Jul 20 20:05:14.618598 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.618556    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d540243d-c552-4728-8136-b785b0962d5b" containerName="manager"
Jul 20 20:05:14.618639 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.618614    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d540243d-c552-4728-8136-b785b0962d5b" containerName="manager"
Jul 20 20:05:14.621668 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.621641    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.636827 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.636795    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"]
Jul 20 20:05:14.655680 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.655649    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmnfd\" (UniqueName: \"kubernetes.io/projected/d540243d-c552-4728-8136-b785b0962d5b-kube-api-access-fmnfd\") pod \"d540243d-c552-4728-8136-b785b0962d5b\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") "
Jul 20 20:05:14.655908 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.655792    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d540243d-c552-4728-8136-b785b0962d5b-extensions-socket-volume\") pod \"d540243d-c552-4728-8136-b785b0962d5b\" (UID: \"d540243d-c552-4728-8136-b785b0962d5b\") "
Jul 20 20:05:14.655908 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.655886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae73549-1127-424c-855c-c62e38c99962-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w8sg5\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.656031 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.655927    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvsdh\" (UniqueName: \"kubernetes.io/projected/4ae73549-1127-424c-855c-c62e38c99962-kube-api-access-kvsdh\") pod \"kuadrant-operator-controller-manager-86878c769f-w8sg5\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.656226 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.656200    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d540243d-c552-4728-8136-b785b0962d5b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d540243d-c552-4728-8136-b785b0962d5b" (UID: "d540243d-c552-4728-8136-b785b0962d5b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:14.658389 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.658356    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d540243d-c552-4728-8136-b785b0962d5b-kube-api-access-fmnfd" (OuterVolumeSpecName: "kube-api-access-fmnfd") pod "d540243d-c552-4728-8136-b785b0962d5b" (UID: "d540243d-c552-4728-8136-b785b0962d5b"). InnerVolumeSpecName "kube-api-access-fmnfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:14.757201 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.757156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae73549-1127-424c-855c-c62e38c99962-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w8sg5\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.757201 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.757202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvsdh\" (UniqueName: \"kubernetes.io/projected/4ae73549-1127-424c-855c-c62e38c99962-kube-api-access-kvsdh\") pod \"kuadrant-operator-controller-manager-86878c769f-w8sg5\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.757403 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.757234    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d540243d-c552-4728-8136-b785b0962d5b-extensions-socket-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:14.757403 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.757244    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmnfd\" (UniqueName: \"kubernetes.io/projected/d540243d-c552-4728-8136-b785b0962d5b-kube-api-access-fmnfd\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:14.757550 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.757530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae73549-1127-424c-855c-c62e38c99962-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w8sg5\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.766523 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.766491    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvsdh\" (UniqueName: \"kubernetes.io/projected/4ae73549-1127-424c-855c-c62e38c99962-kube-api-access-kvsdh\") pod \"kuadrant-operator-controller-manager-86878c769f-w8sg5\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:14.931876 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:14.931835    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:15.082600 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.082568    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"]
Jul 20 20:05:15.084605 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:05:15.084574    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae73549_1127_424c_855c_c62e38c99962.slice/crio-cae519c95922b8c0e5a164a6c871a2534460865441254737739e8d8d017e2b5f WatchSource:0}: Error finding container cae519c95922b8c0e5a164a6c871a2534460865441254737739e8d8d017e2b5f: Status 404 returned error can't find the container with id cae519c95922b8c0e5a164a6c871a2534460865441254737739e8d8d017e2b5f
Jul 20 20:05:15.344914 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.344796    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5" event={"ID":"4ae73549-1127-424c-855c-c62e38c99962","Type":"ContainerStarted","Data":"f1a9a24a329161b3965100e4bd464cebe67ef44f725f7633552116c63851bde3"}
Jul 20 20:05:15.344914 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.344872    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5" event={"ID":"4ae73549-1127-424c-855c-c62e38c99962","Type":"ContainerStarted","Data":"cae519c95922b8c0e5a164a6c871a2534460865441254737739e8d8d017e2b5f"}
Jul 20 20:05:15.345402 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.344983    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:15.346218 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.346196    2572 generic.go:356] "Generic (PLEG): container finished" podID="d540243d-c552-4728-8136-b785b0962d5b" containerID="8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05" exitCode=0
Jul 20 20:05:15.346348 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.346238    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"
Jul 20 20:05:15.346348 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.346286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh" event={"ID":"d540243d-c552-4728-8136-b785b0962d5b","Type":"ContainerDied","Data":"8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05"}
Jul 20 20:05:15.346348 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.346333    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh" event={"ID":"d540243d-c552-4728-8136-b785b0962d5b","Type":"ContainerDied","Data":"d10420152bad662506a8539562a590e5cabad29d695de9109de85c934737663c"}
Jul 20 20:05:15.346458 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.346357    2572 scope.go:117] "RemoveContainer" containerID="8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05"
Jul 20 20:05:15.356464 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.356271    2572 scope.go:117] "RemoveContainer" containerID="8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05"
Jul 20 20:05:15.356609 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:15.356587    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05\": container with ID starting with 8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05 not found: ID does not exist" containerID="8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05"
Jul 20 20:05:15.356656 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.356619    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05"} err="failed to get container status \"8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05\": rpc error: code = NotFound desc = could not find container \"8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05\": container with ID starting with 8e872b0870709b9be48cf7cd4b55d271ac72a47f432a4ff0de5c4a2574e05d05 not found: ID does not exist"
Jul 20 20:05:15.381528 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.381471    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5" podStartSLOduration=1.381452145 podStartE2EDuration="1.381452145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:15.377640617 +0000 UTC m=+539.960871508" watchObservedRunningTime="2026-07-20 20:05:15.381452145 +0000 UTC m=+539.964683037"
Jul 20 20:05:15.410381 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.410338    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"]
Jul 20 20:05:15.424525 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:15.424486    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb2jh"]
Jul 20 20:05:16.731469 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:16.731434    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d540243d-c552-4728-8136-b785b0962d5b" path="/var/lib/kubelet/pods/d540243d-c552-4728-8136-b785b0962d5b/volumes"
Jul 20 20:05:26.356873 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.356841    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:05:26.406359 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.406327    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"]
Jul 20 20:05:26.406626 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.406579    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk" podUID="387c12ce-5dd0-4710-b70e-3ad74715f0bd" containerName="manager" containerID="cri-o://1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a" gracePeriod=10
Jul 20 20:05:26.660702 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.660672    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:26.762833 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.762797    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fmcz\" (UniqueName: \"kubernetes.io/projected/387c12ce-5dd0-4710-b70e-3ad74715f0bd-kube-api-access-6fmcz\") pod \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") "
Jul 20 20:05:26.763653 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.762900    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/387c12ce-5dd0-4710-b70e-3ad74715f0bd-extensions-socket-volume\") pod \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\" (UID: \"387c12ce-5dd0-4710-b70e-3ad74715f0bd\") "
Jul 20 20:05:26.763653 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.763475    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/387c12ce-5dd0-4710-b70e-3ad74715f0bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "387c12ce-5dd0-4710-b70e-3ad74715f0bd" (UID: "387c12ce-5dd0-4710-b70e-3ad74715f0bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:26.765416 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.765378    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387c12ce-5dd0-4710-b70e-3ad74715f0bd-kube-api-access-6fmcz" (OuterVolumeSpecName: "kube-api-access-6fmcz") pod "387c12ce-5dd0-4710-b70e-3ad74715f0bd" (UID: "387c12ce-5dd0-4710-b70e-3ad74715f0bd"). InnerVolumeSpecName "kube-api-access-6fmcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:26.864448 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.864411    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/387c12ce-5dd0-4710-b70e-3ad74715f0bd-extensions-socket-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:26.864448 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:26.864440    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fmcz\" (UniqueName: \"kubernetes.io/projected/387c12ce-5dd0-4710-b70e-3ad74715f0bd-kube-api-access-6fmcz\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:05:27.415635 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.415602    2572 generic.go:356] "Generic (PLEG): container finished" podID="387c12ce-5dd0-4710-b70e-3ad74715f0bd" containerID="1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a" exitCode=0
Jul 20 20:05:27.416077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.415653    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"
Jul 20 20:05:27.416077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.415692    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk" event={"ID":"387c12ce-5dd0-4710-b70e-3ad74715f0bd","Type":"ContainerDied","Data":"1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a"}
Jul 20 20:05:27.416077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.415765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk" event={"ID":"387c12ce-5dd0-4710-b70e-3ad74715f0bd","Type":"ContainerDied","Data":"0c4385a40eaf78c4643925826f18776f745afd17a008f5de85fed98c1011029c"}
Jul 20 20:05:27.416077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.415794    2572 scope.go:117] "RemoveContainer" containerID="1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a"
Jul 20 20:05:27.425741 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.425707    2572 scope.go:117] "RemoveContainer" containerID="1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a"
Jul 20 20:05:27.426050 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:05:27.426029    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a\": container with ID starting with 1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a not found: ID does not exist" containerID="1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a"
Jul 20 20:05:27.426098 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.426063    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a"} err="failed to get container status \"1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a\": rpc error: code = NotFound desc = could not find container \"1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a\": container with ID starting with 1dd1dc2d34e6c417d17786e113edd8bd73d3ac41dc700539799d018634d5924a not found: ID does not exist"
Jul 20 20:05:27.437992 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.437951    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"]
Jul 20 20:05:27.445515 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:27.445483    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zndsk"]
Jul 20 20:05:28.725625 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:28.725587    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387c12ce-5dd0-4710-b70e-3ad74715f0bd" path="/var/lib/kubelet/pods/387c12ce-5dd0-4710-b70e-3ad74715f0bd/volumes"
Jul 20 20:05:46.177465 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.177425    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:05:46.177973 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.177822    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387c12ce-5dd0-4710-b70e-3ad74715f0bd" containerName="manager"
Jul 20 20:05:46.177973 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.177835    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="387c12ce-5dd0-4710-b70e-3ad74715f0bd" containerName="manager"
Jul 20 20:05:46.177973 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.177893    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="387c12ce-5dd0-4710-b70e-3ad74715f0bd" containerName="manager"
Jul 20 20:05:46.180950 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.180931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.183244 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.183217    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 20:05:46.183393 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.183289    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6r4\""
Jul 20 20:05:46.190286 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.190260    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:05:46.270487 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.270451    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:05:46.338512 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.338479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-config-file\") pod \"limitador-limitador-64c94fd64f-462b9\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.338690 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.338520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45bhg\" (UniqueName: \"kubernetes.io/projected/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-kube-api-access-45bhg\") pod \"limitador-limitador-64c94fd64f-462b9\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.439590 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.439491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-config-file\") pod \"limitador-limitador-64c94fd64f-462b9\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.439590 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.439547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45bhg\" (UniqueName: \"kubernetes.io/projected/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-kube-api-access-45bhg\") pod \"limitador-limitador-64c94fd64f-462b9\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.440194 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.440175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-config-file\") pod \"limitador-limitador-64c94fd64f-462b9\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.447916 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.447885    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45bhg\" (UniqueName: \"kubernetes.io/projected/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-kube-api-access-45bhg\") pod \"limitador-limitador-64c94fd64f-462b9\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.492123 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.492086    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:46.649986 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:46.649950    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:05:46.653245 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:05:46.653211    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e84dc8_b0fa_495e_bfa8_efaf34f08c4c.slice/crio-500af4f2cc77ee4973d0e894c8c17233ccc2c93c212845fe65054eba8f67da5e WatchSource:0}: Error finding container 500af4f2cc77ee4973d0e894c8c17233ccc2c93c212845fe65054eba8f67da5e: Status 404 returned error can't find the container with id 500af4f2cc77ee4973d0e894c8c17233ccc2c93c212845fe65054eba8f67da5e
Jul 20 20:05:47.539249 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:47.539177    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9" event={"ID":"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c","Type":"ContainerStarted","Data":"500af4f2cc77ee4973d0e894c8c17233ccc2c93c212845fe65054eba8f67da5e"}
Jul 20 20:05:49.552126 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:49.552078    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9" event={"ID":"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c","Type":"ContainerStarted","Data":"05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240"}
Jul 20 20:05:49.552505 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:49.552246    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:05:49.572492 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:05:49.572433    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9" podStartSLOduration=0.881301861 podStartE2EDuration="3.572416008s" totalImagesPullingTime="2.691114147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:49.570544655 +0000 UTC m=+574.153775536" watchObservedRunningTime="2026-07-20 20:05:49.572416008 +0000 UTC m=+574.155646895"
Jul 20 20:06:00.559159 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:00.559121    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:06:00.977803 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:00.977756    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:06:00.978020 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:00.977992    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9" podUID="66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" containerName="limitador" containerID="cri-o://05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240" gracePeriod=30
Jul 20 20:06:01.538239 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.538206    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:06:01.560194 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.560107    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45bhg\" (UniqueName: \"kubernetes.io/projected/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-kube-api-access-45bhg\") pod \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") "
Jul 20 20:06:01.560194 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.560188    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-config-file\") pod \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\" (UID: \"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c\") "
Jul 20 20:06:01.560640 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.560609    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-config-file" (OuterVolumeSpecName: "config-file") pod "66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" (UID: "66e84dc8-b0fa-495e-bfa8-efaf34f08c4c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:06:01.562675 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.562644    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-kube-api-access-45bhg" (OuterVolumeSpecName: "kube-api-access-45bhg") pod "66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" (UID: "66e84dc8-b0fa-495e-bfa8-efaf34f08c4c"). InnerVolumeSpecName "kube-api-access-45bhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:06:01.622234 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.622192    2572 generic.go:356] "Generic (PLEG): container finished" podID="66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" containerID="05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240" exitCode=0
Jul 20 20:06:01.622407 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.622239    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9"
Jul 20 20:06:01.622407 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.622242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9" event={"ID":"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c","Type":"ContainerDied","Data":"05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240"}
Jul 20 20:06:01.622407 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.622368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-462b9" event={"ID":"66e84dc8-b0fa-495e-bfa8-efaf34f08c4c","Type":"ContainerDied","Data":"500af4f2cc77ee4973d0e894c8c17233ccc2c93c212845fe65054eba8f67da5e"}
Jul 20 20:06:01.622407 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.622399    2572 scope.go:117] "RemoveContainer" containerID="05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240"
Jul 20 20:06:01.631659 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.631636    2572 scope.go:117] "RemoveContainer" containerID="05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240"
Jul 20 20:06:01.632066 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:06:01.632039    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240\": container with ID starting with 05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240 not found: ID does not exist" containerID="05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240"
Jul 20 20:06:01.632182 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.632075    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240"} err="failed to get container status \"05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240\": rpc error: code = NotFound desc = could not find container \"05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240\": container with ID starting with 05d887609a5f46f5bb6f00e0b0656b40fd24759e679434da0de6659979c59240 not found: ID does not exist"
Jul 20 20:06:01.645161 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.645124    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:06:01.648943 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.648906    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-462b9"]
Jul 20 20:06:01.660798 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.660764    2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-config-file\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:06:01.660798 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:01.660793    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45bhg\" (UniqueName: \"kubernetes.io/projected/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c-kube-api-access-45bhg\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:06:02.725036 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:02.724998    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" path="/var/lib/kubelet/pods/66e84dc8-b0fa-495e-bfa8-efaf34f08c4c/volumes"
Jul 20 20:06:04.957179 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.957143    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"]
Jul 20 20:06:04.957666 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.957514    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" containerName="limitador"
Jul 20 20:06:04.957666 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.957527    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" containerName="limitador"
Jul 20 20:06:04.957666 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.957604    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e84dc8-b0fa-495e-bfa8-efaf34f08c4c" containerName="limitador"
Jul 20 20:06:04.962124 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.962097    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:04.964956 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.964927    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-hm7wt\""
Jul 20 20:06:04.965168 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.965146    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 20:06:04.965592 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.965572    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 20:06:04.965592 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.965595    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 20:06:04.971408 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.971374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"]
Jul 20 20:06:04.986002 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.985962    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnnpl\" (UniqueName: \"kubernetes.io/projected/b2eb6b9b-4b8b-4264-9abd-cad924181b55-kube-api-access-rnnpl\") pod \"postgres-69fb4594cf-9mfp9\" (UID: \"b2eb6b9b-4b8b-4264-9abd-cad924181b55\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:04.986198 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:04.986057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2eb6b9b-4b8b-4264-9abd-cad924181b55-data\") pod \"postgres-69fb4594cf-9mfp9\" (UID: \"b2eb6b9b-4b8b-4264-9abd-cad924181b55\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:05.086549 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.086504    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnnpl\" (UniqueName: \"kubernetes.io/projected/b2eb6b9b-4b8b-4264-9abd-cad924181b55-kube-api-access-rnnpl\") pod \"postgres-69fb4594cf-9mfp9\" (UID: \"b2eb6b9b-4b8b-4264-9abd-cad924181b55\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:05.086549 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.086553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2eb6b9b-4b8b-4264-9abd-cad924181b55-data\") pod \"postgres-69fb4594cf-9mfp9\" (UID: \"b2eb6b9b-4b8b-4264-9abd-cad924181b55\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:05.086945 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.086928    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b2eb6b9b-4b8b-4264-9abd-cad924181b55-data\") pod \"postgres-69fb4594cf-9mfp9\" (UID: \"b2eb6b9b-4b8b-4264-9abd-cad924181b55\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:05.094492 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.094463    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnnpl\" (UniqueName: \"kubernetes.io/projected/b2eb6b9b-4b8b-4264-9abd-cad924181b55-kube-api-access-rnnpl\") pod \"postgres-69fb4594cf-9mfp9\" (UID: \"b2eb6b9b-4b8b-4264-9abd-cad924181b55\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:05.276194 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.276087    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:05.421005 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.420976    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"]
Jul 20 20:06:05.422882 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:06:05.422854    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2eb6b9b_4b8b_4264_9abd_cad924181b55.slice/crio-bb23f5c6005eff255531b677f5a1374e49097fa9c68df1f4dd4ea9008fd38fb9 WatchSource:0}: Error finding container bb23f5c6005eff255531b677f5a1374e49097fa9c68df1f4dd4ea9008fd38fb9: Status 404 returned error can't find the container with id bb23f5c6005eff255531b677f5a1374e49097fa9c68df1f4dd4ea9008fd38fb9
Jul 20 20:06:05.647108 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:05.647075    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9" event={"ID":"b2eb6b9b-4b8b-4264-9abd-cad924181b55","Type":"ContainerStarted","Data":"bb23f5c6005eff255531b677f5a1374e49097fa9c68df1f4dd4ea9008fd38fb9"}
Jul 20 20:06:10.681788 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:10.681741    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9" event={"ID":"b2eb6b9b-4b8b-4264-9abd-cad924181b55","Type":"ContainerStarted","Data":"e374806974ebdeb571071971e566c81f3f50e9e109fda123fc95f902b0b8d3ac"}
Jul 20 20:06:10.682250 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:10.681838    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:10.699142 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:10.699082    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9" podStartSLOduration=1.6396453119999999 podStartE2EDuration="6.699061664s" totalImagesPullingTime="5.059416352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:06:10.698517768 +0000 UTC m=+595.281748656" watchObservedRunningTime="2026-07-20 20:06:10.699061664 +0000 UTC m=+595.282292551"
Jul 20 20:06:16.670961 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:16.670930    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:06:16.671454 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:16.670930    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:06:16.717696 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:16.717664    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mfp9"
Jul 20 20:06:24.637940 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.637899    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84c6986c77-6m2dl"]
Jul 20 20:06:24.665943 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.665909    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c6986c77-6m2dl"]
Jul 20 20:06:24.666148 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.665917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.668232 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.668205    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 20:06:24.668381 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.668323    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 20:06:24.668381 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.668360    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4qdn7\""
Jul 20 20:06:24.756863 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.756828    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jbvg\" (UniqueName: \"kubernetes.io/projected/c12d023f-66cc-4861-bf4f-a63389666a15-kube-api-access-6jbvg\") pod \"maas-controller-84c6986c77-6m2dl\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") " pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.757053 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.756894    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12d023f-66cc-4861-bf4f-a63389666a15-webhook-cert\") pod \"maas-controller-84c6986c77-6m2dl\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") " pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.821709 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.821667    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77bdf94859-lgz2j"]
Jul 20 20:06:24.825712 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.825684    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:24.834245 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.834211    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77bdf94859-lgz2j"]
Jul 20 20:06:24.859503 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.858265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jbvg\" (UniqueName: \"kubernetes.io/projected/c12d023f-66cc-4861-bf4f-a63389666a15-kube-api-access-6jbvg\") pod \"maas-controller-84c6986c77-6m2dl\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") " pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.859503 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.858358    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12d023f-66cc-4861-bf4f-a63389666a15-webhook-cert\") pod \"maas-controller-84c6986c77-6m2dl\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") " pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.864108 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.864063    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12d023f-66cc-4861-bf4f-a63389666a15-webhook-cert\") pod \"maas-controller-84c6986c77-6m2dl\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") " pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.867177 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.867143    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jbvg\" (UniqueName: \"kubernetes.io/projected/c12d023f-66cc-4861-bf4f-a63389666a15-kube-api-access-6jbvg\") pod \"maas-controller-84c6986c77-6m2dl\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") " pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:24.959203 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.959098    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43b8ebc-7242-499f-8d93-04de30c6b90a-webhook-cert\") pod \"maas-controller-77bdf94859-lgz2j\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") " pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:24.959203 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.959183    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwx99\" (UniqueName: \"kubernetes.io/projected/b43b8ebc-7242-499f-8d93-04de30c6b90a-kube-api-access-dwx99\") pod \"maas-controller-77bdf94859-lgz2j\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") " pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:24.977053 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:24.977017    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:25.060047 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.060011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43b8ebc-7242-499f-8d93-04de30c6b90a-webhook-cert\") pod \"maas-controller-77bdf94859-lgz2j\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") " pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:25.060047 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.060055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwx99\" (UniqueName: \"kubernetes.io/projected/b43b8ebc-7242-499f-8d93-04de30c6b90a-kube-api-access-dwx99\") pod \"maas-controller-77bdf94859-lgz2j\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") " pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:25.063115 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.063097    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43b8ebc-7242-499f-8d93-04de30c6b90a-webhook-cert\") pod \"maas-controller-77bdf94859-lgz2j\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") " pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:25.068611 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.068577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwx99\" (UniqueName: \"kubernetes.io/projected/b43b8ebc-7242-499f-8d93-04de30c6b90a-kube-api-access-dwx99\") pod \"maas-controller-77bdf94859-lgz2j\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") " pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:25.117291 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.117263    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c6986c77-6m2dl"]
Jul 20 20:06:25.119155 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:06:25.119127    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12d023f_66cc_4861_bf4f_a63389666a15.slice/crio-481f524d54a7b1aa35ae2bb91aa941da78fe58a41d3cf1fb82fc10bef5461989 WatchSource:0}: Error finding container 481f524d54a7b1aa35ae2bb91aa941da78fe58a41d3cf1fb82fc10bef5461989: Status 404 returned error can't find the container with id 481f524d54a7b1aa35ae2bb91aa941da78fe58a41d3cf1fb82fc10bef5461989
Jul 20 20:06:25.155657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.155621    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:25.295663 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.295631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77bdf94859-lgz2j"]
Jul 20 20:06:25.297587 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:06:25.297558    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43b8ebc_7242_499f_8d93_04de30c6b90a.slice/crio-297b9dcedc18c7a52cd09a25103ffbe0e09d9cfde7bbf4388d112ffde54390bc WatchSource:0}: Error finding container 297b9dcedc18c7a52cd09a25103ffbe0e09d9cfde7bbf4388d112ffde54390bc: Status 404 returned error can't find the container with id 297b9dcedc18c7a52cd09a25103ffbe0e09d9cfde7bbf4388d112ffde54390bc
Jul 20 20:06:25.767624 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.766747    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bdf94859-lgz2j" event={"ID":"b43b8ebc-7242-499f-8d93-04de30c6b90a","Type":"ContainerStarted","Data":"297b9dcedc18c7a52cd09a25103ffbe0e09d9cfde7bbf4388d112ffde54390bc"}
Jul 20 20:06:25.772303 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:25.772161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c6986c77-6m2dl" event={"ID":"c12d023f-66cc-4861-bf4f-a63389666a15","Type":"ContainerStarted","Data":"481f524d54a7b1aa35ae2bb91aa941da78fe58a41d3cf1fb82fc10bef5461989"}
Jul 20 20:06:27.786602 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:27.786456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bdf94859-lgz2j" event={"ID":"b43b8ebc-7242-499f-8d93-04de30c6b90a","Type":"ContainerStarted","Data":"ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018"}
Jul 20 20:06:27.787102 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:27.786637    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:27.788524 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:27.788495    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c6986c77-6m2dl" event={"ID":"c12d023f-66cc-4861-bf4f-a63389666a15","Type":"ContainerStarted","Data":"3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c"}
Jul 20 20:06:27.788670 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:27.788587    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:27.816528 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:27.816467    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77bdf94859-lgz2j" podStartSLOduration=1.477820603 podStartE2EDuration="3.816450153s" totalImagesPullingTime="2.33862955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:06:27.812810342 +0000 UTC m=+612.396041227" watchObservedRunningTime="2026-07-20 20:06:27.816450153 +0000 UTC m=+612.399681039"
Jul 20 20:06:27.847921 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:27.847849    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84c6986c77-6m2dl" podStartSLOduration=1.3378098999999999 podStartE2EDuration="3.847832391s" totalImagesPullingTime="2.510022491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:06:27.845941042 +0000 UTC m=+612.429171930" watchObservedRunningTime="2026-07-20 20:06:27.847832391 +0000 UTC m=+612.431063281"
Jul 20 20:06:38.797228 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:38.797147    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:06:38.797228 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:38.797218    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:38.864192 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:38.864154    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c6986c77-6m2dl"]
Jul 20 20:06:38.864382 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:38.864346    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84c6986c77-6m2dl" podUID="c12d023f-66cc-4861-bf4f-a63389666a15" containerName="manager" containerID="cri-o://3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c" gracePeriod=30
Jul 20 20:06:39.121343 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.121314    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:39.185234 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.185188    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jbvg\" (UniqueName: \"kubernetes.io/projected/c12d023f-66cc-4861-bf4f-a63389666a15-kube-api-access-6jbvg\") pod \"c12d023f-66cc-4861-bf4f-a63389666a15\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") "
Jul 20 20:06:39.185234 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.185232    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12d023f-66cc-4861-bf4f-a63389666a15-webhook-cert\") pod \"c12d023f-66cc-4861-bf4f-a63389666a15\" (UID: \"c12d023f-66cc-4861-bf4f-a63389666a15\") "
Jul 20 20:06:39.187475 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.187447    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c12d023f-66cc-4861-bf4f-a63389666a15-kube-api-access-6jbvg" (OuterVolumeSpecName: "kube-api-access-6jbvg") pod "c12d023f-66cc-4861-bf4f-a63389666a15" (UID: "c12d023f-66cc-4861-bf4f-a63389666a15"). InnerVolumeSpecName "kube-api-access-6jbvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:06:39.187608 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.187523    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c12d023f-66cc-4861-bf4f-a63389666a15-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c12d023f-66cc-4861-bf4f-a63389666a15" (UID: "c12d023f-66cc-4861-bf4f-a63389666a15"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:06:39.285997 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.285941    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jbvg\" (UniqueName: \"kubernetes.io/projected/c12d023f-66cc-4861-bf4f-a63389666a15-kube-api-access-6jbvg\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:06:39.285997 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.285990    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c12d023f-66cc-4861-bf4f-a63389666a15-webhook-cert\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:06:39.857045 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.857006    2572 generic.go:356] "Generic (PLEG): container finished" podID="c12d023f-66cc-4861-bf4f-a63389666a15" containerID="3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c" exitCode=0
Jul 20 20:06:39.857045 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.857048    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c6986c77-6m2dl"
Jul 20 20:06:39.857567 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.857055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c6986c77-6m2dl" event={"ID":"c12d023f-66cc-4861-bf4f-a63389666a15","Type":"ContainerDied","Data":"3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c"}
Jul 20 20:06:39.857567 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.857104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c6986c77-6m2dl" event={"ID":"c12d023f-66cc-4861-bf4f-a63389666a15","Type":"ContainerDied","Data":"481f524d54a7b1aa35ae2bb91aa941da78fe58a41d3cf1fb82fc10bef5461989"}
Jul 20 20:06:39.857567 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.857126    2572 scope.go:117] "RemoveContainer" containerID="3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c"
Jul 20 20:06:39.867587 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.867454    2572 scope.go:117] "RemoveContainer" containerID="3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c"
Jul 20 20:06:39.867819 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:06:39.867798    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c\": container with ID starting with 3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c not found: ID does not exist" containerID="3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c"
Jul 20 20:06:39.867865 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.867827    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c"} err="failed to get container status \"3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c\": rpc error: code = NotFound desc = could not find container \"3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c\": container with ID starting with 3f8ab7334559f4a114c877f6f5457facb904003efd0c625cae5dbaace23c301c not found: ID does not exist"
Jul 20 20:06:39.886792 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.886753    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c6986c77-6m2dl"]
Jul 20 20:06:39.889048 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:39.889022    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84c6986c77-6m2dl"]
Jul 20 20:06:40.724870 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:06:40.724831    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c12d023f-66cc-4861-bf4f-a63389666a15" path="/var/lib/kubelet/pods/c12d023f-66cc-4861-bf4f-a63389666a15/volumes"
Jul 20 20:07:00.596577 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.596534    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"]
Jul 20 20:07:00.597216 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.597195    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c12d023f-66cc-4861-bf4f-a63389666a15" containerName="manager"
Jul 20 20:07:00.597297 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.597219    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c12d023f-66cc-4861-bf4f-a63389666a15" containerName="manager"
Jul 20 20:07:00.597351 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.597327    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c12d023f-66cc-4861-bf4f-a63389666a15" containerName="manager"
Jul 20 20:07:00.601417 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.601387    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.604033 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.604001    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 20:07:00.617376 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.617340    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"]
Jul 20 20:07:00.677488 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.677441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d237c5c7-8345-4662-8d37-e857ee56cdcd-openshift-service-ca\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.677683 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.677523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d237c5c7-8345-4662-8d37-e857ee56cdcd-maas-api-tls\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.677683 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.677545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcx2x\" (UniqueName: \"kubernetes.io/projected/d237c5c7-8345-4662-8d37-e857ee56cdcd-kube-api-access-xcx2x\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.778843 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.778801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d237c5c7-8345-4662-8d37-e857ee56cdcd-openshift-service-ca\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.779060 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.778863    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d237c5c7-8345-4662-8d37-e857ee56cdcd-maas-api-tls\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.779060 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.778882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcx2x\" (UniqueName: \"kubernetes.io/projected/d237c5c7-8345-4662-8d37-e857ee56cdcd-kube-api-access-xcx2x\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.779542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.779505    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d237c5c7-8345-4662-8d37-e857ee56cdcd-openshift-service-ca\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.781338 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.781311    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d237c5c7-8345-4662-8d37-e857ee56cdcd-maas-api-tls\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.788092 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.788057    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcx2x\" (UniqueName: \"kubernetes.io/projected/d237c5c7-8345-4662-8d37-e857ee56cdcd-kube-api-access-xcx2x\") pod \"maas-api-8674778c7c-wbpph\" (UID: \"d237c5c7-8345-4662-8d37-e857ee56cdcd\") " pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:00.912985 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:00.912894    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:01.062511 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.062475    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"]
Jul 20 20:07:01.066249 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:07:01.066215    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd237c5c7_8345_4662_8d37_e857ee56cdcd.slice/crio-e2058f7aff15215ff959c5fde270f57c91d902ed7eb64ebb2b47225e4b84ce06 WatchSource:0}: Error finding container e2058f7aff15215ff959c5fde270f57c91d902ed7eb64ebb2b47225e4b84ce06: Status 404 returned error can't find the container with id e2058f7aff15215ff959c5fde270f57c91d902ed7eb64ebb2b47225e4b84ce06
Jul 20 20:07:01.067994 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.067959    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:07:01.271884 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.271788    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-c6gjw"]
Jul 20 20:07:01.274635 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.274613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.277127 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.277104    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 20:07:01.277289 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.277168    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mbmpp\""
Jul 20 20:07:01.283503 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.283471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b-plugins-config-volume\") pod \"payload-processing-5bf47cd988-c6gjw\" (UID: \"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b\") " pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.283647 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.283541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7cj7\" (UniqueName: \"kubernetes.io/projected/8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b-kube-api-access-h7cj7\") pod \"payload-processing-5bf47cd988-c6gjw\" (UID: \"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b\") " pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.287659 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.287620    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-c6gjw"]
Jul 20 20:07:01.308780 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.308743    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"]
Jul 20 20:07:01.311133 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.311114    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.325519 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.325485    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"]
Jul 20 20:07:01.384206 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.384173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b-plugins-config-volume\") pod \"payload-processing-5bf47cd988-c6gjw\" (UID: \"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b\") " pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.384385 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.384212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf86p\" (UniqueName: \"kubernetes.io/projected/e65d27e5-10a1-4f15-adb0-4098c778e293-kube-api-access-pf86p\") pod \"payload-pre-processing-7677b774bb-9c4w7\" (UID: \"e65d27e5-10a1-4f15-adb0-4098c778e293\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.384385 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.384254    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7cj7\" (UniqueName: \"kubernetes.io/projected/8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b-kube-api-access-h7cj7\") pod \"payload-processing-5bf47cd988-c6gjw\" (UID: \"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b\") " pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.384385 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.384308    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e65d27e5-10a1-4f15-adb0-4098c778e293-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-9c4w7\" (UID: \"e65d27e5-10a1-4f15-adb0-4098c778e293\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.384929 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.384900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b-plugins-config-volume\") pod \"payload-processing-5bf47cd988-c6gjw\" (UID: \"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b\") " pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.395254 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.395215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7cj7\" (UniqueName: \"kubernetes.io/projected/8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b-kube-api-access-h7cj7\") pod \"payload-processing-5bf47cd988-c6gjw\" (UID: \"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b\") " pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.485395 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.485352    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e65d27e5-10a1-4f15-adb0-4098c778e293-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-9c4w7\" (UID: \"e65d27e5-10a1-4f15-adb0-4098c778e293\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.485759 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.485686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf86p\" (UniqueName: \"kubernetes.io/projected/e65d27e5-10a1-4f15-adb0-4098c778e293-kube-api-access-pf86p\") pod \"payload-pre-processing-7677b774bb-9c4w7\" (UID: \"e65d27e5-10a1-4f15-adb0-4098c778e293\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.486421 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.486396    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e65d27e5-10a1-4f15-adb0-4098c778e293-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-9c4w7\" (UID: \"e65d27e5-10a1-4f15-adb0-4098c778e293\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.494481 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.494444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf86p\" (UniqueName: \"kubernetes.io/projected/e65d27e5-10a1-4f15-adb0-4098c778e293-kube-api-access-pf86p\") pod \"payload-pre-processing-7677b774bb-9c4w7\" (UID: \"e65d27e5-10a1-4f15-adb0-4098c778e293\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.587122 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.587009    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:01.623285 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.623246    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:01.740964 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.740439    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-c6gjw"]
Jul 20 20:07:01.743439 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:07:01.743382    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7b0e2b_4b81_493d_bcf4_da5989eb7d7b.slice/crio-151f59749ad12554421be77a351959ea76ad84b1061be9c379c3ac25bf030e7e WatchSource:0}: Error finding container 151f59749ad12554421be77a351959ea76ad84b1061be9c379c3ac25bf030e7e: Status 404 returned error can't find the container with id 151f59749ad12554421be77a351959ea76ad84b1061be9c379c3ac25bf030e7e
Jul 20 20:07:01.791054 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.790964    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"]
Jul 20 20:07:01.793113 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:07:01.793083    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65d27e5_10a1_4f15_adb0_4098c778e293.slice/crio-7ce1f3c5f9e2d853c428b00df0b96ccafc691c77bae53cdcf0bb3c66aab96410 WatchSource:0}: Error finding container 7ce1f3c5f9e2d853c428b00df0b96ccafc691c77bae53cdcf0bb3c66aab96410: Status 404 returned error can't find the container with id 7ce1f3c5f9e2d853c428b00df0b96ccafc691c77bae53cdcf0bb3c66aab96410
Jul 20 20:07:01.985961 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.985919    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw" event={"ID":"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b","Type":"ContainerStarted","Data":"151f59749ad12554421be77a351959ea76ad84b1061be9c379c3ac25bf030e7e"}
Jul 20 20:07:01.987109 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.987088    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7" event={"ID":"e65d27e5-10a1-4f15-adb0-4098c778e293","Type":"ContainerStarted","Data":"7ce1f3c5f9e2d853c428b00df0b96ccafc691c77bae53cdcf0bb3c66aab96410"}
Jul 20 20:07:01.988406 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:01.988379    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph" event={"ID":"d237c5c7-8345-4662-8d37-e857ee56cdcd","Type":"ContainerStarted","Data":"e2058f7aff15215ff959c5fde270f57c91d902ed7eb64ebb2b47225e4b84ce06"}
Jul 20 20:07:03.002072 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:03.002028    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph" event={"ID":"d237c5c7-8345-4662-8d37-e857ee56cdcd","Type":"ContainerStarted","Data":"85cceec8cd6f57628ccedb348c133964602e2acb58ba1fba6dc5ff023ca80549"}
Jul 20 20:07:03.002552 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:03.002298    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:03.027800 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:03.026989    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph" podStartSLOduration=1.333148045 podStartE2EDuration="3.026966412s" totalImagesPullingTime="1.693818367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:03.025831806 +0000 UTC m=+647.609062695" watchObservedRunningTime="2026-07-20 20:07:03.026966412 +0000 UTC m=+647.610197302"
Jul 20 20:07:04.010118 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:04.010077    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw" event={"ID":"8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b","Type":"ContainerStarted","Data":"fec9f5e21ef9aa251ebf2c65b4531dd1e93ced2c19511d1e7da9f28ef076324c"}
Jul 20 20:07:04.010632 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:04.010286    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:04.011783 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:04.011752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7" event={"ID":"e65d27e5-10a1-4f15-adb0-4098c778e293","Type":"ContainerStarted","Data":"cf3f3f52b589d0d9109c79e4a4d64829f09d817482f804508974dc3f5b81b4fa"}
Jul 20 20:07:04.032848 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:04.032787    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw" podStartSLOduration=1.214514982 podStartE2EDuration="3.032769901s" totalImagesPullingTime="1.818254919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:04.030067351 +0000 UTC m=+648.613298238" watchObservedRunningTime="2026-07-20 20:07:04.032769901 +0000 UTC m=+648.616000787"
Jul 20 20:07:04.051010 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:04.050946    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7" podStartSLOduration=0.956171668 podStartE2EDuration="3.050924682s" totalImagesPullingTime="2.094753014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:04.049930143 +0000 UTC m=+648.633161030" watchObservedRunningTime="2026-07-20 20:07:04.050924682 +0000 UTC m=+648.634155570"
Jul 20 20:07:05.017221 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:05.017190    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:09.017640 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:09.017604    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8674778c7c-wbpph"
Jul 20 20:07:15.020159 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:15.020126    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-c6gjw"
Jul 20 20:07:16.025392 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:16.025360    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-9c4w7"
Jul 20 20:07:24.327659 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.327616    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"]
Jul 20 20:07:24.332384 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.332363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.335473 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.335450    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 20:07:24.335590 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.335497    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z9f7c\""
Jul 20 20:07:24.335590 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.335497    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 20:07:24.335703 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.335562    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 20:07:24.346883 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.346863    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"]
Jul 20 20:07:24.379077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.379044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.379229 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.379089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6nz7\" (UniqueName: \"kubernetes.io/projected/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-kube-api-access-d6nz7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.379229 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.379112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.379229 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.379181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.379371 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.379240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.379371 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.379265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6nz7\" (UniqueName: \"kubernetes.io/projected/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-kube-api-access-d6nz7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480650 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480650 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480442    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480650 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480650 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480919 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480961 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480915    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.480961 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.480942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.483492 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.483467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.483602 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.483581    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.487598 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.487578    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6nz7\" (UniqueName: \"kubernetes.io/projected/a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d-kube-api-access-d6nz7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2\" (UID: \"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.643391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.643353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:24.791846 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:24.791814    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"]
Jul 20 20:07:24.793595 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:07:24.793571    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c2afe4_a38a_44f9_b60b_8a89ff7cc01d.slice/crio-f5de32ec1345f38be1dc3982c9f3820c51d8eb807616f248da7bb90b0fe48368 WatchSource:0}: Error finding container f5de32ec1345f38be1dc3982c9f3820c51d8eb807616f248da7bb90b0fe48368: Status 404 returned error can't find the container with id f5de32ec1345f38be1dc3982c9f3820c51d8eb807616f248da7bb90b0fe48368
Jul 20 20:07:25.136344 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:25.136291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2" event={"ID":"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d","Type":"ContainerStarted","Data":"f5de32ec1345f38be1dc3982c9f3820c51d8eb807616f248da7bb90b0fe48368"}
Jul 20 20:07:26.143196 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:26.143161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2" event={"ID":"a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d","Type":"ContainerStarted","Data":"036fa09469db7a32de181a6cbb51a95537496c4148f0816117e92e4a53dd6812"}
Jul 20 20:07:26.163307 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:26.163209    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2" podStartSLOduration=1.061128116 podStartE2EDuration="2.163194298s" totalImagesPullingTime="1.102066182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:26.162290035 +0000 UTC m=+670.745520922" watchObservedRunningTime="2026-07-20 20:07:26.163194298 +0000 UTC m=+670.746425186"
Jul 20 20:07:34.644490 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:34.644446    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:34.644996 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:34.644521    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:34.657057 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:34.657032    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:35.207921 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:35.207895    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2"
Jul 20 20:07:47.153461 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.153425    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"]
Jul 20 20:07:47.157050 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.157031    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.160057 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.160034    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 20:07:47.179512 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.179473    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"]
Jul 20 20:07:47.283498 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.283458    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.283498 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.283498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qfk9\" (UniqueName: \"kubernetes.io/projected/2c8d56e7-e881-48f4-a4fb-d79c8b234873-kube-api-access-5qfk9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.283775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.283528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.283775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.283624    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.283775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.283669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8d56e7-e881-48f4-a4fb-d79c8b234873-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.283929 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.283791    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384486 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384440    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8d56e7-e881-48f4-a4fb-d79c8b234873-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384673 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384673 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384823 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qfk9\" (UniqueName: \"kubernetes.io/projected/2c8d56e7-e881-48f4-a4fb-d79c8b234873-kube-api-access-5qfk9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384823 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384934 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.384996 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.385055 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.384993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.385178 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.385158    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.387050 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.387019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8d56e7-e881-48f4-a4fb-d79c8b234873-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.387050 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.387031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8d56e7-e881-48f4-a4fb-d79c8b234873-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.395812 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.395786    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qfk9\" (UniqueName: \"kubernetes.io/projected/2c8d56e7-e881-48f4-a4fb-d79c8b234873-kube-api-access-5qfk9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j8hx\" (UID: \"2c8d56e7-e881-48f4-a4fb-d79c8b234873\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.467337 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.467237    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:47.603865 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:47.603829    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"]
Jul 20 20:07:47.605439 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:07:47.605413    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8d56e7_e881_48f4_a4fb_d79c8b234873.slice/crio-f625b6dff45b07a56f39eb2984754ff42b2ccfdd076b154bffc6e9c72f0c352f WatchSource:0}: Error finding container f625b6dff45b07a56f39eb2984754ff42b2ccfdd076b154bffc6e9c72f0c352f: Status 404 returned error can't find the container with id f625b6dff45b07a56f39eb2984754ff42b2ccfdd076b154bffc6e9c72f0c352f
Jul 20 20:07:48.277163 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:48.277065    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx" event={"ID":"2c8d56e7-e881-48f4-a4fb-d79c8b234873","Type":"ContainerStarted","Data":"0cc93de50d07db3f80c18a7ef9e3859ecc96888e309f0e68c7db67b072aa03a5"}
Jul 20 20:07:48.277163 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:48.277120    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx" event={"ID":"2c8d56e7-e881-48f4-a4fb-d79c8b234873","Type":"ContainerStarted","Data":"f625b6dff45b07a56f39eb2984754ff42b2ccfdd076b154bffc6e9c72f0c352f"}
Jul 20 20:07:48.296846 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:48.296792    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx" podStartSLOduration=0.963758775 podStartE2EDuration="1.296773623s" totalImagesPullingTime="333.014848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:48.295836136 +0000 UTC m=+692.879067023" watchObservedRunningTime="2026-07-20 20:07:48.296773623 +0000 UTC m=+692.880004510"
Jul 20 20:07:55.336073 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.336034    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"]
Jul 20 20:07:55.339987 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.339962    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.342618 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.342592    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 20:07:55.350762 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.350715    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"]
Jul 20 20:07:55.466441 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.466404    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.466441 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.466445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.466680 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.466472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2shvx\" (UniqueName: \"kubernetes.io/projected/1d493e62-cb30-4ab3-99c1-a558b841960e-kube-api-access-2shvx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.466680 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.466613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.466680 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.466653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.466812 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.466697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d493e62-cb30-4ab3-99c1-a558b841960e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567394 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567610 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567408    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d493e62-cb30-4ab3-99c1-a558b841960e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567610 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567610 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567610 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2shvx\" (UniqueName: \"kubernetes.io/projected/1d493e62-cb30-4ab3-99c1-a558b841960e-kube-api-access-2shvx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567610 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567952 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567814    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567952 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.567952 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.567929    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.569792 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.569772    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d493e62-cb30-4ab3-99c1-a558b841960e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.569962 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.569944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d493e62-cb30-4ab3-99c1-a558b841960e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.582718 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.582687    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2shvx\" (UniqueName: \"kubernetes.io/projected/1d493e62-cb30-4ab3-99c1-a558b841960e-kube-api-access-2shvx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v\" (UID: \"1d493e62-cb30-4ab3-99c1-a558b841960e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.651507 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.651464    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:07:55.792502 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:55.792478    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"]
Jul 20 20:07:55.794637 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:07:55.794607    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d493e62_cb30_4ab3_99c1_a558b841960e.slice/crio-4232d72726904bbbaa742df14e303a83b24c1a8f3315f81c9404384587b4a35e WatchSource:0}: Error finding container 4232d72726904bbbaa742df14e303a83b24c1a8f3315f81c9404384587b4a35e: Status 404 returned error can't find the container with id 4232d72726904bbbaa742df14e303a83b24c1a8f3315f81c9404384587b4a35e
Jul 20 20:07:56.323811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:56.323769    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v" event={"ID":"1d493e62-cb30-4ab3-99c1-a558b841960e","Type":"ContainerStarted","Data":"85f376c881d3fffbc9f28c56cc08c995c065b135548e2e73cec6d1986b2131ef"}
Jul 20 20:07:56.323990 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:56.323839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v" event={"ID":"1d493e62-cb30-4ab3-99c1-a558b841960e","Type":"ContainerStarted","Data":"4232d72726904bbbaa742df14e303a83b24c1a8f3315f81c9404384587b4a35e"}
Jul 20 20:07:56.345366 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:56.345307    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v" podStartSLOduration=1.061630375 podStartE2EDuration="1.345287509s" totalImagesPullingTime="283.657134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:56.344618891 +0000 UTC m=+700.927849780" watchObservedRunningTime="2026-07-20 20:07:56.345287509 +0000 UTC m=+700.928518398"
Jul 20 20:07:57.467916 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:57.467870    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:57.468318 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:57.467949    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:57.484481 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:57.484444    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:07:58.346534 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:07:58.346505    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j8hx"
Jul 20 20:08:05.651627 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:08:05.651586    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:08:05.652198 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:08:05.651651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:08:05.664093 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:08:05.664067    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:08:06.396738 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:08:06.396702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v"
Jul 20 20:10:26.533705 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.533667    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77bdf94859-lgz2j"]
Jul 20 20:10:26.534274 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.533937    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77bdf94859-lgz2j" podUID="b43b8ebc-7242-499f-8d93-04de30c6b90a" containerName="manager" containerID="cri-o://ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018" gracePeriod=30
Jul 20 20:10:26.791665 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.791603    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:10:26.950471 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.950444    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43b8ebc-7242-499f-8d93-04de30c6b90a-webhook-cert\") pod \"b43b8ebc-7242-499f-8d93-04de30c6b90a\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") "
Jul 20 20:10:26.950661 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.950513    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwx99\" (UniqueName: \"kubernetes.io/projected/b43b8ebc-7242-499f-8d93-04de30c6b90a-kube-api-access-dwx99\") pod \"b43b8ebc-7242-499f-8d93-04de30c6b90a\" (UID: \"b43b8ebc-7242-499f-8d93-04de30c6b90a\") "
Jul 20 20:10:26.952518 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.952478    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b43b8ebc-7242-499f-8d93-04de30c6b90a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b43b8ebc-7242-499f-8d93-04de30c6b90a" (UID: "b43b8ebc-7242-499f-8d93-04de30c6b90a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:10:26.952636 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:26.952560    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b43b8ebc-7242-499f-8d93-04de30c6b90a-kube-api-access-dwx99" (OuterVolumeSpecName: "kube-api-access-dwx99") pod "b43b8ebc-7242-499f-8d93-04de30c6b90a" (UID: "b43b8ebc-7242-499f-8d93-04de30c6b90a"). InnerVolumeSpecName "kube-api-access-dwx99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:10:27.052111 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.052014    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b43b8ebc-7242-499f-8d93-04de30c6b90a-webhook-cert\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:10:27.052111 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.052056    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwx99\" (UniqueName: \"kubernetes.io/projected/b43b8ebc-7242-499f-8d93-04de30c6b90a-kube-api-access-dwx99\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:10:27.205926 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.205887    2572 generic.go:356] "Generic (PLEG): container finished" podID="b43b8ebc-7242-499f-8d93-04de30c6b90a" containerID="ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018" exitCode=0
Jul 20 20:10:27.206106 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.205935    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77bdf94859-lgz2j"
Jul 20 20:10:27.206106 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.205975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bdf94859-lgz2j" event={"ID":"b43b8ebc-7242-499f-8d93-04de30c6b90a","Type":"ContainerDied","Data":"ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018"}
Jul 20 20:10:27.206106 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.206033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77bdf94859-lgz2j" event={"ID":"b43b8ebc-7242-499f-8d93-04de30c6b90a","Type":"ContainerDied","Data":"297b9dcedc18c7a52cd09a25103ffbe0e09d9cfde7bbf4388d112ffde54390bc"}
Jul 20 20:10:27.206106 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.206058    2572 scope.go:117] "RemoveContainer" containerID="ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018"
Jul 20 20:10:27.216632 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.216616    2572 scope.go:117] "RemoveContainer" containerID="ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018"
Jul 20 20:10:27.216942 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:10:27.216922    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018\": container with ID starting with ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018 not found: ID does not exist" containerID="ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018"
Jul 20 20:10:27.217032 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.216949    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018"} err="failed to get container status \"ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018\": rpc error: code = NotFound desc = could not find container \"ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018\": container with ID starting with ba6a16492d4ff0c8ea4a565a1cae190668175ad73278c44dfa37242b873af018 not found: ID does not exist"
Jul 20 20:10:27.232379 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.232354    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77bdf94859-lgz2j"]
Jul 20 20:10:27.235720 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:27.235693    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77bdf94859-lgz2j"]
Jul 20 20:10:28.726145 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:10:28.726112    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b43b8ebc-7242-499f-8d93-04de30c6b90a" path="/var/lib/kubelet/pods/b43b8ebc-7242-499f-8d93-04de30c6b90a/volumes"
Jul 20 20:11:16.709451 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:11:16.709366    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:11:16.713647 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:11:16.713627    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:15:00.161969 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.161932    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"]
Jul 20 20:15:00.162444 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.162336    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b43b8ebc-7242-499f-8d93-04de30c6b90a" containerName="manager"
Jul 20 20:15:00.162444 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.162347    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b43b8ebc-7242-499f-8d93-04de30c6b90a" containerName="manager"
Jul 20 20:15:00.162444 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.162416    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b43b8ebc-7242-499f-8d93-04de30c6b90a" containerName="manager"
Jul 20 20:15:00.165460 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.165443    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"
Jul 20 20:15:00.169105 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.169086    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-628hb\""
Jul 20 20:15:00.174613 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.174594    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"
Jul 20 20:15:00.203296 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.203268    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"]
Jul 20 20:15:00.317398 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.317374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"]
Jul 20 20:15:00.319270 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:15:00.319247    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fa6edb_a095_4712_9098_6695c99e65e8.slice/crio-aaedf3b4e89f3a84fb49c6d9821e8add3d82fee6eac03cdc446d36c46d37ccfc WatchSource:0}: Error finding container aaedf3b4e89f3a84fb49c6d9821e8add3d82fee6eac03cdc446d36c46d37ccfc: Status 404 returned error can't find the container with id aaedf3b4e89f3a84fb49c6d9821e8add3d82fee6eac03cdc446d36c46d37ccfc
Jul 20 20:15:00.328859 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.321415    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:15:00.758118 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:00.758083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248" event={"ID":"d3fa6edb-a095-4712-9098-6695c99e65e8","Type":"ContainerStarted","Data":"aaedf3b4e89f3a84fb49c6d9821e8add3d82fee6eac03cdc446d36c46d37ccfc"}
Jul 20 20:15:03.777337 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:03.777238    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3fa6edb-a095-4712-9098-6695c99e65e8" containerID="edd6a63f970a190d8e2c9620a32ce32ad508bd5a52f32f173467af50203b4b43" exitCode=0
Jul 20 20:15:03.777337 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:03.777329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248" event={"ID":"d3fa6edb-a095-4712-9098-6695c99e65e8","Type":"ContainerDied","Data":"edd6a63f970a190d8e2c9620a32ce32ad508bd5a52f32f173467af50203b4b43"}
Jul 20 20:15:04.921968 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:04.921939    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"
Jul 20 20:15:05.789849 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:05.789822    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248"
Jul 20 20:15:05.789849 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:05.789832    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-ws248" event={"ID":"d3fa6edb-a095-4712-9098-6695c99e65e8","Type":"ContainerDied","Data":"aaedf3b4e89f3a84fb49c6d9821e8add3d82fee6eac03cdc446d36c46d37ccfc"}
Jul 20 20:15:05.790150 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:15:05.789873    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaedf3b4e89f3a84fb49c6d9821e8add3d82fee6eac03cdc446d36c46d37ccfc"
Jul 20 20:16:16.750005 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:16.749975    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:16:16.758048 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:16.758028    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:16:42.025660 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:42.025627    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"]
Jul 20 20:16:42.026121 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:42.025852    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5" podUID="4ae73549-1127-424c-855c-c62e38c99962" containerName="manager" containerID="cri-o://f1a9a24a329161b3965100e4bd464cebe67ef44f725f7633552116c63851bde3" gracePeriod=10
Jul 20 20:16:45.343230 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.343195    2572 generic.go:356] "Generic (PLEG): container finished" podID="4ae73549-1127-424c-855c-c62e38c99962" containerID="f1a9a24a329161b3965100e4bd464cebe67ef44f725f7633552116c63851bde3" exitCode=0
Jul 20 20:16:45.343625 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.343271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5" event={"ID":"4ae73549-1127-424c-855c-c62e38c99962","Type":"ContainerDied","Data":"f1a9a24a329161b3965100e4bd464cebe67ef44f725f7633552116c63851bde3"}
Jul 20 20:16:45.784530 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.784506    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:16:45.849466 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.849439    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae73549-1127-424c-855c-c62e38c99962-extensions-socket-volume\") pod \"4ae73549-1127-424c-855c-c62e38c99962\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") "
Jul 20 20:16:45.849621 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.849476    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvsdh\" (UniqueName: \"kubernetes.io/projected/4ae73549-1127-424c-855c-c62e38c99962-kube-api-access-kvsdh\") pod \"4ae73549-1127-424c-855c-c62e38c99962\" (UID: \"4ae73549-1127-424c-855c-c62e38c99962\") "
Jul 20 20:16:45.849831 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.849806    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae73549-1127-424c-855c-c62e38c99962-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ae73549-1127-424c-855c-c62e38c99962" (UID: "4ae73549-1127-424c-855c-c62e38c99962"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:16:45.851402 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.851383    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae73549-1127-424c-855c-c62e38c99962-kube-api-access-kvsdh" (OuterVolumeSpecName: "kube-api-access-kvsdh") pod "4ae73549-1127-424c-855c-c62e38c99962" (UID: "4ae73549-1127-424c-855c-c62e38c99962"). InnerVolumeSpecName "kube-api-access-kvsdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:16:45.951077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.951005    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae73549-1127-424c-855c-c62e38c99962-extensions-socket-volume\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:16:45.951077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:45.951030    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvsdh\" (UniqueName: \"kubernetes.io/projected/4ae73549-1127-424c-855c-c62e38c99962-kube-api-access-kvsdh\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:16:46.350342 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:46.350314    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"
Jul 20 20:16:46.350778 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:46.350351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5" event={"ID":"4ae73549-1127-424c-855c-c62e38c99962","Type":"ContainerDied","Data":"cae519c95922b8c0e5a164a6c871a2534460865441254737739e8d8d017e2b5f"}
Jul 20 20:16:46.350778 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:46.350412    2572 scope.go:117] "RemoveContainer" containerID="f1a9a24a329161b3965100e4bd464cebe67ef44f725f7633552116c63851bde3"
Jul 20 20:16:46.372645 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:46.372618    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"]
Jul 20 20:16:46.376000 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:46.375979    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w8sg5"]
Jul 20 20:16:46.726071 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:16:46.725996    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae73549-1127-424c-855c-c62e38c99962" path="/var/lib/kubelet/pods/4ae73549-1127-424c-855c-c62e38c99962/volumes"
Jul 20 20:17:43.209587 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.209553    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"]
Jul 20 20:17:43.210082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.209996    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae73549-1127-424c-855c-c62e38c99962" containerName="manager"
Jul 20 20:17:43.210082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.210012    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae73549-1127-424c-855c-c62e38c99962" containerName="manager"
Jul 20 20:17:43.210082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.210035    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3fa6edb-a095-4712-9098-6695c99e65e8" containerName="cleanup"
Jul 20 20:17:43.210082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.210041    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3fa6edb-a095-4712-9098-6695c99e65e8" containerName="cleanup"
Jul 20 20:17:43.210253 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.210107    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae73549-1127-424c-855c-c62e38c99962" containerName="manager"
Jul 20 20:17:43.210253 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.210118    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3fa6edb-a095-4712-9098-6695c99e65e8" containerName="cleanup"
Jul 20 20:17:43.214458 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.214440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.216703 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.216682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mnwvs\""
Jul 20 20:17:43.223978 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.223958    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"]
Jul 20 20:17:43.258094 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.258064    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8240795-0663-42d7-b277-becfe3ecad8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-45pbc\" (UID: \"c8240795-0663-42d7-b277-becfe3ecad8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.258094 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.258094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wgt5\" (UniqueName: \"kubernetes.io/projected/c8240795-0663-42d7-b277-becfe3ecad8e-kube-api-access-2wgt5\") pod \"kuadrant-operator-controller-manager-86878c769f-45pbc\" (UID: \"c8240795-0663-42d7-b277-becfe3ecad8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.358811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.358773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8240795-0663-42d7-b277-becfe3ecad8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-45pbc\" (UID: \"c8240795-0663-42d7-b277-becfe3ecad8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.358811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.358810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wgt5\" (UniqueName: \"kubernetes.io/projected/c8240795-0663-42d7-b277-becfe3ecad8e-kube-api-access-2wgt5\") pod \"kuadrant-operator-controller-manager-86878c769f-45pbc\" (UID: \"c8240795-0663-42d7-b277-becfe3ecad8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.359152 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.359130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8240795-0663-42d7-b277-becfe3ecad8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-45pbc\" (UID: \"c8240795-0663-42d7-b277-becfe3ecad8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.370230 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.370203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wgt5\" (UniqueName: \"kubernetes.io/projected/c8240795-0663-42d7-b277-becfe3ecad8e-kube-api-access-2wgt5\") pod \"kuadrant-operator-controller-manager-86878c769f-45pbc\" (UID: \"c8240795-0663-42d7-b277-becfe3ecad8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.525077 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.524988    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:43.694245 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:43.694221    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"]
Jul 20 20:17:43.697142 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:17:43.697114    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8240795_0663_42d7_b277_becfe3ecad8e.slice/crio-7b59fbc2006b30e8b21272d125b8f9eb569494379183bdd7fddbaaa9efac4998 WatchSource:0}: Error finding container 7b59fbc2006b30e8b21272d125b8f9eb569494379183bdd7fddbaaa9efac4998: Status 404 returned error can't find the container with id 7b59fbc2006b30e8b21272d125b8f9eb569494379183bdd7fddbaaa9efac4998
Jul 20 20:17:44.682318 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:44.682281    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc" event={"ID":"c8240795-0663-42d7-b277-becfe3ecad8e","Type":"ContainerStarted","Data":"b76d4ddecd508c33fcd4f2093563b81cfee61b1e6624bc50322f60e2e5bea574"}
Jul 20 20:17:44.682776 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:44.682334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc" event={"ID":"c8240795-0663-42d7-b277-becfe3ecad8e","Type":"ContainerStarted","Data":"7b59fbc2006b30e8b21272d125b8f9eb569494379183bdd7fddbaaa9efac4998"}
Jul 20 20:17:44.682776 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:44.682454    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:17:44.709931 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:44.709880    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc" podStartSLOduration=1.7098648060000001 podStartE2EDuration="1.709864806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:17:44.707990994 +0000 UTC m=+1289.291221880" watchObservedRunningTime="2026-07-20 20:17:44.709864806 +0000 UTC m=+1289.293095695"
Jul 20 20:17:55.690688 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:17:55.690656    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45pbc"
Jul 20 20:21:16.789620 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:21:16.789586    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:21:16.801663 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:21:16.801635    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:25:11.133009 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.132973    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"]
Jul 20 20:25:11.136810 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.136788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.139296 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.139273    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:25:11.139963 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.139944    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8d5e1ae9-serving-cert\""
Jul 20 20:25:11.163168 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.163132    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"]
Jul 20 20:25:11.214985 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.214948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2bdq\" (UniqueName: \"kubernetes.io/projected/399642ba-58d0-478a-b86f-7a0953191b1f-kube-api-access-z2bdq\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.215189 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.215005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399642ba-58d0-478a-b86f-7a0953191b1f-maas-api-tls\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.215189 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.215061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399642ba-58d0-478a-b86f-7a0953191b1f-openshift-service-ca\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.315888 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.315851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2bdq\" (UniqueName: \"kubernetes.io/projected/399642ba-58d0-478a-b86f-7a0953191b1f-kube-api-access-z2bdq\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.316084 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.315911    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399642ba-58d0-478a-b86f-7a0953191b1f-maas-api-tls\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.316084 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.315971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399642ba-58d0-478a-b86f-7a0953191b1f-openshift-service-ca\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.316718 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.316682    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399642ba-58d0-478a-b86f-7a0953191b1f-openshift-service-ca\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.318306 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.318285    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399642ba-58d0-478a-b86f-7a0953191b1f-maas-api-tls\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.330775 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.330751    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2bdq\" (UniqueName: \"kubernetes.io/projected/399642ba-58d0-478a-b86f-7a0953191b1f-kube-api-access-z2bdq\") pod \"maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.448065 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.447972    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:11.612658 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.612620    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"]
Jul 20 20:25:11.614493 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:25:11.614454    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399642ba_58d0_478a_b86f_7a0953191b1f.slice/crio-43d223a7a05f9094685229f3a5eb69dbef60f871e82b47c4425d879818fd7a6b WatchSource:0}: Error finding container 43d223a7a05f9094685229f3a5eb69dbef60f871e82b47c4425d879818fd7a6b: Status 404 returned error can't find the container with id 43d223a7a05f9094685229f3a5eb69dbef60f871e82b47c4425d879818fd7a6b
Jul 20 20:25:11.616118 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:11.616099    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:25:12.262845 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:12.262809    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r" event={"ID":"399642ba-58d0-478a-b86f-7a0953191b1f","Type":"ContainerStarted","Data":"43d223a7a05f9094685229f3a5eb69dbef60f871e82b47c4425d879818fd7a6b"}
Jul 20 20:25:13.269898 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:13.269860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r" event={"ID":"399642ba-58d0-478a-b86f-7a0953191b1f","Type":"ContainerStarted","Data":"58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e"}
Jul 20 20:25:13.270344 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:13.270038    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:13.294227 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:13.294166    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r" podStartSLOduration=1.6322101180000002 podStartE2EDuration="2.294149348s" totalImagesPullingTime="661.93923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:25:13.291386481 +0000 UTC m=+1737.874617369" watchObservedRunningTime="2026-07-20 20:25:13.294149348 +0000 UTC m=+1737.877380281"
Jul 20 20:25:19.281882 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:19.281848    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:47.030060 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.030015    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"]
Jul 20 20:25:47.030671 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.030305    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r" podUID="399642ba-58d0-478a-b86f-7a0953191b1f" containerName="maas-api" containerID="cri-o://58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e" gracePeriod=30
Jul 20 20:25:47.296062 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.295991    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:47.366122 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.366083    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2bdq\" (UniqueName: \"kubernetes.io/projected/399642ba-58d0-478a-b86f-7a0953191b1f-kube-api-access-z2bdq\") pod \"399642ba-58d0-478a-b86f-7a0953191b1f\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") "
Jul 20 20:25:47.366327 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.366197    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399642ba-58d0-478a-b86f-7a0953191b1f-maas-api-tls\") pod \"399642ba-58d0-478a-b86f-7a0953191b1f\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") "
Jul 20 20:25:47.366402 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.366357    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399642ba-58d0-478a-b86f-7a0953191b1f-openshift-service-ca\") pod \"399642ba-58d0-478a-b86f-7a0953191b1f\" (UID: \"399642ba-58d0-478a-b86f-7a0953191b1f\") "
Jul 20 20:25:47.366717 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.366690    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/399642ba-58d0-478a-b86f-7a0953191b1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "399642ba-58d0-478a-b86f-7a0953191b1f" (UID: "399642ba-58d0-478a-b86f-7a0953191b1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:25:47.368488 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.368463    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/399642ba-58d0-478a-b86f-7a0953191b1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "399642ba-58d0-478a-b86f-7a0953191b1f" (UID: "399642ba-58d0-478a-b86f-7a0953191b1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:25:47.368576 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.368460    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399642ba-58d0-478a-b86f-7a0953191b1f-kube-api-access-z2bdq" (OuterVolumeSpecName: "kube-api-access-z2bdq") pod "399642ba-58d0-478a-b86f-7a0953191b1f" (UID: "399642ba-58d0-478a-b86f-7a0953191b1f"). InnerVolumeSpecName "kube-api-access-z2bdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:25:47.467855 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.467823    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399642ba-58d0-478a-b86f-7a0953191b1f-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:25:47.467855 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.467848    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2bdq\" (UniqueName: \"kubernetes.io/projected/399642ba-58d0-478a-b86f-7a0953191b1f-kube-api-access-z2bdq\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:25:47.467855 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.467858    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399642ba-58d0-478a-b86f-7a0953191b1f-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:25:47.475283 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.475245    2572 generic.go:356] "Generic (PLEG): container finished" podID="399642ba-58d0-478a-b86f-7a0953191b1f" containerID="58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e" exitCode=0
Jul 20 20:25:47.475495 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.475309    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"
Jul 20 20:25:47.475495 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.475325    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r" event={"ID":"399642ba-58d0-478a-b86f-7a0953191b1f","Type":"ContainerDied","Data":"58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e"}
Jul 20 20:25:47.475495 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.475391    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r" event={"ID":"399642ba-58d0-478a-b86f-7a0953191b1f","Type":"ContainerDied","Data":"43d223a7a05f9094685229f3a5eb69dbef60f871e82b47c4425d879818fd7a6b"}
Jul 20 20:25:47.475495 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.475423    2572 scope.go:117] "RemoveContainer" containerID="58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e"
Jul 20 20:25:47.486326 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.486299    2572 scope.go:117] "RemoveContainer" containerID="58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e"
Jul 20 20:25:47.486649 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:25:47.486630    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e\": container with ID starting with 58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e not found: ID does not exist" containerID="58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e"
Jul 20 20:25:47.486692 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.486666    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e"} err="failed to get container status \"58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e\": rpc error: code = NotFound desc = could not find container \"58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e\": container with ID starting with 58fccd7f5ae0350b0bf7a973c08659be55e7587cd4a8c5ddb66ec37e493e381e not found: ID does not exist"
Jul 20 20:25:47.498951 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.498923    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"]
Jul 20 20:25:47.502137 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:47.502112    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d5e1ae9-66c4cdb88d-4f75r"]
Jul 20 20:25:48.725448 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:48.725398    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="399642ba-58d0-478a-b86f-7a0953191b1f" path="/var/lib/kubelet/pods/399642ba-58d0-478a-b86f-7a0953191b1f/volumes"
Jul 20 20:25:55.458197 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.458159    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"]
Jul 20 20:25:55.458619 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.458609    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="399642ba-58d0-478a-b86f-7a0953191b1f" containerName="maas-api"
Jul 20 20:25:55.458663 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.458622    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="399642ba-58d0-478a-b86f-7a0953191b1f" containerName="maas-api"
Jul 20 20:25:55.458712 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.458703    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="399642ba-58d0-478a-b86f-7a0953191b1f" containerName="maas-api"
Jul 20 20:25:55.462321 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.462300    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.464603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.464584    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-03a646a1-serving-cert\""
Jul 20 20:25:55.465399 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.465365    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:25:55.478688 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.478659    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"]
Jul 20 20:25:55.543166 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.543124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f4c5\" (UniqueName: \"kubernetes.io/projected/f641c882-bbf7-44a6-845e-710b2d04dad2-kube-api-access-7f4c5\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.543360 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.543273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f641c882-bbf7-44a6-845e-710b2d04dad2-openshift-service-ca\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.543360 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.543321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.644003 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.643961    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f641c882-bbf7-44a6-845e-710b2d04dad2-openshift-service-ca\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.644003 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.644009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.644228 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.644037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f4c5\" (UniqueName: \"kubernetes.io/projected/f641c882-bbf7-44a6-845e-710b2d04dad2-kube-api-access-7f4c5\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.644228 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:25:55.644162    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-serving-cert: secret "maas-api-e2e-migrate-03a646a1-serving-cert" not found
Jul 20 20:25:55.644302 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:25:55.644242    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls podName:f641c882-bbf7-44a6-845e-710b2d04dad2 nodeName:}" failed. No retries permitted until 2026-07-20 20:25:56.144224587 +0000 UTC m=+1780.727455460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls") pod "maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" (UID: "f641c882-bbf7-44a6-845e-710b2d04dad2") : secret "maas-api-e2e-migrate-03a646a1-serving-cert" not found
Jul 20 20:25:55.644624 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.644604    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f641c882-bbf7-44a6-845e-710b2d04dad2-openshift-service-ca\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:55.661308 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:55.661280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f4c5\" (UniqueName: \"kubernetes.io/projected/f641c882-bbf7-44a6-845e-710b2d04dad2-kube-api-access-7f4c5\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:56.149315 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:56.149277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:56.149533 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:25:56.149462    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-serving-cert: secret "maas-api-e2e-migrate-03a646a1-serving-cert" not found
Jul 20 20:25:56.149597 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:25:56.149543    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls podName:f641c882-bbf7-44a6-845e-710b2d04dad2 nodeName:}" failed. No retries permitted until 2026-07-20 20:25:57.149527374 +0000 UTC m=+1781.732758245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls") pod "maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" (UID: "f641c882-bbf7-44a6-845e-710b2d04dad2") : secret "maas-api-e2e-migrate-03a646a1-serving-cert" not found
Jul 20 20:25:57.159239 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:57.159197    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:57.161634 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:57.161612    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") pod \"maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:57.272950 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:57.272908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:57.436884 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:57.436856    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"]
Jul 20 20:25:57.438984 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:25:57.438955    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf641c882_bbf7_44a6_845e_710b2d04dad2.slice/crio-1515b47b74198a707550f2c1d04ab3ca2e73372f8cf8b15ed65f270fb889197e WatchSource:0}: Error finding container 1515b47b74198a707550f2c1d04ab3ca2e73372f8cf8b15ed65f270fb889197e: Status 404 returned error can't find the container with id 1515b47b74198a707550f2c1d04ab3ca2e73372f8cf8b15ed65f270fb889197e
Jul 20 20:25:57.535108 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:57.535071    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" event={"ID":"f641c882-bbf7-44a6-845e-710b2d04dad2","Type":"ContainerStarted","Data":"1515b47b74198a707550f2c1d04ab3ca2e73372f8cf8b15ed65f270fb889197e"}
Jul 20 20:25:58.543376 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:58.543330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" event={"ID":"f641c882-bbf7-44a6-845e-710b2d04dad2","Type":"ContainerStarted","Data":"d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9"}
Jul 20 20:25:58.543823 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:58.543420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:25:58.563682 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:25:58.563623    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" podStartSLOduration=3.159466616 podStartE2EDuration="3.563599612s" totalImagesPullingTime="404.132996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:25:58.560865518 +0000 UTC m=+1783.144096401" watchObservedRunningTime="2026-07-20 20:25:58.563599612 +0000 UTC m=+1783.146830500"
Jul 20 20:26:04.554983 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:04.554952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:26:16.829243 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:16.829198    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:26:16.855778 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:16.855751    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:26:31.146157 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.146122    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"]
Jul 20 20:26:31.146673 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.146341    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" podUID="f641c882-bbf7-44a6-845e-710b2d04dad2" containerName="maas-api" containerID="cri-o://d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9" gracePeriod=30
Jul 20 20:26:31.407013 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.406950    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:26:31.488789 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.488756    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f4c5\" (UniqueName: \"kubernetes.io/projected/f641c882-bbf7-44a6-845e-710b2d04dad2-kube-api-access-7f4c5\") pod \"f641c882-bbf7-44a6-845e-710b2d04dad2\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") "
Jul 20 20:26:31.488954 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.488806    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") pod \"f641c882-bbf7-44a6-845e-710b2d04dad2\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") "
Jul 20 20:26:31.488954 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.488862    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f641c882-bbf7-44a6-845e-710b2d04dad2-openshift-service-ca\") pod \"f641c882-bbf7-44a6-845e-710b2d04dad2\" (UID: \"f641c882-bbf7-44a6-845e-710b2d04dad2\") "
Jul 20 20:26:31.489253 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.489226    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f641c882-bbf7-44a6-845e-710b2d04dad2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f641c882-bbf7-44a6-845e-710b2d04dad2" (UID: "f641c882-bbf7-44a6-845e-710b2d04dad2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:26:31.490871 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.490838    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f641c882-bbf7-44a6-845e-710b2d04dad2" (UID: "f641c882-bbf7-44a6-845e-710b2d04dad2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:26:31.490970 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.490887    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f641c882-bbf7-44a6-845e-710b2d04dad2-kube-api-access-7f4c5" (OuterVolumeSpecName: "kube-api-access-7f4c5") pod "f641c882-bbf7-44a6-845e-710b2d04dad2" (UID: "f641c882-bbf7-44a6-845e-710b2d04dad2"). InnerVolumeSpecName "kube-api-access-7f4c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:26:31.589603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.589562    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f641c882-bbf7-44a6-845e-710b2d04dad2-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:26:31.589603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.589593    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f4c5\" (UniqueName: \"kubernetes.io/projected/f641c882-bbf7-44a6-845e-710b2d04dad2-kube-api-access-7f4c5\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:26:31.589603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.589603    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f641c882-bbf7-44a6-845e-710b2d04dad2-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:26:31.740967 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.740878    2572 generic.go:356] "Generic (PLEG): container finished" podID="f641c882-bbf7-44a6-845e-710b2d04dad2" containerID="d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9" exitCode=0
Jul 20 20:26:31.740967 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.740919    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"
Jul 20 20:26:31.740967 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.740961    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" event={"ID":"f641c882-bbf7-44a6-845e-710b2d04dad2","Type":"ContainerDied","Data":"d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9"}
Jul 20 20:26:31.741191 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.741010    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5" event={"ID":"f641c882-bbf7-44a6-845e-710b2d04dad2","Type":"ContainerDied","Data":"1515b47b74198a707550f2c1d04ab3ca2e73372f8cf8b15ed65f270fb889197e"}
Jul 20 20:26:31.741191 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.741032    2572 scope.go:117] "RemoveContainer" containerID="d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9"
Jul 20 20:26:31.750138 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.750121    2572 scope.go:117] "RemoveContainer" containerID="d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9"
Jul 20 20:26:31.750365 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:26:31.750346    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9\": container with ID starting with d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9 not found: ID does not exist" containerID="d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9"
Jul 20 20:26:31.750414 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.750374    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9"} err="failed to get container status \"d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9\": rpc error: code = NotFound desc = could not find container \"d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9\": container with ID starting with d55bd6c2c8f326dc48a926a8028ae79e8036747a787c5106e6713de6a0df26a9 not found: ID does not exist"
Jul 20 20:26:31.767497 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.767471    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"]
Jul 20 20:26:31.778471 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:31.778450    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-03a646a1-544dbf9dd7-s7mh5"]
Jul 20 20:26:32.725506 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:32.725472    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f641c882-bbf7-44a6-845e-710b2d04dad2" path="/var/lib/kubelet/pods/f641c882-bbf7-44a6-845e-710b2d04dad2/volumes"
Jul 20 20:26:42.068429 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.068398    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"]
Jul 20 20:26:42.068865 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.068839    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f641c882-bbf7-44a6-845e-710b2d04dad2" containerName="maas-api"
Jul 20 20:26:42.068865 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.068850    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f641c882-bbf7-44a6-845e-710b2d04dad2" containerName="maas-api"
Jul 20 20:26:42.068953 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.068934    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f641c882-bbf7-44a6-845e-710b2d04dad2" containerName="maas-api"
Jul 20 20:26:42.072331 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.072312    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.075950 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.075928    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-47f7982b-serving-cert\""
Jul 20 20:26:42.075950 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.075945    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:26:42.103745 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.103692    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"]
Jul 20 20:26:42.178080 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.178040    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvhk\" (UniqueName: \"kubernetes.io/projected/e14670bc-f016-4074-a85f-0314d6d9982f-kube-api-access-kpvhk\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.178080 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.178089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e14670bc-f016-4074-a85f-0314d6d9982f-openshift-service-ca\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.178338 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.178249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e14670bc-f016-4074-a85f-0314d6d9982f-maas-api-tls\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.278866 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.278828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvhk\" (UniqueName: \"kubernetes.io/projected/e14670bc-f016-4074-a85f-0314d6d9982f-kube-api-access-kpvhk\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.278866 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.278870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e14670bc-f016-4074-a85f-0314d6d9982f-openshift-service-ca\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.279124 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.278933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e14670bc-f016-4074-a85f-0314d6d9982f-maas-api-tls\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.279633 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.279606    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e14670bc-f016-4074-a85f-0314d6d9982f-openshift-service-ca\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.281300 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.281283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e14670bc-f016-4074-a85f-0314d6d9982f-maas-api-tls\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.296576 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.296549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvhk\" (UniqueName: \"kubernetes.io/projected/e14670bc-f016-4074-a85f-0314d6d9982f-kube-api-access-kpvhk\") pod \"maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.382252 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.382212    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:42.527563 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.527538    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"]
Jul 20 20:26:42.529648 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:26:42.529622    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14670bc_f016_4074_a85f_0314d6d9982f.slice/crio-664204d343c135160951f2a24d02bc7783a67f625c2bbaa27f76ac34d7f80d3c WatchSource:0}: Error finding container 664204d343c135160951f2a24d02bc7783a67f625c2bbaa27f76ac34d7f80d3c: Status 404 returned error can't find the container with id 664204d343c135160951f2a24d02bc7783a67f625c2bbaa27f76ac34d7f80d3c
Jul 20 20:26:42.805538 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:42.805452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76" event={"ID":"e14670bc-f016-4074-a85f-0314d6d9982f","Type":"ContainerStarted","Data":"664204d343c135160951f2a24d02bc7783a67f625c2bbaa27f76ac34d7f80d3c"}
Jul 20 20:26:43.812367 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:43.812329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76" event={"ID":"e14670bc-f016-4074-a85f-0314d6d9982f","Type":"ContainerStarted","Data":"afe6df05cac06a01221bfdcf237f502d5ab7ff36e84cb7ae7fa08c6a70a2174d"}
Jul 20 20:26:43.812819 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:43.812482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:26:43.837997 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:43.837949    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76" podStartSLOduration=1.438405574 podStartE2EDuration="1.83793394s" totalImagesPullingTime="399.528366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:26:43.834940772 +0000 UTC m=+1828.418171659" watchObservedRunningTime="2026-07-20 20:26:43.83793394 +0000 UTC m=+1828.421164828"
Jul 20 20:26:49.822544 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:26:49.822516    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:27:18.804801 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:18.804768    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"]
Jul 20 20:27:18.805331 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:18.805031    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76" podUID="e14670bc-f016-4074-a85f-0314d6d9982f" containerName="maas-api" containerID="cri-o://afe6df05cac06a01221bfdcf237f502d5ab7ff36e84cb7ae7fa08c6a70a2174d" gracePeriod=30
Jul 20 20:27:19.013484 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.013454    2572 generic.go:356] "Generic (PLEG): container finished" podID="e14670bc-f016-4074-a85f-0314d6d9982f" containerID="afe6df05cac06a01221bfdcf237f502d5ab7ff36e84cb7ae7fa08c6a70a2174d" exitCode=0
Jul 20 20:27:19.013653 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.013516    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76" event={"ID":"e14670bc-f016-4074-a85f-0314d6d9982f","Type":"ContainerDied","Data":"afe6df05cac06a01221bfdcf237f502d5ab7ff36e84cb7ae7fa08c6a70a2174d"}
Jul 20 20:27:19.065267 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.065208    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:27:19.114968 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.114931    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e14670bc-f016-4074-a85f-0314d6d9982f-openshift-service-ca\") pod \"e14670bc-f016-4074-a85f-0314d6d9982f\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") "
Jul 20 20:27:19.115156 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.114988    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e14670bc-f016-4074-a85f-0314d6d9982f-maas-api-tls\") pod \"e14670bc-f016-4074-a85f-0314d6d9982f\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") "
Jul 20 20:27:19.115156 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.115021    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpvhk\" (UniqueName: \"kubernetes.io/projected/e14670bc-f016-4074-a85f-0314d6d9982f-kube-api-access-kpvhk\") pod \"e14670bc-f016-4074-a85f-0314d6d9982f\" (UID: \"e14670bc-f016-4074-a85f-0314d6d9982f\") "
Jul 20 20:27:19.115395 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.115364    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14670bc-f016-4074-a85f-0314d6d9982f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e14670bc-f016-4074-a85f-0314d6d9982f" (UID: "e14670bc-f016-4074-a85f-0314d6d9982f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:27:19.117123 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.117096    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e14670bc-f016-4074-a85f-0314d6d9982f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e14670bc-f016-4074-a85f-0314d6d9982f" (UID: "e14670bc-f016-4074-a85f-0314d6d9982f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:27:19.117123 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.117108    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14670bc-f016-4074-a85f-0314d6d9982f-kube-api-access-kpvhk" (OuterVolumeSpecName: "kube-api-access-kpvhk") pod "e14670bc-f016-4074-a85f-0314d6d9982f" (UID: "e14670bc-f016-4074-a85f-0314d6d9982f"). InnerVolumeSpecName "kube-api-access-kpvhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:27:19.216206 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.216169    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e14670bc-f016-4074-a85f-0314d6d9982f-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:27:19.216206 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.216199    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e14670bc-f016-4074-a85f-0314d6d9982f-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:27:19.216206 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:19.216208    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpvhk\" (UniqueName: \"kubernetes.io/projected/e14670bc-f016-4074-a85f-0314d6d9982f-kube-api-access-kpvhk\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:27:20.020804 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:20.020772    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"
Jul 20 20:27:20.020804 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:20.020786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76" event={"ID":"e14670bc-f016-4074-a85f-0314d6d9982f","Type":"ContainerDied","Data":"664204d343c135160951f2a24d02bc7783a67f625c2bbaa27f76ac34d7f80d3c"}
Jul 20 20:27:20.021353 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:20.020861    2572 scope.go:117] "RemoveContainer" containerID="afe6df05cac06a01221bfdcf237f502d5ab7ff36e84cb7ae7fa08c6a70a2174d"
Jul 20 20:27:20.044416 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:20.044392    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"]
Jul 20 20:27:20.048955 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:20.048936    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-47f7982b-57bdd79cbf-v9r76"]
Jul 20 20:27:20.724875 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:20.724842    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14670bc-f016-4074-a85f-0314d6d9982f" path="/var/lib/kubelet/pods/e14670bc-f016-4074-a85f-0314d6d9982f/volumes"
Jul 20 20:27:27.311628 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.311590    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"]
Jul 20 20:27:27.312096 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.312078    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14670bc-f016-4074-a85f-0314d6d9982f" containerName="maas-api"
Jul 20 20:27:27.312151 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.312098    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14670bc-f016-4074-a85f-0314d6d9982f" containerName="maas-api"
Jul 20 20:27:27.312187 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.312173    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14670bc-f016-4074-a85f-0314d6d9982f" containerName="maas-api"
Jul 20 20:27:27.316648 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.316610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.320638 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.320617    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-aeaf4876-serving-cert\""
Jul 20 20:27:27.321091 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.321073    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:27:27.336053 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.336029    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"]
Jul 20 20:27:27.385794 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.385758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4znth\" (UniqueName: \"kubernetes.io/projected/a4345651-2211-4bb4-a636-f8d9b6d64eb9-kube-api-access-4znth\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.385981 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.385867    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.385981 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.385891    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4345651-2211-4bb4-a636-f8d9b6d64eb9-openshift-service-ca\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.486880 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.486845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.487056 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.486886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4345651-2211-4bb4-a636-f8d9b6d64eb9-openshift-service-ca\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.487056 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.486924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4znth\" (UniqueName: \"kubernetes.io/projected/a4345651-2211-4bb4-a636-f8d9b6d64eb9-kube-api-access-4znth\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.487056 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:27:27.486990    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-serving-cert: secret "maas-api-e2e-derive-aeaf4876-serving-cert" not found
Jul 20 20:27:27.487177 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:27:27.487071    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls podName:a4345651-2211-4bb4-a636-f8d9b6d64eb9 nodeName:}" failed. No retries permitted until 2026-07-20 20:27:27.987055189 +0000 UTC m=+1872.570286055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls") pod "maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" (UID: "a4345651-2211-4bb4-a636-f8d9b6d64eb9") : secret "maas-api-e2e-derive-aeaf4876-serving-cert" not found
Jul 20 20:27:27.487568 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.487549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4345651-2211-4bb4-a636-f8d9b6d64eb9-openshift-service-ca\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.514645 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.514616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4znth\" (UniqueName: \"kubernetes.io/projected/a4345651-2211-4bb4-a636-f8d9b6d64eb9-kube-api-access-4znth\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.990955 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.990922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:27.993361 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:27.993331    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls\") pod \"maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:28.227440 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:28.227402    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:28.378559 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:28.378519    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"]
Jul 20 20:27:28.379167 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:27:28.379141    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4345651_2211_4bb4_a636_f8d9b6d64eb9.slice/crio-1f94d680cbb93662165c77737933ec2f096c9cc19b3e3ea3ad37a1c6f62eb2cb WatchSource:0}: Error finding container 1f94d680cbb93662165c77737933ec2f096c9cc19b3e3ea3ad37a1c6f62eb2cb: Status 404 returned error can't find the container with id 1f94d680cbb93662165c77737933ec2f096c9cc19b3e3ea3ad37a1c6f62eb2cb
Jul 20 20:27:29.071626 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:29.071526    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" event={"ID":"a4345651-2211-4bb4-a636-f8d9b6d64eb9","Type":"ContainerStarted","Data":"cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b"}
Jul 20 20:27:29.071626 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:29.071591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" event={"ID":"a4345651-2211-4bb4-a636-f8d9b6d64eb9","Type":"ContainerStarted","Data":"1f94d680cbb93662165c77737933ec2f096c9cc19b3e3ea3ad37a1c6f62eb2cb"}
Jul 20 20:27:29.071891 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:29.071629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:27:29.094822 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:29.094768    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" podStartSLOduration=1.6982044859999998 podStartE2EDuration="2.094752675s" totalImagesPullingTime="396.548189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:27:29.092623605 +0000 UTC m=+1873.675854492" watchObservedRunningTime="2026-07-20 20:27:29.094752675 +0000 UTC m=+1873.677983888"
Jul 20 20:27:35.083966 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:27:35.083928    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:28:02.621619 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.621577    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"]
Jul 20 20:28:02.622206 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.621851    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" podUID="a4345651-2211-4bb4-a636-f8d9b6d64eb9" containerName="maas-api" containerID="cri-o://cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b" gracePeriod=30
Jul 20 20:28:02.875642 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.875581    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:28:02.998257 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.998222    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4345651-2211-4bb4-a636-f8d9b6d64eb9-openshift-service-ca\") pod \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") "
Jul 20 20:28:02.998257 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.998267    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4znth\" (UniqueName: \"kubernetes.io/projected/a4345651-2211-4bb4-a636-f8d9b6d64eb9-kube-api-access-4znth\") pod \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") "
Jul 20 20:28:02.998508 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.998308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls\") pod \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\" (UID: \"a4345651-2211-4bb4-a636-f8d9b6d64eb9\") "
Jul 20 20:28:02.998589 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:02.998566    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4345651-2211-4bb4-a636-f8d9b6d64eb9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4345651-2211-4bb4-a636-f8d9b6d64eb9" (UID: "a4345651-2211-4bb4-a636-f8d9b6d64eb9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:28:03.000370 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.000342    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4345651-2211-4bb4-a636-f8d9b6d64eb9" (UID: "a4345651-2211-4bb4-a636-f8d9b6d64eb9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:28:03.000495 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.000420    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4345651-2211-4bb4-a636-f8d9b6d64eb9-kube-api-access-4znth" (OuterVolumeSpecName: "kube-api-access-4znth") pod "a4345651-2211-4bb4-a636-f8d9b6d64eb9" (UID: "a4345651-2211-4bb4-a636-f8d9b6d64eb9"). InnerVolumeSpecName "kube-api-access-4znth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:28:03.099433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.099402    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4345651-2211-4bb4-a636-f8d9b6d64eb9-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:28:03.099433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.099431    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4znth\" (UniqueName: \"kubernetes.io/projected/a4345651-2211-4bb4-a636-f8d9b6d64eb9-kube-api-access-4znth\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:28:03.099634 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.099441    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4345651-2211-4bb4-a636-f8d9b6d64eb9-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:28:03.277292 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.277213    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4345651-2211-4bb4-a636-f8d9b6d64eb9" containerID="cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b" exitCode=0
Jul 20 20:28:03.277292 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.277270    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"
Jul 20 20:28:03.277477 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.277294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" event={"ID":"a4345651-2211-4bb4-a636-f8d9b6d64eb9","Type":"ContainerDied","Data":"cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b"}
Jul 20 20:28:03.277477 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.277352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6" event={"ID":"a4345651-2211-4bb4-a636-f8d9b6d64eb9","Type":"ContainerDied","Data":"1f94d680cbb93662165c77737933ec2f096c9cc19b3e3ea3ad37a1c6f62eb2cb"}
Jul 20 20:28:03.277477 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.277378    2572 scope.go:117] "RemoveContainer" containerID="cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b"
Jul 20 20:28:03.287279 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.287263    2572 scope.go:117] "RemoveContainer" containerID="cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b"
Jul 20 20:28:03.287579 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:28:03.287556    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b\": container with ID starting with cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b not found: ID does not exist" containerID="cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b"
Jul 20 20:28:03.287646 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.287595    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b"} err="failed to get container status \"cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b\": rpc error: code = NotFound desc = could not find container \"cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b\": container with ID starting with cc474076dcb39d0aaee51c1d2c46f57560e2910624b9d48b597b350534c6f45b not found: ID does not exist"
Jul 20 20:28:03.302945 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.302924    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"]
Jul 20 20:28:03.308225 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:03.308203    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aeaf4876-6bf5b7d9cf-9cfk6"]
Jul 20 20:28:04.725493 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:28:04.725460    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4345651-2211-4bb4-a636-f8d9b6d64eb9" path="/var/lib/kubelet/pods/a4345651-2211-4bb4-a636-f8d9b6d64eb9/volumes"
Jul 20 20:29:55.539814 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.539775    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"]
Jul 20 20:29:55.540530 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.540507    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4345651-2211-4bb4-a636-f8d9b6d64eb9" containerName="maas-api"
Jul 20 20:29:55.540577 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.540535    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4345651-2211-4bb4-a636-f8d9b6d64eb9" containerName="maas-api"
Jul 20 20:29:55.540652 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.540639    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4345651-2211-4bb4-a636-f8d9b6d64eb9" containerName="maas-api"
Jul 20 20:29:55.544318 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.544299    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.550827 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.550684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-573f276e-serving-cert\""
Jul 20 20:29:55.550920 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.550860    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:29:55.559086 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.559062    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"]
Jul 20 20:29:55.690119 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.690085    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-openshift-service-ca\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.690282 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.690126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-maas-api-tls\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.690282 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.690214    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lprmc\" (UniqueName: \"kubernetes.io/projected/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-kube-api-access-lprmc\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.791631 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.791545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lprmc\" (UniqueName: \"kubernetes.io/projected/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-kube-api-access-lprmc\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.791631 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.791595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-openshift-service-ca\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.791631 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.791624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-maas-api-tls\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.792208 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.792189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-openshift-service-ca\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.793973 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.793951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-maas-api-tls\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.812446 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.812422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lprmc\" (UniqueName: \"kubernetes.io/projected/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-kube-api-access-lprmc\") pod \"maas-api-e2e-mt-573f276e-5644958c98-lvhjd\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:55.854319 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:55.854292    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:56.215040 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:56.215013    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"]
Jul 20 20:29:56.217831 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:29:56.217802    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a65546_ef8f_403b_ad84_6f3a5bf84ddf.slice/crio-416b3703a4b08b249f2d87533da8baab1b60bfad24799d2438d19131e29df4d6 WatchSource:0}: Error finding container 416b3703a4b08b249f2d87533da8baab1b60bfad24799d2438d19131e29df4d6: Status 404 returned error can't find the container with id 416b3703a4b08b249f2d87533da8baab1b60bfad24799d2438d19131e29df4d6
Jul 20 20:29:56.927436 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:56.927402    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd" event={"ID":"77a65546-ef8f-403b-ad84-6f3a5bf84ddf","Type":"ContainerStarted","Data":"7fc35c51106d91c65e0b9619edff33fe30a3b350156a50366fc3d7b233955284"}
Jul 20 20:29:56.927908 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:56.927462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd" event={"ID":"77a65546-ef8f-403b-ad84-6f3a5bf84ddf","Type":"ContainerStarted","Data":"416b3703a4b08b249f2d87533da8baab1b60bfad24799d2438d19131e29df4d6"}
Jul 20 20:29:56.927908 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:56.927536    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:29:56.969572 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:29:56.969475    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd" podStartSLOduration=1.496242602 podStartE2EDuration="1.969460726s" totalImagesPullingTime="473.218124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:29:56.966094212 +0000 UTC m=+2021.549325099" watchObservedRunningTime="2026-07-20 20:29:56.969460726 +0000 UTC m=+2021.552691624"
Jul 20 20:30:02.938710 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:02.938678    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:30:18.851139 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:18.851099    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"]
Jul 20 20:30:18.853782 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:18.851385    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd" podUID="77a65546-ef8f-403b-ad84-6f3a5bf84ddf" containerName="maas-api" containerID="cri-o://7fc35c51106d91c65e0b9619edff33fe30a3b350156a50366fc3d7b233955284" gracePeriod=30
Jul 20 20:30:19.055561 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.055522    2572 generic.go:356] "Generic (PLEG): container finished" podID="77a65546-ef8f-403b-ad84-6f3a5bf84ddf" containerID="7fc35c51106d91c65e0b9619edff33fe30a3b350156a50366fc3d7b233955284" exitCode=0
Jul 20 20:30:19.055761 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.055594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd" event={"ID":"77a65546-ef8f-403b-ad84-6f3a5bf84ddf","Type":"ContainerDied","Data":"7fc35c51106d91c65e0b9619edff33fe30a3b350156a50366fc3d7b233955284"}
Jul 20 20:30:19.109196 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.109125    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:30:19.189751 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.189692    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-openshift-service-ca\") pod \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") "
Jul 20 20:30:19.189940 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.189860    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-maas-api-tls\") pod \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") "
Jul 20 20:30:19.189940 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.189907    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lprmc\" (UniqueName: \"kubernetes.io/projected/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-kube-api-access-lprmc\") pod \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\" (UID: \"77a65546-ef8f-403b-ad84-6f3a5bf84ddf\") "
Jul 20 20:30:19.190052 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.190029    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77a65546-ef8f-403b-ad84-6f3a5bf84ddf" (UID: "77a65546-ef8f-403b-ad84-6f3a5bf84ddf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:30:19.190169 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.190154    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:30:19.191935 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.191900    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77a65546-ef8f-403b-ad84-6f3a5bf84ddf" (UID: "77a65546-ef8f-403b-ad84-6f3a5bf84ddf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:30:19.192038 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.191928    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-kube-api-access-lprmc" (OuterVolumeSpecName: "kube-api-access-lprmc") pod "77a65546-ef8f-403b-ad84-6f3a5bf84ddf" (UID: "77a65546-ef8f-403b-ad84-6f3a5bf84ddf"). InnerVolumeSpecName "kube-api-access-lprmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:30:19.290734 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.290697    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lprmc\" (UniqueName: \"kubernetes.io/projected/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-kube-api-access-lprmc\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:30:19.290884 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:19.290749    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a65546-ef8f-403b-ad84-6f3a5bf84ddf-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:30:20.069365 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:20.069336    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"
Jul 20 20:30:20.069793 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:20.069405    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd" event={"ID":"77a65546-ef8f-403b-ad84-6f3a5bf84ddf","Type":"ContainerDied","Data":"416b3703a4b08b249f2d87533da8baab1b60bfad24799d2438d19131e29df4d6"}
Jul 20 20:30:20.069793 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:20.069508    2572 scope.go:117] "RemoveContainer" containerID="7fc35c51106d91c65e0b9619edff33fe30a3b350156a50366fc3d7b233955284"
Jul 20 20:30:20.094623 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:20.094597    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"]
Jul 20 20:30:20.097397 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:20.097376    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-573f276e-5644958c98-lvhjd"]
Jul 20 20:30:20.726598 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:20.726565    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a65546-ef8f-403b-ad84-6f3a5bf84ddf" path="/var/lib/kubelet/pods/77a65546-ef8f-403b-ad84-6f3a5bf84ddf/volumes"
Jul 20 20:30:54.782333 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.782297    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"]
Jul 20 20:30:54.782847 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.782782    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a65546-ef8f-403b-ad84-6f3a5bf84ddf" containerName="maas-api"
Jul 20 20:30:54.782847 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.782797    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a65546-ef8f-403b-ad84-6f3a5bf84ddf" containerName="maas-api"
Jul 20 20:30:54.782922 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.782860    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a65546-ef8f-403b-ad84-6f3a5bf84ddf" containerName="maas-api"
Jul 20 20:30:54.786112 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.786093    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:54.789418 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.789397    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fa45191d-serving-cert\""
Jul 20 20:30:54.791233 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.791214    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:30:54.800993 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.800962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"]
Jul 20 20:30:54.914085 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.914050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fc5c\" (UniqueName: \"kubernetes.io/projected/756e7676-905f-4df9-af80-11e2848dde04-kube-api-access-9fc5c\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:54.914264 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.914162    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:54.914264 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:54.914194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/756e7676-905f-4df9-af80-11e2848dde04-openshift-service-ca\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.015674 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.015635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.015674 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.015681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/756e7676-905f-4df9-af80-11e2848dde04-openshift-service-ca\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.015931 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.015716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fc5c\" (UniqueName: \"kubernetes.io/projected/756e7676-905f-4df9-af80-11e2848dde04-kube-api-access-9fc5c\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.015931 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:30:55.015828    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-serving-cert: secret "maas-api-e2e-mt-fa45191d-serving-cert" not found
Jul 20 20:30:55.015931 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:30:55.015919    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls podName:756e7676-905f-4df9-af80-11e2848dde04 nodeName:}" failed. No retries permitted until 2026-07-20 20:30:55.515898428 +0000 UTC m=+2080.099129294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls") pod "maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" (UID: "756e7676-905f-4df9-af80-11e2848dde04") : secret "maas-api-e2e-mt-fa45191d-serving-cert" not found
Jul 20 20:30:55.016444 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.016428    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/756e7676-905f-4df9-af80-11e2848dde04-openshift-service-ca\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.037017 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.036944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fc5c\" (UniqueName: \"kubernetes.io/projected/756e7676-905f-4df9-af80-11e2848dde04-kube-api-access-9fc5c\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.519847 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.519807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.522262 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.522237    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls\") pod \"maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.698370 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.698330    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:55.862789 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.862683    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:30:55.869135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:55.868020    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"]
Jul 20 20:30:56.277042 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:56.277007    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" event={"ID":"756e7676-905f-4df9-af80-11e2848dde04","Type":"ContainerStarted","Data":"b800b8bd52cc60c72ffd98e6665d6796dedc29aa7cbf5a8e8de9c21d543ca3b7"}
Jul 20 20:30:57.284899 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:57.284862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" event={"ID":"756e7676-905f-4df9-af80-11e2848dde04","Type":"ContainerStarted","Data":"26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7"}
Jul 20 20:30:57.285371 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:57.285050    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:30:57.305158 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:30:57.305101    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" podStartSLOduration=2.900775789 podStartE2EDuration="3.305087018s" totalImagesPullingTime="404.311229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:30:57.301583652 +0000 UTC m=+2081.884814541" watchObservedRunningTime="2026-07-20 20:30:57.305087018 +0000 UTC m=+2081.888317905"
Jul 20 20:31:03.297593 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:03.297563    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:31:16.874160 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:16.874132    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:31:16.895986 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:16.895966    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:31:43.122197 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.122157    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"]
Jul 20 20:31:43.125977 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.125959    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:43.128328 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.128306    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-628hb\""
Jul 20 20:31:43.133828 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.133806    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"]
Jul 20 20:31:43.250939 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.250899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a77fbe8-927b-41bd-be95-36671d840d76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fa45191d-4x85b\" (UID: \"1a77fbe8-927b-41bd-be95-36671d840d76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:43.351777 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.351705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a77fbe8-927b-41bd-be95-36671d840d76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fa45191d-4x85b\" (UID: \"1a77fbe8-927b-41bd-be95-36671d840d76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:43.352368 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.352340    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a77fbe8-927b-41bd-be95-36671d840d76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fa45191d-4x85b\" (UID: \"1a77fbe8-927b-41bd-be95-36671d840d76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:43.438461 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.438383    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:43.576179 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:43.576153    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"]
Jul 20 20:31:43.577505 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:31:43.577468    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a77fbe8_927b_41bd_be95_36671d840d76.slice/crio-810481a89b589e6aa096b6e8231abc35a44a20bdb06e6947d828988259ccb6ac WatchSource:0}: Error finding container 810481a89b589e6aa096b6e8231abc35a44a20bdb06e6947d828988259ccb6ac: Status 404 returned error can't find the container with id 810481a89b589e6aa096b6e8231abc35a44a20bdb06e6947d828988259ccb6ac
Jul 20 20:31:44.555815 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:44.555702    2572 generic.go:356] "Generic (PLEG): container finished" podID="1a77fbe8-927b-41bd-be95-36671d840d76" containerID="0a79c12661bdbb74a458b1258fed4be580a95f280c4814141f482cdbb84a0dd9" exitCode=0
Jul 20 20:31:44.555815 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:44.555761    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b" event={"ID":"1a77fbe8-927b-41bd-be95-36671d840d76","Type":"ContainerDied","Data":"0a79c12661bdbb74a458b1258fed4be580a95f280c4814141f482cdbb84a0dd9"}
Jul 20 20:31:44.556201 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:44.555824    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b" event={"ID":"1a77fbe8-927b-41bd-be95-36671d840d76","Type":"ContainerStarted","Data":"810481a89b589e6aa096b6e8231abc35a44a20bdb06e6947d828988259ccb6ac"}
Jul 20 20:31:45.699368 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:45.699344    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:45.876702 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:45.876662    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a77fbe8-927b-41bd-be95-36671d840d76-maas-api-service-ca\") pod \"1a77fbe8-927b-41bd-be95-36671d840d76\" (UID: \"1a77fbe8-927b-41bd-be95-36671d840d76\") "
Jul 20 20:31:45.877139 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:45.877101    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a77fbe8-927b-41bd-be95-36671d840d76-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a77fbe8-927b-41bd-be95-36671d840d76" (UID: "1a77fbe8-927b-41bd-be95-36671d840d76"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:31:45.978338 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:45.978308    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a77fbe8-927b-41bd-be95-36671d840d76-maas-api-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:31:46.567942 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:46.567911    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"
Jul 20 20:31:46.568119 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:46.567951    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b" event={"ID":"1a77fbe8-927b-41bd-be95-36671d840d76","Type":"ContainerDied","Data":"810481a89b589e6aa096b6e8231abc35a44a20bdb06e6947d828988259ccb6ac"}
Jul 20 20:31:46.568119 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:46.567997    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="810481a89b589e6aa096b6e8231abc35a44a20bdb06e6947d828988259ccb6ac"
Jul 20 20:31:58.680936 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.680902    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"]
Jul 20 20:31:58.681341 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.681197    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" podUID="756e7676-905f-4df9-af80-11e2848dde04" containerName="maas-api" containerID="cri-o://26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7" gracePeriod=30
Jul 20 20:31:58.937701 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.937636    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:31:58.980506 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.980471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/756e7676-905f-4df9-af80-11e2848dde04-openshift-service-ca\") pod \"756e7676-905f-4df9-af80-11e2848dde04\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") "
Jul 20 20:31:58.980657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.980530    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls\") pod \"756e7676-905f-4df9-af80-11e2848dde04\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") "
Jul 20 20:31:58.980749 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.980706    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fc5c\" (UniqueName: \"kubernetes.io/projected/756e7676-905f-4df9-af80-11e2848dde04-kube-api-access-9fc5c\") pod \"756e7676-905f-4df9-af80-11e2848dde04\" (UID: \"756e7676-905f-4df9-af80-11e2848dde04\") "
Jul 20 20:31:58.980864 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.980832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756e7676-905f-4df9-af80-11e2848dde04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "756e7676-905f-4df9-af80-11e2848dde04" (UID: "756e7676-905f-4df9-af80-11e2848dde04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:31:58.981044 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.981028    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/756e7676-905f-4df9-af80-11e2848dde04-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:31:58.982589 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.982567    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "756e7676-905f-4df9-af80-11e2848dde04" (UID: "756e7676-905f-4df9-af80-11e2848dde04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:31:58.982688 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:58.982652    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756e7676-905f-4df9-af80-11e2848dde04-kube-api-access-9fc5c" (OuterVolumeSpecName: "kube-api-access-9fc5c") pod "756e7676-905f-4df9-af80-11e2848dde04" (UID: "756e7676-905f-4df9-af80-11e2848dde04"). InnerVolumeSpecName "kube-api-access-9fc5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:31:59.081924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.081890    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/756e7676-905f-4df9-af80-11e2848dde04-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:31:59.081924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.081918    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fc5c\" (UniqueName: \"kubernetes.io/projected/756e7676-905f-4df9-af80-11e2848dde04-kube-api-access-9fc5c\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:31:59.645846 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.645810    2572 generic.go:356] "Generic (PLEG): container finished" podID="756e7676-905f-4df9-af80-11e2848dde04" containerID="26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7" exitCode=0
Jul 20 20:31:59.646023 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.645860    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"
Jul 20 20:31:59.646023 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.645896    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" event={"ID":"756e7676-905f-4df9-af80-11e2848dde04","Type":"ContainerDied","Data":"26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7"}
Jul 20 20:31:59.646023 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.645956    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j" event={"ID":"756e7676-905f-4df9-af80-11e2848dde04","Type":"ContainerDied","Data":"b800b8bd52cc60c72ffd98e6665d6796dedc29aa7cbf5a8e8de9c21d543ca3b7"}
Jul 20 20:31:59.646023 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.645981    2572 scope.go:117] "RemoveContainer" containerID="26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7"
Jul 20 20:31:59.655470 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.655450    2572 scope.go:117] "RemoveContainer" containerID="26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7"
Jul 20 20:31:59.655713 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:31:59.655695    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7\": container with ID starting with 26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7 not found: ID does not exist" containerID="26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7"
Jul 20 20:31:59.655804 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.655747    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7"} err="failed to get container status \"26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7\": rpc error: code = NotFound desc = could not find container \"26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7\": container with ID starting with 26ba5bb3af72e11f59e07af6a0cd027d7e29bd013b090385c37b02c495e849f7 not found: ID does not exist"
Jul 20 20:31:59.668575 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.668549    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"]
Jul 20 20:31:59.673553 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:31:59.673522    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa45191d-5d96f9f47b-fs98j"]
Jul 20 20:32:00.725712 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:32:00.725675    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756e7676-905f-4df9-af80-11e2848dde04" path="/var/lib/kubelet/pods/756e7676-905f-4df9-af80-11e2848dde04/volumes"
Jul 20 20:32:03.208507 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:32:03.208462    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"]
Jul 20 20:32:03.212127 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:32:03.212096    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fa45191d-4x85b"]
Jul 20 20:32:04.725499 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:32:04.725464    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a77fbe8-927b-41bd-be95-36671d840d76" path="/var/lib/kubelet/pods/1a77fbe8-927b-41bd-be95-36671d840d76/volumes"
Jul 20 20:34:02.612297 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612264    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"]
Jul 20 20:34:02.612706 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612694    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a77fbe8-927b-41bd-be95-36671d840d76" containerName="revoke-keys"
Jul 20 20:34:02.612706 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612706    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a77fbe8-927b-41bd-be95-36671d840d76" containerName="revoke-keys"
Jul 20 20:34:02.612808 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612756    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756e7676-905f-4df9-af80-11e2848dde04" containerName="maas-api"
Jul 20 20:34:02.612808 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612762    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="756e7676-905f-4df9-af80-11e2848dde04" containerName="maas-api"
Jul 20 20:34:02.612872 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612836    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a77fbe8-927b-41bd-be95-36671d840d76" containerName="revoke-keys"
Jul 20 20:34:02.612872 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.612846    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="756e7676-905f-4df9-af80-11e2848dde04" containerName="maas-api"
Jul 20 20:34:02.616009 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.615986    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.618742 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.618703    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\""
Jul 20 20:34:02.618978 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.618961    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-68af9a-serving-cert\""
Jul 20 20:34:02.630697 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.630675    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"]
Jul 20 20:34:02.667035 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.667001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c085073-998b-47e4-a781-8fb4c34b3904-maas-api-tls\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.667210 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.667047    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c085073-998b-47e4-a781-8fb4c34b3904-openshift-service-ca\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.667210 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.667113    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrx5\" (UniqueName: \"kubernetes.io/projected/7c085073-998b-47e4-a781-8fb4c34b3904-kube-api-access-wrrx5\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.768390 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.768361    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c085073-998b-47e4-a781-8fb4c34b3904-maas-api-tls\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.768608 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.768411    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c085073-998b-47e4-a781-8fb4c34b3904-openshift-service-ca\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.768608 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.768476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrx5\" (UniqueName: \"kubernetes.io/projected/7c085073-998b-47e4-a781-8fb4c34b3904-kube-api-access-wrrx5\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.769189 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.769164    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c085073-998b-47e4-a781-8fb4c34b3904-openshift-service-ca\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.770877 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.770853    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c085073-998b-47e4-a781-8fb4c34b3904-maas-api-tls\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.781506 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.781464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrx5\" (UniqueName: \"kubernetes.io/projected/7c085073-998b-47e4-a781-8fb4c34b3904-kube-api-access-wrrx5\") pod \"maas-api-e2e-inf-a-68af9a-77c785485b-p9nml\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:02.926511 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:02.926420    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:03.065639 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:03.065617    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"]
Jul 20 20:34:03.067153 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:34:03.067118    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c085073_998b_47e4_a781_8fb4c34b3904.slice/crio-ba98cd076e9318a3ded3f836ca6e4670ed01be5f4a9d9af51340b79d1b666847 WatchSource:0}: Error finding container ba98cd076e9318a3ded3f836ca6e4670ed01be5f4a9d9af51340b79d1b666847: Status 404 returned error can't find the container with id ba98cd076e9318a3ded3f836ca6e4670ed01be5f4a9d9af51340b79d1b666847
Jul 20 20:34:03.346148 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:03.346109    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml" event={"ID":"7c085073-998b-47e4-a781-8fb4c34b3904","Type":"ContainerStarted","Data":"ba98cd076e9318a3ded3f836ca6e4670ed01be5f4a9d9af51340b79d1b666847"}
Jul 20 20:34:04.353991 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:04.353955    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml" event={"ID":"7c085073-998b-47e4-a781-8fb4c34b3904","Type":"ContainerStarted","Data":"698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f"}
Jul 20 20:34:04.354378 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:04.354016    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:34:04.373423 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:04.373368    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml" podStartSLOduration=1.919772043 podStartE2EDuration="2.373354149s" totalImagesPullingTime="453.582106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:34:04.370960293 +0000 UTC m=+2268.954191186" watchObservedRunningTime="2026-07-20 20:34:04.373354149 +0000 UTC m=+2268.956585036"
Jul 20 20:34:10.365595 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:34:10.365565    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:35:46.179071 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.179033    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"]
Jul 20 20:35:46.182668 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.182652    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:46.184756 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.184736    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-628hb\""
Jul 20 20:35:46.190288 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.190252    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"]
Jul 20 20:35:46.192012 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.191987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp\" (UID: \"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:46.293038 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.293000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp\" (UID: \"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:46.293657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.293632    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp\" (UID: \"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:46.495827 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.495687    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:46.634255 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.634226    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"]
Jul 20 20:35:46.635553 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:35:46.635519    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c83f81_cd0b_4c29_b2b0_94a02b798fd2.slice/crio-25255cd476f5f3356b79d0540c07dc951c87ffea30b0e7f08dad27666eeac7b4 WatchSource:0}: Error finding container 25255cd476f5f3356b79d0540c07dc951c87ffea30b0e7f08dad27666eeac7b4: Status 404 returned error can't find the container with id 25255cd476f5f3356b79d0540c07dc951c87ffea30b0e7f08dad27666eeac7b4
Jul 20 20:35:46.959386 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:46.959346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp" event={"ID":"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2","Type":"ContainerStarted","Data":"25255cd476f5f3356b79d0540c07dc951c87ffea30b0e7f08dad27666eeac7b4"}
Jul 20 20:35:47.966544 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:47.966508    2572 generic.go:356] "Generic (PLEG): container finished" podID="c4c83f81-cd0b-4c29-b2b0-94a02b798fd2" containerID="7fff136e1ba0cd8b90418dd91fab40ed61d3d3d56a2a8b0c4c0d7c6c4274e4f1" exitCode=0
Jul 20 20:35:47.967014 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:47.966597    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp" event={"ID":"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2","Type":"ContainerDied","Data":"7fff136e1ba0cd8b90418dd91fab40ed61d3d3d56a2a8b0c4c0d7c6c4274e4f1"}
Jul 20 20:35:49.114259 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.114230    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:49.220991 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.220957    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2-maas-api-service-ca\") pod \"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2\" (UID: \"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2\") "
Jul 20 20:35:49.221336 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.221313    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4c83f81-cd0b-4c29-b2b0-94a02b798fd2" (UID: "c4c83f81-cd0b-4c29-b2b0-94a02b798fd2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:35:49.322102 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.322021    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2-maas-api-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:35:49.980818 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.980775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp" event={"ID":"c4c83f81-cd0b-4c29-b2b0-94a02b798fd2","Type":"ContainerDied","Data":"25255cd476f5f3356b79d0540c07dc951c87ffea30b0e7f08dad27666eeac7b4"}
Jul 20 20:35:49.980818 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.980808    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"
Jul 20 20:35:49.980818 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:49.980827    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25255cd476f5f3356b79d0540c07dc951c87ffea30b0e7f08dad27666eeac7b4"
Jul 20 20:35:56.622504 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.622467    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"]
Jul 20 20:35:56.622921 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.622746    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml" podUID="7c085073-998b-47e4-a781-8fb4c34b3904" containerName="maas-api" containerID="cri-o://698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f" gracePeriod=30
Jul 20 20:35:56.876550 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.876487    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:35:56.995883 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.995846    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrrx5\" (UniqueName: \"kubernetes.io/projected/7c085073-998b-47e4-a781-8fb4c34b3904-kube-api-access-wrrx5\") pod \"7c085073-998b-47e4-a781-8fb4c34b3904\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") "
Jul 20 20:35:56.996078 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.995899    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c085073-998b-47e4-a781-8fb4c34b3904-maas-api-tls\") pod \"7c085073-998b-47e4-a781-8fb4c34b3904\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") "
Jul 20 20:35:56.996078 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.995960    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c085073-998b-47e4-a781-8fb4c34b3904-openshift-service-ca\") pod \"7c085073-998b-47e4-a781-8fb4c34b3904\" (UID: \"7c085073-998b-47e4-a781-8fb4c34b3904\") "
Jul 20 20:35:56.996370 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.996347    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c085073-998b-47e4-a781-8fb4c34b3904-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c085073-998b-47e4-a781-8fb4c34b3904" (UID: "7c085073-998b-47e4-a781-8fb4c34b3904"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:35:56.997857 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.997828    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c085073-998b-47e4-a781-8fb4c34b3904-kube-api-access-wrrx5" (OuterVolumeSpecName: "kube-api-access-wrrx5") pod "7c085073-998b-47e4-a781-8fb4c34b3904" (UID: "7c085073-998b-47e4-a781-8fb4c34b3904"). InnerVolumeSpecName "kube-api-access-wrrx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:35:56.997960 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:56.997924    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c085073-998b-47e4-a781-8fb4c34b3904-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c085073-998b-47e4-a781-8fb4c34b3904" (UID: "7c085073-998b-47e4-a781-8fb4c34b3904"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:35:57.023373 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.023347    2572 generic.go:356] "Generic (PLEG): container finished" podID="7c085073-998b-47e4-a781-8fb4c34b3904" containerID="698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f" exitCode=0
Jul 20 20:35:57.023499 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.023391    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"
Jul 20 20:35:57.023499 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.023434    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml" event={"ID":"7c085073-998b-47e4-a781-8fb4c34b3904","Type":"ContainerDied","Data":"698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f"}
Jul 20 20:35:57.023499 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.023488    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml" event={"ID":"7c085073-998b-47e4-a781-8fb4c34b3904","Type":"ContainerDied","Data":"ba98cd076e9318a3ded3f836ca6e4670ed01be5f4a9d9af51340b79d1b666847"}
Jul 20 20:35:57.023616 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.023511    2572 scope.go:117] "RemoveContainer" containerID="698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f"
Jul 20 20:35:57.032626 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.032610    2572 scope.go:117] "RemoveContainer" containerID="698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f"
Jul 20 20:35:57.032954 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:35:57.032919    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f\": container with ID starting with 698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f not found: ID does not exist" containerID="698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f"
Jul 20 20:35:57.033037 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.032954    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f"} err="failed to get container status \"698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f\": rpc error: code = NotFound desc = could not find container \"698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f\": container with ID starting with 698624eb919cdc615126178fac49e769b5f984ad70ac65e595ce084571d5d82f not found: ID does not exist"
Jul 20 20:35:57.047602 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.047580    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"]
Jul 20 20:35:57.049993 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.049971    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68af9a-77c785485b-p9nml"]
Jul 20 20:35:57.096895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.096866    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrrx5\" (UniqueName: \"kubernetes.io/projected/7c085073-998b-47e4-a781-8fb4c34b3904-kube-api-access-wrrx5\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:35:57.096895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.096891    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c085073-998b-47e4-a781-8fb4c34b3904-maas-api-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:35:57.096895 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:57.096902    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c085073-998b-47e4-a781-8fb4c34b3904-openshift-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:35:58.725974 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:35:58.725943    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c085073-998b-47e4-a781-8fb4c34b3904" path="/var/lib/kubelet/pods/7c085073-998b-47e4-a781-8fb4c34b3904/volumes"
Jul 20 20:36:01.270080 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:01.269851    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"]
Jul 20 20:36:01.272426 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:01.272404    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68af9a-45wmp"]
Jul 20 20:36:02.725487 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:02.725458    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c83f81-cd0b-4c29-b2b0-94a02b798fd2" path="/var/lib/kubelet/pods/c4c83f81-cd0b-4c29-b2b0-94a02b798fd2/volumes"
Jul 20 20:36:08.468010 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.467978    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"]
Jul 20 20:36:08.468424 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.468411    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c83f81-cd0b-4c29-b2b0-94a02b798fd2" containerName="revoke-keys"
Jul 20 20:36:08.468424 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.468425    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c83f81-cd0b-4c29-b2b0-94a02b798fd2" containerName="revoke-keys"
Jul 20 20:36:08.468508 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.468436    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c085073-998b-47e4-a781-8fb4c34b3904" containerName="maas-api"
Jul 20 20:36:08.468508 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.468441    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c085073-998b-47e4-a781-8fb4c34b3904" containerName="maas-api"
Jul 20 20:36:08.468508 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.468503    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c83f81-cd0b-4c29-b2b0-94a02b798fd2" containerName="revoke-keys"
Jul 20 20:36:08.468601 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.468513    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c085073-998b-47e4-a781-8fb4c34b3904" containerName="maas-api"
Jul 20 20:36:08.472837 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.472818    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:08.475088 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.475054    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-628hb\""
Jul 20 20:36:08.478924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.478898    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"]
Jul 20 20:36:08.606261 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.606223    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb61b2f-fd00-4208-bf04-ce02db5257b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-183471-zmzzk\" (UID: \"bdb61b2f-fd00-4208-bf04-ce02db5257b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:08.707248 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.707205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb61b2f-fd00-4208-bf04-ce02db5257b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-183471-zmzzk\" (UID: \"bdb61b2f-fd00-4208-bf04-ce02db5257b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:08.707877 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.707859    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb61b2f-fd00-4208-bf04-ce02db5257b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-183471-zmzzk\" (UID: \"bdb61b2f-fd00-4208-bf04-ce02db5257b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:08.785904 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.785822    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:08.925017 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:08.924992    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"]
Jul 20 20:36:08.927210 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:36:08.927176    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb61b2f_fd00_4208_bf04_ce02db5257b4.slice/crio-300cc0fb44e7bd753ee2b6d8d9521d6a95167a4ac9c4a3d0c0f215f9d97dae67 WatchSource:0}: Error finding container 300cc0fb44e7bd753ee2b6d8d9521d6a95167a4ac9c4a3d0c0f215f9d97dae67: Status 404 returned error can't find the container with id 300cc0fb44e7bd753ee2b6d8d9521d6a95167a4ac9c4a3d0c0f215f9d97dae67
Jul 20 20:36:09.098406 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:09.098375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk" event={"ID":"bdb61b2f-fd00-4208-bf04-ce02db5257b4","Type":"ContainerStarted","Data":"300cc0fb44e7bd753ee2b6d8d9521d6a95167a4ac9c4a3d0c0f215f9d97dae67"}
Jul 20 20:36:10.105963 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:10.105928    2572 generic.go:356] "Generic (PLEG): container finished" podID="bdb61b2f-fd00-4208-bf04-ce02db5257b4" containerID="12d22b409ca0cf568ac219abeb4f5644ff3d7b0d4a54b9f45f170e8d1f798c1c" exitCode=0
Jul 20 20:36:10.106338 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:10.105969    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk" event={"ID":"bdb61b2f-fd00-4208-bf04-ce02db5257b4","Type":"ContainerDied","Data":"12d22b409ca0cf568ac219abeb4f5644ff3d7b0d4a54b9f45f170e8d1f798c1c"}
Jul 20 20:36:11.245958 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:11.245932    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:11.331861 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:11.331810    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb61b2f-fd00-4208-bf04-ce02db5257b4-maas-api-service-ca\") pod \"bdb61b2f-fd00-4208-bf04-ce02db5257b4\" (UID: \"bdb61b2f-fd00-4208-bf04-ce02db5257b4\") "
Jul 20 20:36:11.332228 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:11.332206    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdb61b2f-fd00-4208-bf04-ce02db5257b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bdb61b2f-fd00-4208-bf04-ce02db5257b4" (UID: "bdb61b2f-fd00-4208-bf04-ce02db5257b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:36:11.433024 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:11.432933    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb61b2f-fd00-4208-bf04-ce02db5257b4-maas-api-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:36:12.119507 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:12.119476    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"
Jul 20 20:36:12.119668 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:12.119472    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk" event={"ID":"bdb61b2f-fd00-4208-bf04-ce02db5257b4","Type":"ContainerDied","Data":"300cc0fb44e7bd753ee2b6d8d9521d6a95167a4ac9c4a3d0c0f215f9d97dae67"}
Jul 20 20:36:12.119668 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:12.119602    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="300cc0fb44e7bd753ee2b6d8d9521d6a95167a4ac9c4a3d0c0f215f9d97dae67"
Jul 20 20:36:16.912781 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:16.912756    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:36:16.941641 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:16.941613    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:36:23.541016 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:23.540983    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"]
Jul 20 20:36:23.543220 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:23.543194    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-183471-zmzzk"]
Jul 20 20:36:24.725199 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:36:24.725163    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdb61b2f-fd00-4208-bf04-ce02db5257b4" path="/var/lib/kubelet/pods/bdb61b2f-fd00-4208-bf04-ce02db5257b4/volumes"
Jul 20 20:38:17.043159 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:38:17.043055    2572 scope.go:117] "RemoveContainer" containerID="0a79c12661bdbb74a458b1258fed4be580a95f280c4814141f482cdbb84a0dd9"
Jul 20 20:41:16.951440 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:41:16.951356    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:41:16.982505 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:41:16.982471    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:42:17.103021 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:42:17.102986    2572 scope.go:117] "RemoveContainer" containerID="7fff136e1ba0cd8b90418dd91fab40ed61d3d3d56a2a8b0c4c0d7c6c4274e4f1"
Jul 20 20:42:17.111811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:42:17.111788    2572 scope.go:117] "RemoveContainer" containerID="12d22b409ca0cf568ac219abeb4f5644ff3d7b0d4a54b9f45f170e8d1f798c1c"
Jul 20 20:44:29.395244 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.395165    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7855-139667800702256"]
Jul 20 20:44:29.395654 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.395628    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb61b2f-fd00-4208-bf04-ce02db5257b4" containerName="revoke-keys"
Jul 20 20:44:29.395654 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.395639    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb61b2f-fd00-4208-bf04-ce02db5257b4" containerName="revoke-keys"
Jul 20 20:44:29.395761 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.395696    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb61b2f-fd00-4208-bf04-ce02db5257b4" containerName="revoke-keys"
Jul 20 20:44:29.398890 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.398868    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:29.401076 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.401048    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kngk5\""
Jul 20 20:44:29.405011 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.404986    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800702256"]
Jul 20 20:44:29.482735 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.482691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8dr\" (UniqueName: \"kubernetes.io/projected/04561d32-99a3-44ad-8a3d-89aa1b40b8fb-kube-api-access-8v8dr\") pod \"test-curl-7855-139667800702256\" (UID: \"04561d32-99a3-44ad-8a3d-89aa1b40b8fb\") " pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:29.583950 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.583917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8dr\" (UniqueName: \"kubernetes.io/projected/04561d32-99a3-44ad-8a3d-89aa1b40b8fb-kube-api-access-8v8dr\") pod \"test-curl-7855-139667800702256\" (UID: \"04561d32-99a3-44ad-8a3d-89aa1b40b8fb\") " pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:29.591532 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.591501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8dr\" (UniqueName: \"kubernetes.io/projected/04561d32-99a3-44ad-8a3d-89aa1b40b8fb-kube-api-access-8v8dr\") pod \"test-curl-7855-139667800702256\" (UID: \"04561d32-99a3-44ad-8a3d-89aa1b40b8fb\") " pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:29.709610 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.709522    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:29.843754 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.843702    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800702256"]
Jul 20 20:44:29.846084 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:29.846051    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04561d32_99a3_44ad_8a3d_89aa1b40b8fb.slice/crio-951756eea0fb21707801cfece284eef7402c7c7bd391a6dec1fa54a4474082e6 WatchSource:0}: Error finding container 951756eea0fb21707801cfece284eef7402c7c7bd391a6dec1fa54a4474082e6: Status 404 returned error can't find the container with id 951756eea0fb21707801cfece284eef7402c7c7bd391a6dec1fa54a4474082e6
Jul 20 20:44:29.847410 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:29.847389    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:44:30.103513 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:30.103477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800702256" event={"ID":"04561d32-99a3-44ad-8a3d-89aa1b40b8fb","Type":"ContainerStarted","Data":"951756eea0fb21707801cfece284eef7402c7c7bd391a6dec1fa54a4474082e6"}
Jul 20 20:44:31.111169 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:31.111135    2572 generic.go:356] "Generic (PLEG): container finished" podID="04561d32-99a3-44ad-8a3d-89aa1b40b8fb" containerID="c727e1b8505dfee71b55bd3f154417fb801cf1b51549fe0cb3e63be5711932e1" exitCode=0
Jul 20 20:44:31.111553 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:31.111184    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800702256" event={"ID":"04561d32-99a3-44ad-8a3d-89aa1b40b8fb","Type":"ContainerDied","Data":"c727e1b8505dfee71b55bd3f154417fb801cf1b51549fe0cb3e63be5711932e1"}
Jul 20 20:44:32.264128 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.264102    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:32.299713 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.299683    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7855-139667800702256_04561d32-99a3-44ad-8a3d-89aa1b40b8fb/test-curl-7855-139667800702256/0.log"
Jul 20 20:44:32.309029 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.309006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v8dr\" (UniqueName: \"kubernetes.io/projected/04561d32-99a3-44ad-8a3d-89aa1b40b8fb-kube-api-access-8v8dr\") pod \"04561d32-99a3-44ad-8a3d-89aa1b40b8fb\" (UID: \"04561d32-99a3-44ad-8a3d-89aa1b40b8fb\") "
Jul 20 20:44:32.311048 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.311017    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04561d32-99a3-44ad-8a3d-89aa1b40b8fb-kube-api-access-8v8dr" (OuterVolumeSpecName: "kube-api-access-8v8dr") pod "04561d32-99a3-44ad-8a3d-89aa1b40b8fb" (UID: "04561d32-99a3-44ad-8a3d-89aa1b40b8fb"). InnerVolumeSpecName "kube-api-access-8v8dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:44:32.321172 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.321150    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7855-139667800702256"]
Jul 20 20:44:32.323499 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.323481    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7855-139667800702256"]
Jul 20 20:44:32.409688 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.409596    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v8dr\" (UniqueName: \"kubernetes.io/projected/04561d32-99a3-44ad-8a3d-89aa1b40b8fb-kube-api-access-8v8dr\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:32.446667 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.446630    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7855-139667800700848"]
Jul 20 20:44:32.447087 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.447071    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04561d32-99a3-44ad-8a3d-89aa1b40b8fb" containerName="test-curl-7855-139667800702256"
Jul 20 20:44:32.447132 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.447088    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="04561d32-99a3-44ad-8a3d-89aa1b40b8fb" containerName="test-curl-7855-139667800702256"
Jul 20 20:44:32.447176 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.447167    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="04561d32-99a3-44ad-8a3d-89aa1b40b8fb" containerName="test-curl-7855-139667800702256"
Jul 20 20:44:32.450359 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.450343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:32.456102 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.456072    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800700848"]
Jul 20 20:44:32.510385 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.510351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj24j\" (UniqueName: \"kubernetes.io/projected/56be9f5a-07e1-4712-8430-2a59eab249ab-kube-api-access-zj24j\") pod \"test-curl-7855-139667800700848\" (UID: \"56be9f5a-07e1-4712-8430-2a59eab249ab\") " pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:32.611799 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.611761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj24j\" (UniqueName: \"kubernetes.io/projected/56be9f5a-07e1-4712-8430-2a59eab249ab-kube-api-access-zj24j\") pod \"test-curl-7855-139667800700848\" (UID: \"56be9f5a-07e1-4712-8430-2a59eab249ab\") " pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:32.619699 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.619672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj24j\" (UniqueName: \"kubernetes.io/projected/56be9f5a-07e1-4712-8430-2a59eab249ab-kube-api-access-zj24j\") pod \"test-curl-7855-139667800700848\" (UID: \"56be9f5a-07e1-4712-8430-2a59eab249ab\") " pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:32.724975 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.724892    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04561d32-99a3-44ad-8a3d-89aa1b40b8fb" path="/var/lib/kubelet/pods/04561d32-99a3-44ad-8a3d-89aa1b40b8fb/volumes"
Jul 20 20:44:32.761414 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.761376    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:32.898504 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:32.898471    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800700848"]
Jul 20 20:44:32.899894 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:32.899866    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56be9f5a_07e1_4712_8430_2a59eab249ab.slice/crio-b063d88a39702df752eb8eca74588ae39f711ba4effd9e72f2234edbd071cec2 WatchSource:0}: Error finding container b063d88a39702df752eb8eca74588ae39f711ba4effd9e72f2234edbd071cec2: Status 404 returned error can't find the container with id b063d88a39702df752eb8eca74588ae39f711ba4effd9e72f2234edbd071cec2
Jul 20 20:44:33.123645 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:33.123609    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800702256"
Jul 20 20:44:33.123645 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:33.123641    2572 scope.go:117] "RemoveContainer" containerID="c727e1b8505dfee71b55bd3f154417fb801cf1b51549fe0cb3e63be5711932e1"
Jul 20 20:44:33.124968 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:33.124890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800700848" event={"ID":"56be9f5a-07e1-4712-8430-2a59eab249ab","Type":"ContainerStarted","Data":"b063d88a39702df752eb8eca74588ae39f711ba4effd9e72f2234edbd071cec2"}
Jul 20 20:44:34.133900 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:34.133866    2572 generic.go:356] "Generic (PLEG): container finished" podID="56be9f5a-07e1-4712-8430-2a59eab249ab" containerID="ea9a91fd6759583622df5c4ce8d57604788cd5230b7b3636ae6bc79a1e6e1353" exitCode=0
Jul 20 20:44:34.134564 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:34.133956    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800700848" event={"ID":"56be9f5a-07e1-4712-8430-2a59eab249ab","Type":"ContainerDied","Data":"ea9a91fd6759583622df5c4ce8d57604788cd5230b7b3636ae6bc79a1e6e1353"}
Jul 20 20:44:35.285322 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.285296    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:35.304760 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.304709    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7855-139667800700848_56be9f5a-07e1-4712-8430-2a59eab249ab/test-curl-7855-139667800700848/0.log"
Jul 20 20:44:35.329650 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.329612    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7855-139667800700848"]
Jul 20 20:44:35.335173 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.335151    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7855-139667800700848"]
Jul 20 20:44:35.338899 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.338869    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj24j\" (UniqueName: \"kubernetes.io/projected/56be9f5a-07e1-4712-8430-2a59eab249ab-kube-api-access-zj24j\") pod \"56be9f5a-07e1-4712-8430-2a59eab249ab\" (UID: \"56be9f5a-07e1-4712-8430-2a59eab249ab\") "
Jul 20 20:44:35.340872 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.340850    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56be9f5a-07e1-4712-8430-2a59eab249ab-kube-api-access-zj24j" (OuterVolumeSpecName: "kube-api-access-zj24j") pod "56be9f5a-07e1-4712-8430-2a59eab249ab" (UID: "56be9f5a-07e1-4712-8430-2a59eab249ab"). InnerVolumeSpecName "kube-api-access-zj24j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:44:35.439632 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.439550    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj24j\" (UniqueName: \"kubernetes.io/projected/56be9f5a-07e1-4712-8430-2a59eab249ab-kube-api-access-zj24j\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:35.498482 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.498447    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:35.498932 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.498915    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56be9f5a-07e1-4712-8430-2a59eab249ab" containerName="test-curl-7855-139667800700848"
Jul 20 20:44:35.498979 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.498934    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="56be9f5a-07e1-4712-8430-2a59eab249ab" containerName="test-curl-7855-139667800700848"
Jul 20 20:44:35.499014 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.498994    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="56be9f5a-07e1-4712-8430-2a59eab249ab" containerName="test-curl-7855-139667800700848"
Jul 20 20:44:35.502115 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.502099    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:35.508009 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.507980    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:35.540082 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.540051    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8sfg\" (UniqueName: \"kubernetes.io/projected/08360600-3fc5-4f67-b3cb-70b5c19e40e2-kube-api-access-d8sfg\") pod \"test-curl-7855-139667800650064\" (UID: \"08360600-3fc5-4f67-b3cb-70b5c19e40e2\") " pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:35.641117 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.641079    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8sfg\" (UniqueName: \"kubernetes.io/projected/08360600-3fc5-4f67-b3cb-70b5c19e40e2-kube-api-access-d8sfg\") pod \"test-curl-7855-139667800650064\" (UID: \"08360600-3fc5-4f67-b3cb-70b5c19e40e2\") " pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:35.649372 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.649339    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8sfg\" (UniqueName: \"kubernetes.io/projected/08360600-3fc5-4f67-b3cb-70b5c19e40e2-kube-api-access-d8sfg\") pod \"test-curl-7855-139667800650064\" (UID: \"08360600-3fc5-4f67-b3cb-70b5c19e40e2\") " pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:35.813169 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.813074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:35.967460 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:35.967438    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:35.968468 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:35.968448    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08360600_3fc5_4f67_b3cb_70b5c19e40e2.slice/crio-34880f8280d97be7857ea977e565b7e9672cdc0a17f54bc12dbd44d445932401 WatchSource:0}: Error finding container 34880f8280d97be7857ea977e565b7e9672cdc0a17f54bc12dbd44d445932401: Status 404 returned error can't find the container with id 34880f8280d97be7857ea977e565b7e9672cdc0a17f54bc12dbd44d445932401
Jul 20 20:44:36.145904 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:36.145865    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800650064" event={"ID":"08360600-3fc5-4f67-b3cb-70b5c19e40e2","Type":"ContainerStarted","Data":"34880f8280d97be7857ea977e565b7e9672cdc0a17f54bc12dbd44d445932401"}
Jul 20 20:44:36.147220 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:36.147194    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b063d88a39702df752eb8eca74588ae39f711ba4effd9e72f2234edbd071cec2"
Jul 20 20:44:36.147341 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:36.147229    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:36.161551 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:44:36.161512    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7855-139667800700848\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="56be9f5a-07e1-4712-8430-2a59eab249ab" pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:36.723967 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:44:36.723930    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7855-139667800700848\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="56be9f5a-07e1-4712-8430-2a59eab249ab" pod="opendatahub/test-curl-7855-139667800700848"
Jul 20 20:44:36.726551 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:36.726525    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56be9f5a-07e1-4712-8430-2a59eab249ab" path="/var/lib/kubelet/pods/56be9f5a-07e1-4712-8430-2a59eab249ab/volumes"
Jul 20 20:44:37.155501 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:37.155466    2572 generic.go:356] "Generic (PLEG): container finished" podID="08360600-3fc5-4f67-b3cb-70b5c19e40e2" containerID="2436ef3f30bedad1fc647bab93ce19e183816dcbb569f7c4571ecfd79e7faf3d" exitCode=0
Jul 20 20:44:37.155715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:37.155547    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800650064" event={"ID":"08360600-3fc5-4f67-b3cb-70b5c19e40e2","Type":"ContainerDied","Data":"2436ef3f30bedad1fc647bab93ce19e183816dcbb569f7c4571ecfd79e7faf3d"}
Jul 20 20:44:38.307692 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.307666    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:38.328453 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.328416    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7855-139667800650064_08360600-3fc5-4f67-b3cb-70b5c19e40e2/test-curl-7855-139667800650064/0.log"
Jul 20 20:44:38.356108 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.356077    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:38.360363 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.360336    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:38.365802 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.365781    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8sfg\" (UniqueName: \"kubernetes.io/projected/08360600-3fc5-4f67-b3cb-70b5c19e40e2-kube-api-access-d8sfg\") pod \"08360600-3fc5-4f67-b3cb-70b5c19e40e2\" (UID: \"08360600-3fc5-4f67-b3cb-70b5c19e40e2\") "
Jul 20 20:44:38.367766 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.367738    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08360600-3fc5-4f67-b3cb-70b5c19e40e2-kube-api-access-d8sfg" (OuterVolumeSpecName: "kube-api-access-d8sfg") pod "08360600-3fc5-4f67-b3cb-70b5c19e40e2" (UID: "08360600-3fc5-4f67-b3cb-70b5c19e40e2"). InnerVolumeSpecName "kube-api-access-d8sfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:44:38.467036 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.466949    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8sfg\" (UniqueName: \"kubernetes.io/projected/08360600-3fc5-4f67-b3cb-70b5c19e40e2-kube-api-access-d8sfg\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:38.482039 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.482010    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:38.482433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.482420    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08360600-3fc5-4f67-b3cb-70b5c19e40e2" containerName="test-curl-7855-139667800650064"
Jul 20 20:44:38.482482 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.482435    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08360600-3fc5-4f67-b3cb-70b5c19e40e2" containerName="test-curl-7855-139667800650064"
Jul 20 20:44:38.482520 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.482503    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="08360600-3fc5-4f67-b3cb-70b5c19e40e2" containerName="test-curl-7855-139667800650064"
Jul 20 20:44:38.485628 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.485611    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:38.492369 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.492345    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:38.568210 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.568169    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9vb\" (UniqueName: \"kubernetes.io/projected/40185399-6e13-48a5-8e38-440110cbceab-kube-api-access-mq9vb\") pod \"test-curl-7855-139667800650064\" (UID: \"40185399-6e13-48a5-8e38-440110cbceab\") " pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:38.668993 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.668956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9vb\" (UniqueName: \"kubernetes.io/projected/40185399-6e13-48a5-8e38-440110cbceab-kube-api-access-mq9vb\") pod \"test-curl-7855-139667800650064\" (UID: \"40185399-6e13-48a5-8e38-440110cbceab\") " pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:38.677902 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.677865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9vb\" (UniqueName: \"kubernetes.io/projected/40185399-6e13-48a5-8e38-440110cbceab-kube-api-access-mq9vb\") pod \"test-curl-7855-139667800650064\" (UID: \"40185399-6e13-48a5-8e38-440110cbceab\") " pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:38.726605 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.726521    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08360600-3fc5-4f67-b3cb-70b5c19e40e2" path="/var/lib/kubelet/pods/08360600-3fc5-4f67-b3cb-70b5c19e40e2/volumes"
Jul 20 20:44:38.797486 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.797452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:38.936771 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:38.936745    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:38.939022 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:38.938997    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40185399_6e13_48a5_8e38_440110cbceab.slice/crio-153d0efa2306c52f2d64bf7841dd66fe849df2dc02bba134ce5432af6c48d38f WatchSource:0}: Error finding container 153d0efa2306c52f2d64bf7841dd66fe849df2dc02bba134ce5432af6c48d38f: Status 404 returned error can't find the container with id 153d0efa2306c52f2d64bf7841dd66fe849df2dc02bba134ce5432af6c48d38f
Jul 20 20:44:39.167996 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:39.167968    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:39.168183 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:39.168027    2572 scope.go:117] "RemoveContainer" containerID="2436ef3f30bedad1fc647bab93ce19e183816dcbb569f7c4571ecfd79e7faf3d"
Jul 20 20:44:39.169352 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:39.169231    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800650064" event={"ID":"40185399-6e13-48a5-8e38-440110cbceab","Type":"ContainerStarted","Data":"153d0efa2306c52f2d64bf7841dd66fe849df2dc02bba134ce5432af6c48d38f"}
Jul 20 20:44:40.178716 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:40.178682    2572 generic.go:356] "Generic (PLEG): container finished" podID="40185399-6e13-48a5-8e38-440110cbceab" containerID="30333421977a9e8655019ba898f78aa20a5333c7eb125620c4f84ea7aa96b9ed" exitCode=0
Jul 20 20:44:40.179192 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:40.178768    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800650064" event={"ID":"40185399-6e13-48a5-8e38-440110cbceab","Type":"ContainerDied","Data":"30333421977a9e8655019ba898f78aa20a5333c7eb125620c4f84ea7aa96b9ed"}
Jul 20 20:44:41.320241 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.320213    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:41.339967 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.339940    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7855-139667800650064_40185399-6e13-48a5-8e38-440110cbceab/test-curl-7855-139667800650064/0.log"
Jul 20 20:44:41.362743 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.362695    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:41.367963 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.367937    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7855-139667800650064"]
Jul 20 20:44:41.395785 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.395751    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq9vb\" (UniqueName: \"kubernetes.io/projected/40185399-6e13-48a5-8e38-440110cbceab-kube-api-access-mq9vb\") pod \"40185399-6e13-48a5-8e38-440110cbceab\" (UID: \"40185399-6e13-48a5-8e38-440110cbceab\") "
Jul 20 20:44:41.397863 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.397827    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40185399-6e13-48a5-8e38-440110cbceab-kube-api-access-mq9vb" (OuterVolumeSpecName: "kube-api-access-mq9vb") pod "40185399-6e13-48a5-8e38-440110cbceab" (UID: "40185399-6e13-48a5-8e38-440110cbceab"). InnerVolumeSpecName "kube-api-access-mq9vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:44:41.488665 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.488585    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:41.489101 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.489084    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40185399-6e13-48a5-8e38-440110cbceab" containerName="test-curl-7855-139667800650064"
Jul 20 20:44:41.489147 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.489104    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="40185399-6e13-48a5-8e38-440110cbceab" containerName="test-curl-7855-139667800650064"
Jul 20 20:44:41.489184 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.489175    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="40185399-6e13-48a5-8e38-440110cbceab" containerName="test-curl-7855-139667800650064"
Jul 20 20:44:41.492433 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.492412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:41.497905 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.497883    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq9vb\" (UniqueName: \"kubernetes.io/projected/40185399-6e13-48a5-8e38-440110cbceab-kube-api-access-mq9vb\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:41.499246 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.499221    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:41.599007 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.598969    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8z52\" (UniqueName: \"kubernetes.io/projected/faccc1f0-7b2e-4be4-80a2-8370463c21be-kube-api-access-h8z52\") pod \"test-curl-7855-139667800716320\" (UID: \"faccc1f0-7b2e-4be4-80a2-8370463c21be\") " pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:41.699823 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.699790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8z52\" (UniqueName: \"kubernetes.io/projected/faccc1f0-7b2e-4be4-80a2-8370463c21be-kube-api-access-h8z52\") pod \"test-curl-7855-139667800716320\" (UID: \"faccc1f0-7b2e-4be4-80a2-8370463c21be\") " pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:41.707887 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.707855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8z52\" (UniqueName: \"kubernetes.io/projected/faccc1f0-7b2e-4be4-80a2-8370463c21be-kube-api-access-h8z52\") pod \"test-curl-7855-139667800716320\" (UID: \"faccc1f0-7b2e-4be4-80a2-8370463c21be\") " pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:41.803197 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.803103    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:41.941377 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:41.941348    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:41.943926 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:41.943897    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaccc1f0_7b2e_4be4_80a2_8370463c21be.slice/crio-97e3f2d3d2e80ba6faf62f99926c30546282caa456c3a7c9c9842ed674a8258a WatchSource:0}: Error finding container 97e3f2d3d2e80ba6faf62f99926c30546282caa456c3a7c9c9842ed674a8258a: Status 404 returned error can't find the container with id 97e3f2d3d2e80ba6faf62f99926c30546282caa456c3a7c9c9842ed674a8258a
Jul 20 20:44:42.192636 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:42.192600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800716320" event={"ID":"faccc1f0-7b2e-4be4-80a2-8370463c21be","Type":"ContainerStarted","Data":"97e3f2d3d2e80ba6faf62f99926c30546282caa456c3a7c9c9842ed674a8258a"}
Jul 20 20:44:42.193933 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:42.193907    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:42.193933 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:42.193932    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="153d0efa2306c52f2d64bf7841dd66fe849df2dc02bba134ce5432af6c48d38f"
Jul 20 20:44:42.204536 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:44:42.204508    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7855-139667800650064\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="40185399-6e13-48a5-8e38-440110cbceab" pod="opendatahub/test-curl-7855-139667800650064"
Jul 20 20:44:42.726154 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:42.726117    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40185399-6e13-48a5-8e38-440110cbceab" path="/var/lib/kubelet/pods/40185399-6e13-48a5-8e38-440110cbceab/volumes"
Jul 20 20:44:43.201505 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:43.201466    2572 generic.go:356] "Generic (PLEG): container finished" podID="faccc1f0-7b2e-4be4-80a2-8370463c21be" containerID="4b3c8b4d8232c6a27a93c6e154b35c19ebac888fe5df839cc3111fe3d442b5d8" exitCode=0
Jul 20 20:44:43.201720 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:43.201548    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800716320" event={"ID":"faccc1f0-7b2e-4be4-80a2-8370463c21be","Type":"ContainerDied","Data":"4b3c8b4d8232c6a27a93c6e154b35c19ebac888fe5df839cc3111fe3d442b5d8"}
Jul 20 20:44:44.340927 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.340900    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:44.368239 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.368202    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7855-139667800716320_faccc1f0-7b2e-4be4-80a2-8370463c21be/test-curl-7855-139667800716320/0.log"
Jul 20 20:44:44.391455 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.391422    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:44.395381 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.395351    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:44.427112 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.427082    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8z52\" (UniqueName: \"kubernetes.io/projected/faccc1f0-7b2e-4be4-80a2-8370463c21be-kube-api-access-h8z52\") pod \"faccc1f0-7b2e-4be4-80a2-8370463c21be\" (UID: \"faccc1f0-7b2e-4be4-80a2-8370463c21be\") "
Jul 20 20:44:44.429163 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.429128    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faccc1f0-7b2e-4be4-80a2-8370463c21be-kube-api-access-h8z52" (OuterVolumeSpecName: "kube-api-access-h8z52") pod "faccc1f0-7b2e-4be4-80a2-8370463c21be" (UID: "faccc1f0-7b2e-4be4-80a2-8370463c21be"). InnerVolumeSpecName "kube-api-access-h8z52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:44:44.517586 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.517504    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:44.517969 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.517955    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faccc1f0-7b2e-4be4-80a2-8370463c21be" containerName="test-curl-7855-139667800716320"
Jul 20 20:44:44.517969 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.517970    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="faccc1f0-7b2e-4be4-80a2-8370463c21be" containerName="test-curl-7855-139667800716320"
Jul 20 20:44:44.518062 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.518032    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="faccc1f0-7b2e-4be4-80a2-8370463c21be" containerName="test-curl-7855-139667800716320"
Jul 20 20:44:44.521154 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.521136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:44.527808 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.527771    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8z52\" (UniqueName: \"kubernetes.io/projected/faccc1f0-7b2e-4be4-80a2-8370463c21be-kube-api-access-h8z52\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:44.528434 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.528361    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:44.629044 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.629009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ppf6\" (UniqueName: \"kubernetes.io/projected/cbe49912-6fde-4653-a2bb-9be095e8dbec-kube-api-access-6ppf6\") pod \"test-curl-7855-139667800716320\" (UID: \"cbe49912-6fde-4653-a2bb-9be095e8dbec\") " pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:44.726550 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.726514    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faccc1f0-7b2e-4be4-80a2-8370463c21be" path="/var/lib/kubelet/pods/faccc1f0-7b2e-4be4-80a2-8370463c21be/volumes"
Jul 20 20:44:44.729776 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.729755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ppf6\" (UniqueName: \"kubernetes.io/projected/cbe49912-6fde-4653-a2bb-9be095e8dbec-kube-api-access-6ppf6\") pod \"test-curl-7855-139667800716320\" (UID: \"cbe49912-6fde-4653-a2bb-9be095e8dbec\") " pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:44.738471 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.738448    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ppf6\" (UniqueName: \"kubernetes.io/projected/cbe49912-6fde-4653-a2bb-9be095e8dbec-kube-api-access-6ppf6\") pod \"test-curl-7855-139667800716320\" (UID: \"cbe49912-6fde-4653-a2bb-9be095e8dbec\") " pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:44.831837 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.831752    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:44.977286 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:44.977258    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:44.978866 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:44.978840    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbe49912_6fde_4653_a2bb_9be095e8dbec.slice/crio-e88d9d69586ce9e8014eb67bb910f515dbefa6a4024a796fa65bc7e4a4b62345 WatchSource:0}: Error finding container e88d9d69586ce9e8014eb67bb910f515dbefa6a4024a796fa65bc7e4a4b62345: Status 404 returned error can't find the container with id e88d9d69586ce9e8014eb67bb910f515dbefa6a4024a796fa65bc7e4a4b62345
Jul 20 20:44:45.215276 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:45.215241    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800716320" event={"ID":"cbe49912-6fde-4653-a2bb-9be095e8dbec","Type":"ContainerStarted","Data":"e88d9d69586ce9e8014eb67bb910f515dbefa6a4024a796fa65bc7e4a4b62345"}
Jul 20 20:44:45.216520 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:45.216499    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:45.216657 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:45.216532    2572 scope.go:117] "RemoveContainer" containerID="4b3c8b4d8232c6a27a93c6e154b35c19ebac888fe5df839cc3111fe3d442b5d8"
Jul 20 20:44:46.223811 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:46.223776    2572 generic.go:356] "Generic (PLEG): container finished" podID="cbe49912-6fde-4653-a2bb-9be095e8dbec" containerID="b86b7d15f4c176266b0718aecba05a65b5320c28c91d1966988c2f5dba901a75" exitCode=0
Jul 20 20:44:46.224251 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:46.223855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7855-139667800716320" event={"ID":"cbe49912-6fde-4653-a2bb-9be095e8dbec","Type":"ContainerDied","Data":"b86b7d15f4c176266b0718aecba05a65b5320c28c91d1966988c2f5dba901a75"}
Jul 20 20:44:47.377218 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.377194    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:47.399084 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.399051    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7855-139667800716320_cbe49912-6fde-4653-a2bb-9be095e8dbec/test-curl-7855-139667800716320/0.log"
Jul 20 20:44:47.422573 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.422534    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:47.424993 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.424972    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7855-139667800716320"]
Jul 20 20:44:47.453665 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.453633    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ppf6\" (UniqueName: \"kubernetes.io/projected/cbe49912-6fde-4653-a2bb-9be095e8dbec-kube-api-access-6ppf6\") pod \"cbe49912-6fde-4653-a2bb-9be095e8dbec\" (UID: \"cbe49912-6fde-4653-a2bb-9be095e8dbec\") "
Jul 20 20:44:47.455824 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.455788    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbe49912-6fde-4653-a2bb-9be095e8dbec-kube-api-access-6ppf6" (OuterVolumeSpecName: "kube-api-access-6ppf6") pod "cbe49912-6fde-4653-a2bb-9be095e8dbec" (UID: "cbe49912-6fde-4653-a2bb-9be095e8dbec"). InnerVolumeSpecName "kube-api-access-6ppf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:44:47.555107 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.555016    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ppf6\" (UniqueName: \"kubernetes.io/projected/cbe49912-6fde-4653-a2bb-9be095e8dbec-kube-api-access-6ppf6\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:47.602042 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.602012    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"]
Jul 20 20:44:47.602579 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.602556    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe49912-6fde-4653-a2bb-9be095e8dbec" containerName="test-curl-7855-139667800716320"
Jul 20 20:44:47.602579 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.602581    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe49912-6fde-4653-a2bb-9be095e8dbec" containerName="test-curl-7855-139667800716320"
Jul 20 20:44:47.602769 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.602705    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe49912-6fde-4653-a2bb-9be095e8dbec" containerName="test-curl-7855-139667800716320"
Jul 20 20:44:47.605974 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.605956    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:47.608304 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.608199    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-628hb\""
Jul 20 20:44:47.611881 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.611854    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"]
Jul 20 20:44:47.656136 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.656063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f4204ee-8e83-4fce-a5cd-8008229ec991-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4\" (UID: \"0f4204ee-8e83-4fce-a5cd-8008229ec991\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:47.757228 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.757189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f4204ee-8e83-4fce-a5cd-8008229ec991-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4\" (UID: \"0f4204ee-8e83-4fce-a5cd-8008229ec991\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:47.757894 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.757875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f4204ee-8e83-4fce-a5cd-8008229ec991-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4\" (UID: \"0f4204ee-8e83-4fce-a5cd-8008229ec991\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:47.923432 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:47.923388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:48.238391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:48.238301    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:48.238391 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:48.238329    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e88d9d69586ce9e8014eb67bb910f515dbefa6a4024a796fa65bc7e4a4b62345"
Jul 20 20:44:48.249714 ip-10-0-128-178 kubenswrapper[2572]: E0720 20:44:48.249677    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7855-139667800716320\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="cbe49912-6fde-4653-a2bb-9be095e8dbec" pod="opendatahub/test-curl-7855-139667800716320"
Jul 20 20:44:48.271808 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:48.271785    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"]
Jul 20 20:44:48.274699 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:44:48.274677    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4204ee_8e83_4fce_a5cd_8008229ec991.slice/crio-23758dba99c4238642ac85420a790a8e002d40b7e10c5a968afccfdf765b34d6 WatchSource:0}: Error finding container 23758dba99c4238642ac85420a790a8e002d40b7e10c5a968afccfdf765b34d6: Status 404 returned error can't find the container with id 23758dba99c4238642ac85420a790a8e002d40b7e10c5a968afccfdf765b34d6
Jul 20 20:44:48.726323 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:48.726290    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe49912-6fde-4653-a2bb-9be095e8dbec" path="/var/lib/kubelet/pods/cbe49912-6fde-4653-a2bb-9be095e8dbec/volumes"
Jul 20 20:44:49.246418 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:49.246330    2572 generic.go:356] "Generic (PLEG): container finished" podID="0f4204ee-8e83-4fce-a5cd-8008229ec991" containerID="16dc41a1cf3b13276c7000774a4001f57a01c952cfe9da06f1daf7dea8ff03aa" exitCode=0
Jul 20 20:44:49.246569 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:49.246418    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4" event={"ID":"0f4204ee-8e83-4fce-a5cd-8008229ec991","Type":"ContainerDied","Data":"16dc41a1cf3b13276c7000774a4001f57a01c952cfe9da06f1daf7dea8ff03aa"}
Jul 20 20:44:49.246569 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:49.246477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4" event={"ID":"0f4204ee-8e83-4fce-a5cd-8008229ec991","Type":"ContainerStarted","Data":"23758dba99c4238642ac85420a790a8e002d40b7e10c5a968afccfdf765b34d6"}
Jul 20 20:44:50.389022 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:50.389000    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:50.481380 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:50.481343    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f4204ee-8e83-4fce-a5cd-8008229ec991-maas-api-service-ca\") pod \"0f4204ee-8e83-4fce-a5cd-8008229ec991\" (UID: \"0f4204ee-8e83-4fce-a5cd-8008229ec991\") "
Jul 20 20:44:50.481713 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:50.481687    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f4204ee-8e83-4fce-a5cd-8008229ec991-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f4204ee-8e83-4fce-a5cd-8008229ec991" (UID: "0f4204ee-8e83-4fce-a5cd-8008229ec991"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:44:50.582275 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:50.582188    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f4204ee-8e83-4fce-a5cd-8008229ec991-maas-api-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\""
Jul 20 20:44:51.259715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:51.259686    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"
Jul 20 20:44:51.259715 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:51.259708    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4" event={"ID":"0f4204ee-8e83-4fce-a5cd-8008229ec991","Type":"ContainerDied","Data":"23758dba99c4238642ac85420a790a8e002d40b7e10c5a968afccfdf765b34d6"}
Jul 20 20:44:51.259957 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:44:51.259772    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23758dba99c4238642ac85420a790a8e002d40b7e10c5a968afccfdf765b34d6"
Jul 20 20:45:00.158567 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.158530    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"]
Jul 20 20:45:00.159026 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.159013    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f4204ee-8e83-4fce-a5cd-8008229ec991" containerName="revoke-keys"
Jul 20 20:45:00.159026 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.159027    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4204ee-8e83-4fce-a5cd-8008229ec991" containerName="revoke-keys"
Jul 20 20:45:00.159102 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.159094    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f4204ee-8e83-4fce-a5cd-8008229ec991" containerName="revoke-keys"
Jul 20 20:45:00.162035 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.162021    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"
Jul 20 20:45:00.165122 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.165098    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-628hb\""
Jul 20 20:45:00.171005 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.170989    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"
Jul 20 20:45:00.177531 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.177508    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"]
Jul 20 20:45:00.524287 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:00.524260    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"]
Jul 20 20:45:00.526238 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:45:00.526213    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a32fca7_e905_4c4d_81a4_107be56fc90d.slice/crio-c83e03e28132b89225de37000a2ac9dbfe37f20b6151a10f346493f767e2f2ce WatchSource:0}: Error finding container c83e03e28132b89225de37000a2ac9dbfe37f20b6151a10f346493f767e2f2ce: Status 404 returned error can't find the container with id c83e03e28132b89225de37000a2ac9dbfe37f20b6151a10f346493f767e2f2ce
Jul 20 20:45:01.322873 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:01.322778    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs" event={"ID":"9a32fca7-e905-4c4d-81a4-107be56fc90d","Type":"ContainerStarted","Data":"bb99c7f24147d9649fe9da1553b74ff811c7134f1212a155aa31a7e291e41069"}
Jul 20 20:45:01.322873 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:01.322831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs" event={"ID":"9a32fca7-e905-4c4d-81a4-107be56fc90d","Type":"ContainerStarted","Data":"c83e03e28132b89225de37000a2ac9dbfe37f20b6151a10f346493f767e2f2ce"}
Jul 20 20:45:01.336656 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:01.336595    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs" podStartSLOduration=1.336576789 podStartE2EDuration="1.336576789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:45:01.336229604 +0000 UTC m=+2925.919460494" watchObservedRunningTime="2026-07-20 20:45:01.336576789 +0000 UTC m=+2925.919807678"
Jul 20 20:45:02.330793 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:02.330760    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a32fca7-e905-4c4d-81a4-107be56fc90d" containerID="bb99c7f24147d9649fe9da1553b74ff811c7134f1212a155aa31a7e291e41069" exitCode=0
Jul 20 20:45:02.331205 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:02.330851    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs" event={"ID":"9a32fca7-e905-4c4d-81a4-107be56fc90d","Type":"ContainerDied","Data":"bb99c7f24147d9649fe9da1553b74ff811c7134f1212a155aa31a7e291e41069"}
Jul 20 20:45:02.695351 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:02.695318    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"]
Jul 20 20:45:02.697796 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:02.697773    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-b15c6d-5psj4"]
Jul 20 20:45:02.725376 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:02.725342    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f4204ee-8e83-4fce-a5cd-8008229ec991" path="/var/lib/kubelet/pods/0f4204ee-8e83-4fce-a5cd-8008229ec991/volumes"
Jul 20 20:45:03.483056 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:03.483030    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"
Jul 20 20:45:04.344301 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:04.344274    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs"
Jul 20 20:45:04.344555 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:04.344309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743005-5vjxs" event={"ID":"9a32fca7-e905-4c4d-81a4-107be56fc90d","Type":"ContainerDied","Data":"c83e03e28132b89225de37000a2ac9dbfe37f20b6151a10f346493f767e2f2ce"}
Jul 20 20:45:04.344555 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:04.344351    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c83e03e28132b89225de37000a2ac9dbfe37f20b6151a10f346493f767e2f2ce"
Jul 20 20:45:38.221360 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:38.221274    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bhqcj_a26be718-040e-426b-995a-b229d07aeaa4/manager/0.log"
Jul 20 20:45:38.337064 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:38.337031    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9d697_2b86b374-6ac7-468e-95e3-13f7d08f619e/manager/0.log"
Jul 20 20:45:38.580059 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:38.579980    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ndvn2_cdefb31a-a504-4945-b71f-61776f9a1731/server/0.log"
Jul 20 20:45:38.815389 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:38.815356    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-dx7q8_52b2355f-8022-4084-ab80-8bad0093772f/copy-manifests/0.log"
Jul 20 20:45:38.822049 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:38.822023    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-dx7q8_52b2355f-8022-4084-ab80-8bad0093772f/manager/0.log"
Jul 20 20:45:39.433004 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:39.432976    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8674778c7c-wbpph_d237c5c7-8345-4662-8d37-e857ee56cdcd/maas-api/0.log"
Jul 20 20:45:39.549053 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:39.549025    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742975-ws248_d3fa6edb-a095-4712-9098-6695c99e65e8/cleanup/0.log"
Jul 20 20:45:39.794259 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:39.794181    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743005-5vjxs_9a32fca7-e905-4c4d-81a4-107be56fc90d/cleanup/0.log"
Jul 20 20:45:39.911684 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:39.911656    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9mfp9_b2eb6b9b-4b8b-4264-9abd-cad924181b55/postgres/0.log"
Jul 20 20:45:40.757841 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:40.757811    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n_4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c/util/0.log"
Jul 20 20:45:40.769307 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:40.769280    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n_4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c/pull/0.log"
Jul 20 20:45:40.778204 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:40.778181    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n_4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c/extract/0.log"
Jul 20 20:45:40.893904 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:40.893869    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724_fed2a53d-1fad-401f-a7f0-0e849501a1a4/pull/0.log"
Jul 20 20:45:40.900883 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:40.900863    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724_fed2a53d-1fad-401f-a7f0-0e849501a1a4/extract/0.log"
Jul 20 20:45:40.907050 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:40.907032    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724_fed2a53d-1fad-401f-a7f0-0e849501a1a4/util/0.log"
Jul 20 20:45:41.033743 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.033630    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4_50cd734a-afcb-4d95-8bab-ca5d88028b94/extract/0.log"
Jul 20 20:45:41.043331 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.043310    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4_50cd734a-afcb-4d95-8bab-ca5d88028b94/util/0.log"
Jul 20 20:45:41.056830 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.056802    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4_50cd734a-afcb-4d95-8bab-ca5d88028b94/pull/0.log"
Jul 20 20:45:41.195774 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.195740    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf_8c0381f4-82dd-4879-9a9a-2dd4db6fc127/util/0.log"
Jul 20 20:45:41.202046 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.202023    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf_8c0381f4-82dd-4879-9a9a-2dd4db6fc127/pull/0.log"
Jul 20 20:45:41.208460 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.208438    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf_8c0381f4-82dd-4879-9a9a-2dd4db6fc127/extract/0.log"
Jul 20 20:45:41.493307 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.493273    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j2zbv_356ba074-fff9-4c44-abcc-f231bf791f2a/manager/0.log"
Jul 20 20:45:41.624251 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.624213    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qhgmc_ee4b4996-3403-4344-bec2-3c0f98982a64/manager/0.log"
Jul 20 20:45:41.865919 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.865889    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qrxrt_1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d/registry-server/0.log"
Jul 20 20:45:41.983681 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:41.983648    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-45pbc_c8240795-0663-42d7-b277-becfe3ecad8e/manager/0.log"
Jul 20 20:45:42.223503 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:42.223422    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zh7d5_325914ec-da01-487a-92df-9356064075e1/manager/0.log"
Jul 20 20:45:42.963624 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:42.963598    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fb5dc8ff-w9qtg_7f4d8b41-6984-47ee-be59-c5ef241b4d59/kube-auth-proxy/0.log"
Jul 20 20:45:43.214143 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:43.214059    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9c4w7_e65d27e5-10a1-4f15-adb0-4098c778e293/payload-pre-processing/0.log"
Jul 20 20:45:43.336165 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:43.336116    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-c6gjw_8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b/payload-processing/0.log"
Jul 20 20:45:43.455712 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:43.455683    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5458484848-8v9pn_59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86/router/0.log"
Jul 20 20:45:43.802711 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:43.802684    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bfrl2_a6c2afe4-a38a-44f9-b60b-8a89ff7cc01d/main/0.log"
Jul 20 20:45:44.021641 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:44.021611    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4j8hx_2c8d56e7-e881-48f4-a4fb-d79c8b234873/main/0.log"
Jul 20 20:45:44.131065 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:44.131037    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzfx4v_1d493e62-cb30-4ab3-99c1-a558b841960e/main/0.log"
Jul 20 20:45:53.216037 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:53.216008    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9hj8b_6fe97ec9-b7e1-496f-add0-f616a228e390/global-pull-secret-syncer/0.log"
Jul 20 20:45:53.431605 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:53.431575    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sz5wh_719b562b-5156-41d3-944a-21f94c3fead4/konnectivity-agent/0.log"
Jul 20 20:45:53.452053 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:53.452030    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-178.ec2.internal_f5414ab3db9e2c55023fc7625a31b52c/haproxy/0.log"
Jul 20 20:45:57.712867 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.712792    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n_4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c/extract/0.log"
Jul 20 20:45:57.734670 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.734644    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n_4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c/util/0.log"
Jul 20 20:45:57.756073 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.756049    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596jv6n_4710d2b6-01c5-4b10-bcd8-f19e3a06ae4c/pull/0.log"
Jul 20 20:45:57.793262 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.793233    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724_fed2a53d-1fad-401f-a7f0-0e849501a1a4/extract/0.log"
Jul 20 20:45:57.843669 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.843638    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724_fed2a53d-1fad-401f-a7f0-0e849501a1a4/util/0.log"
Jul 20 20:45:57.868447 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.868415    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02z724_fed2a53d-1fad-401f-a7f0-0e849501a1a4/pull/0.log"
Jul 20 20:45:57.899591 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.899561    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4_50cd734a-afcb-4d95-8bab-ca5d88028b94/extract/0.log"
Jul 20 20:45:57.920443 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.920415    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4_50cd734a-afcb-4d95-8bab-ca5d88028b94/util/0.log"
Jul 20 20:45:57.939835 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.939809    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372gd4_50cd734a-afcb-4d95-8bab-ca5d88028b94/pull/0.log"
Jul 20 20:45:57.969213 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.969148    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf_8c0381f4-82dd-4879-9a9a-2dd4db6fc127/extract/0.log"
Jul 20 20:45:57.991258 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:57.991235    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf_8c0381f4-82dd-4879-9a9a-2dd4db6fc127/util/0.log"
Jul 20 20:45:58.013053 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:58.013027    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19qjtf_8c0381f4-82dd-4879-9a9a-2dd4db6fc127/pull/0.log"
Jul 20 20:45:58.529943 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:58.529917    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j2zbv_356ba074-fff9-4c44-abcc-f231bf791f2a/manager/0.log"
Jul 20 20:45:58.555118 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:58.555088    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qhgmc_ee4b4996-3403-4344-bec2-3c0f98982a64/manager/0.log"
Jul 20 20:45:58.628215 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:58.628185    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qrxrt_1c46eaaa-bcab-4ab0-9fd7-c65f3749eb6d/registry-server/0.log"
Jul 20 20:45:58.780313 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:58.780228    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-45pbc_c8240795-0663-42d7-b277-becfe3ecad8e/manager/0.log"
Jul 20 20:45:58.894803 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:45:58.894773    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zh7d5_325914ec-da01-487a-92df-9356064075e1/manager/0.log"
Jul 20 20:46:00.674222 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:00.674189    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-hcst6_4bbe953b-222d-480e-8a1d-db3bf388f7c9/cluster-monitoring-operator/0.log"
Jul 20 20:46:00.828668 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:00.828632    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fm6mp_e91712e2-7a9f-4b2e-90a6-6d171a9c2e94/node-exporter/0.log"
Jul 20 20:46:00.851759 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:00.851715    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fm6mp_e91712e2-7a9f-4b2e-90a6-6d171a9c2e94/kube-rbac-proxy/0.log"
Jul 20 20:46:00.874586 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:00.874560    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fm6mp_e91712e2-7a9f-4b2e-90a6-6d171a9c2e94/init-textfile/0.log"
Jul 20 20:46:01.414850 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:01.414821    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69ff497588-6jlmq_4b6c80cf-c71e-43cc-8067-25d16a074edc/telemeter-client/0.log"
Jul 20 20:46:01.434420 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:01.434392    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69ff497588-6jlmq_4b6c80cf-c71e-43cc-8067-25d16a074edc/reload/0.log"
Jul 20 20:46:01.453605 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:01.453582    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69ff497588-6jlmq_4b6c80cf-c71e-43cc-8067-25d16a074edc/kube-rbac-proxy/0.log"
Jul 20 20:46:02.721542 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.721509    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-kjwp5_26a48c4d-665f-4265-9fc3-ca5602e33a7e/networking-console-plugin/0.log"
Jul 20 20:46:02.921382 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.921347    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"]
Jul 20 20:46:02.921888 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.921870    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a32fca7-e905-4c4d-81a4-107be56fc90d" containerName="cleanup"
Jul 20 20:46:02.921888 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.921889    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a32fca7-e905-4c4d-81a4-107be56fc90d" containerName="cleanup"
Jul 20 20:46:02.922024 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.921960    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a32fca7-e905-4c4d-81a4-107be56fc90d" containerName="cleanup"
Jul 20 20:46:02.925056 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.925041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:02.927216 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.927197    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7mjff\"/\"kube-root-ca.crt\""
Jul 20 20:46:02.927885 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.927864    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7mjff\"/\"openshift-service-ca.crt\""
Jul 20 20:46:02.927987 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.927864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7mjff\"/\"default-dockercfg-frpwq\""
Jul 20 20:46:02.933761 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:02.933709    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"]
Jul 20 20:46:03.042569 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.042466    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fnv8\" (UniqueName: \"kubernetes.io/projected/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-kube-api-access-8fnv8\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.042569 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.042510    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-podres\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.042847 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.042604    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-proc\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.042847 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.042637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-sys\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.042847 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.042714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-lib-modules\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.143885 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.143848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fnv8\" (UniqueName: \"kubernetes.io/projected/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-kube-api-access-8fnv8\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.143885 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.143888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-podres\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.143936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-proc\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.143967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-sys\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.144049    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-sys\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.144055    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-proc\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.144057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-lib-modules\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144135 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.144082    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-podres\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.144363 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.144167    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-lib-modules\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.150817 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.150791    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fnv8\" (UniqueName: \"kubernetes.io/projected/cbd1bbd3-d78b-44dd-8c7f-0f600ef63024-kube-api-access-8fnv8\") pod \"perf-node-gather-daemonset-jgwq7\" (UID: \"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.235518 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.235485    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.371750 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.371709    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"]
Jul 20 20:46:03.373360 ip-10-0-128-178 kubenswrapper[2572]: W0720 20:46:03.373329    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbd1bbd3_d78b_44dd_8c7f_0f600ef63024.slice/crio-c8dc814e79631dba223cb90c6c0db6c1e6905128164481b37b009cfa73ed97d0 WatchSource:0}: Error finding container c8dc814e79631dba223cb90c6c0db6c1e6905128164481b37b009cfa73ed97d0: Status 404 returned error can't find the container with id c8dc814e79631dba223cb90c6c0db6c1e6905128164481b37b009cfa73ed97d0
Jul 20 20:46:03.382524 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.382504    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:46:03.387537 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.387518    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/2.log"
Jul 20 20:46:03.694042 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.694004    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7" event={"ID":"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024","Type":"ContainerStarted","Data":"8fa1a7f13675be6f5a8e40bee4d7fbbbf70d9b1226b2f84c15edf8cbb5cd3438"}
Jul 20 20:46:03.694224 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.694059    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7" event={"ID":"cbd1bbd3-d78b-44dd-8c7f-0f600ef63024","Type":"ContainerStarted","Data":"c8dc814e79631dba223cb90c6c0db6c1e6905128164481b37b009cfa73ed97d0"}
Jul 20 20:46:03.694224 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.694090    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:03.709548 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.709496    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7" podStartSLOduration=1.7094798199999999 podStartE2EDuration="1.70947982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:46:03.7083958 +0000 UTC m=+2988.291626688" watchObservedRunningTime="2026-07-20 20:46:03.70947982 +0000 UTC m=+2988.292710707"
Jul 20 20:46:03.945934 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:03.945852    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-484mh_1194b684-4a02-4d92-800b-0d4fca7bb2fe/download-server/0.log"
Jul 20 20:46:04.608225 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:04.608190    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-stftf_d2c32f51-016d-419b-b2c1-19d1c71af987/volume-data-source-validator/0.log"
Jul 20 20:46:05.721564 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:05.721538    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q8gn8_4e992044-c007-471a-b45d-2214076982eb/dns/0.log"
Jul 20 20:46:05.741820 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:05.741790    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q8gn8_4e992044-c007-471a-b45d-2214076982eb/kube-rbac-proxy/0.log"
Jul 20 20:46:05.764832 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:05.764803    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9h22n_8c9992d0-737f-460d-91e2-c99281caa72b/dns-node-resolver/0.log"
Jul 20 20:46:06.379964 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:06.379928    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fzhh6_e3fc6eea-f7e9-49a0-a320-62d3e65f9fb4/node-ca/0.log"
Jul 20 20:46:07.591422 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:07.591394    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fb5dc8ff-w9qtg_7f4d8b41-6984-47ee-be59-c5ef241b4d59/kube-auth-proxy/0.log"
Jul 20 20:46:07.706629 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:07.706602    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9c4w7_e65d27e5-10a1-4f15-adb0-4098c778e293/payload-pre-processing/0.log"
Jul 20 20:46:07.732770 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:07.732743    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-c6gjw_8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b/payload-processing/0.log"
Jul 20 20:46:07.756268 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:07.756231    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5458484848-8v9pn_59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86/router/0.log"
Jul 20 20:46:08.453338 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:08.453312    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wph6n_f362015d-26e7-4cb2-9dda-100e6f42d877/serve-healthcheck-canary/0.log"
Jul 20 20:46:08.972417 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:08.972384    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2d4nx_7dbf6118-6ad4-4780-8f5c-4034bdb30e25/insights-operator/0.log"
Jul 20 20:46:08.973124 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:08.972869    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2d4nx_7dbf6118-6ad4-4780-8f5c-4034bdb30e25/insights-operator/1.log"
Jul 20 20:46:09.069032 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:09.069002    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6ctkx_1e0c7885-61aa-4f29-995b-aea292b196ff/kube-rbac-proxy/0.log"
Jul 20 20:46:09.094616 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:09.094580    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6ctkx_1e0c7885-61aa-4f29-995b-aea292b196ff/exporter/0.log"
Jul 20 20:46:09.115741 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:09.115709    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6ctkx_1e0c7885-61aa-4f29-995b-aea292b196ff/extractor/0.log"
Jul 20 20:46:09.710290 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:09.710267    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-jgwq7"
Jul 20 20:46:11.358571 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:11.358536    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bhqcj_a26be718-040e-426b-995a-b229d07aeaa4/manager/0.log"
Jul 20 20:46:11.550786 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:11.550761    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9d697_2b86b374-6ac7-468e-95e3-13f7d08f619e/manager/0.log"
Jul 20 20:46:11.728774 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:11.728680    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ndvn2_cdefb31a-a504-4945-b71f-61776f9a1731/server/0.log"
Jul 20 20:46:11.849924 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:11.849895    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-dx7q8_52b2355f-8022-4084-ab80-8bad0093772f/manager/0.log"
Jul 20 20:46:11.870227 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:11.870202    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-dx7q8_52b2355f-8022-4084-ab80-8bad0093772f/copy-manifests/0.log"
Jul 20 20:46:13.564771 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:13.564741    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fb5dc8ff-w9qtg_7f4d8b41-6984-47ee-be59-c5ef241b4d59/kube-auth-proxy/0.log"
Jul 20 20:46:13.657402 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:13.657372    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9c4w7_e65d27e5-10a1-4f15-adb0-4098c778e293/payload-pre-processing/0.log"
Jul 20 20:46:13.676364 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:13.676336    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-c6gjw_8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b/payload-processing/0.log"
Jul 20 20:46:13.688670 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:13.688650    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5458484848-8v9pn_59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86/router/0.log"
Jul 20 20:46:15.161040 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:15.161008    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fb5dc8ff-w9qtg_7f4d8b41-6984-47ee-be59-c5ef241b4d59/kube-auth-proxy/0.log"
Jul 20 20:46:15.263564 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:15.263537    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9c4w7_e65d27e5-10a1-4f15-adb0-4098c778e293/payload-pre-processing/0.log"
Jul 20 20:46:15.287620 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:15.287595    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-c6gjw_8a7b0e2b-4b81-493d-bcf4-da5989eb7d7b/payload-processing/0.log"
Jul 20 20:46:15.300603 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:15.300579    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5458484848-8v9pn_59ebc42a-ddc7-4a6a-95f1-cc8a3e382b86/router/0.log"
Jul 20 20:46:16.993386 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:16.993357    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:46:17.024841 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:17.024816    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-rtjdf_9925e645-3cc0-4d07-b219-eb32d0710984/console-operator/1.log"
Jul 20 20:46:18.837583 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:18.837551    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-ptz79_9f9d45ea-8cc0-46ba-b7b3-da28821e45f1/kube-storage-version-migrator-operator/1.log"
Jul 20 20:46:18.838760 ip-10-0-128-178 kubenswrapper[2572]: I0720 20:46:18.838566    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-ptz79_9f9d45ea-8cc0-46ba-b7b3-da28821e45f1/kube-storage-version-migrator-operator/0.log"