Jul 23 13:05:23.409774 ip-10-0-132-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 13:05:23.409787 ip-10-0-132-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 13:05:23.409796 ip-10-0-132-73 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 13:05:23.410100 ip-10-0-132-73 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 13:05:33.596572 ip-10-0-132-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 13:05:33.596589 ip-10-0-132-73 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot de3f1a79c0ad4d3abfab0ce7859d08ee --
Jul 23 13:07:09.143144 ip-10-0-132-73 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.543325    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547814    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547829    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547833    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547836    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547840    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547843    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547851    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547854    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:09.599921 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547873    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547876    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547879    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547882    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547885    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547887    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547894    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547897    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547900    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547902    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547906    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547909    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547916    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547918    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547921    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547924    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547928    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547939    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547942    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:09.602761 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547945    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547948    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547955    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547958    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547961    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547964    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547966    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547973    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547976    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547979    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547981    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547984    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547987    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547990    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547996    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.547999    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548002    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548004    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548007    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548015    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:09.606160 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548018    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548020    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548023    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548026    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548028    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548035    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548038    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548040    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548043    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548046    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548049    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548051    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548058    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548061    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548065    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548068    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548070    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548073    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548079    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548081    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:09.608907 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548084    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548087    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548090    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548092    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548095    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548101    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548104    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548106    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548111    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548115    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548123    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548126    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548129    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548132    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548134    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548137    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548140    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548142    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548145    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:09.612312 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548147    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548155    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548158    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548161    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548165    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548173    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548176    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548179    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548182    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548186    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548189    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548196    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.548200    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549098    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549107    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549111    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549115    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549122    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549125    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:09.615081 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549128    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549131    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549133    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549137    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549144    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549147    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549149    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549152    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549154    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549157    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549160    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549168    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549172    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549175    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549178    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549181    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549190    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549194    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549196    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:09.618748 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549200    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549207    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549210    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549213    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549216    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549218    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549221    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549224    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549230    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549233    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549235    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549238    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549241    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549244    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549246    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549253    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549256    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549259    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549262    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549264    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:09.621535 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549267    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:09.620399 ip-10-0-132-73 systemd[1]: Started Kubernetes Kubelet.
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549270    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549272    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549275    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549282    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549285    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549288    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549290    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549293    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549295    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549302    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549305    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549307    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549309    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549312    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549315    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549321    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549324    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549326    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:09.626507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549329    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549332    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549334    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549337    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549343    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549345    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549348    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549350    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549353    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549356    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549358    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549365    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549368    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549370    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549373    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549375    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549378    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549380    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549383    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549389    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:09.630279 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549391    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549394    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549397    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549399    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549402    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549404    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549411    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549414    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549419    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549422    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549424    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549427    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549433    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549436    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549438    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549907    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549913    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549916    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549919    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:09.635585 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549925    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549928    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549931    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549933    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549936    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549939    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549942    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549949    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549952    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549954    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549957    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549960    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549962    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549969    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549971    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549974    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549977    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549979    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549981    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:09.638438 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549988    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549991    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549995    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.549998    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550001    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550003    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550006    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550009    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550012    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550014    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550021    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550025    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550028    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550030    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550033    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550039    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550042    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550044    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550049    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550052    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:09.642729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550059    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550061    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550064    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550067    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550069    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550072    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550078    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550081    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550084    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550086    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550088    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550091    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550093    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550096    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550101    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550104    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550106    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550109    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550111    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550114    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:09.647173 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550117    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550119    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550122    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550126    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550130    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550133    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550136    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550139    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550142    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550145    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550148    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550152    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550155    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550157    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550163    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550166    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550168    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550172    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550175    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:09.651755 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550178    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550181    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550184    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550190    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550193    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550196    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550198    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550203    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550206    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550208    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550211    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550214    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550217    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550223    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550226    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550228    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.550232    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550318    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550325    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550336    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550340    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 13:07:09.655918 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550344    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550348    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550356    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550360    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550364    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550367    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550371    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550378    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550381    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550384    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550387    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550390    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550393    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550401    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550883    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550887    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550891    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550894    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550902    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550906    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550909    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550913    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550916    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550923    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 13:07:09.659551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550926    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550929    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550932    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550936    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550941    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550947    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550950    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550953    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550956    2564 flags.go:64] FLAG: --enable-server="true"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550959    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550963    2564 flags.go:64] FLAG: --event-burst="100"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550966    2564 flags.go:64] FLAG: --event-qps="50"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550969    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550982    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550986    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550989    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.550992    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551000    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551003    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551006    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551021    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551024    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551027    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551030    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551033    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 13:07:09.822026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551036    2564 flags.go:64] FLAG: --feature-gates=""
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551045    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551048    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551051    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551054    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551057    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551060    2564 flags.go:64] FLAG: --help="false"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551067    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-132-73.ec2.internal"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551070    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551073    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551077    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551080    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551088    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551091    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551094    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551097    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551100    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551102    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551110    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551113    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551115    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551124    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551131    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551134    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 13:07:09.824615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551137    2564 flags.go:64] FLAG: --lock-file=""
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551140    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551143    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551146    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551155    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551158    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551161    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551164    2564 flags.go:64] FLAG: --logging-format="text"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551167    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551171    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551178    2564 flags.go:64] FLAG: --manifest-url=""
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551181    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551185    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551188    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551192    2564 flags.go:64] FLAG: --max-pods="110"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551199    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551202    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551205    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551209    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551212    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551219    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551222    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551230    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551233    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551239    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 13:07:09.832270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551242    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551245    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551251    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551254    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551261    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551270    2564 flags.go:64] FLAG: --port="10250"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551273    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551276    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f092ea06b6a42243"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551283    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551286    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551289    2564 flags.go:64] FLAG: --register-node="true"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551292    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551296    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551302    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551305    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551308    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551312    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551316    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551319    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551326    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551329    2564 flags.go:64] FLAG: --runonce="false"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551332    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551335    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551338    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551341    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 13:07:09.833430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551346    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551349    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551355    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551358    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551361    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551364    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551367    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551370    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551377    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551380    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551383    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551388    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551390    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551399    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551404    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551407    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551410    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551413    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551416    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551423    2564 flags.go:64] FLAG: --v="2"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551428    2564 flags.go:64] FLAG: --version="false"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551432    2564 flags.go:64] FLAG: --vmodule=""
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551435    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.551438    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 13:07:09.835057 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551588    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551596    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551599    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551602    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551604    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551607    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551610    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551616    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551621    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551623    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551626    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551629    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551631    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551638    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551641    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551645    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551649    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551652    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551659    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:09.836103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551663    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551666    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551669    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551682    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551685    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551687    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551690    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551692    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551695    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551698    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551704    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551706    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551710    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551716    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551719    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551721    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551724    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551726    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551733    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:09.837117 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551735    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551738    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551742    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551745    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551748    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551754    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551757    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551760    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551762    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551765    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551768    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551770    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551777    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551779    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551782    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551784    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551787    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551800    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551802    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551805    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:09.837729 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551808    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551810    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551813    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551819    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551822    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551825    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551829    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551831    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551834    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551836    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551843    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551845    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551848    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551850    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551856    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551873    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551876    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551883    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551885    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551888    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:09.838678 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551891    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551893    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551896    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551902    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551905    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551908    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551910    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551913    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551915    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551918    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551931    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551934    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551936    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551939    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551945    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551948    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551951    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551953    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551957    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551960    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:09.839288 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.551986    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.552676    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.559557    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.559573    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.560337    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.560345    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560402    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560407    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560410    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560413    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560416    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560419    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560421    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560424    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560426    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:09.840027 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560429    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560431    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560435    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560439    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560442    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560445    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560448    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560451    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560454    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560456    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560459    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560461    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560464    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560467    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560470    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560473    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560477    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560480    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560482    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:09.840455 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560485    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560488    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560491    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560493    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560496    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560498    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560501    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560503    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560506    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560509    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560511    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560513    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560516    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560519    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560521    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560524    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560526    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560528    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560531    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560534    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:09.841064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560536    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560539    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560542    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560544    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560547    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560549    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560551    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560554    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560559    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560562    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560565    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560569    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560572    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560575    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560578    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560581    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560584    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560586    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560589    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:10.084780 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560592    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560594    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560598    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560601    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560604    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560607    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560610    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560613    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560615    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560618    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560620    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560623    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560625    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560628    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560630    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560633    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560635    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560638    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560640    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560643    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:10.085474 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560645    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560649    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560653    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560656    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560658    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560661    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560663    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560666    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560669    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560671    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560674    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560676    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.560681    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560791    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560795    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:07:10.086277 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560798    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560802    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560806    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560809    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560812    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560815    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560817    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560821    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560823    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560826    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560829    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560831    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560834    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560837    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560839    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560842    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560844    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560848    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560851    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:07:10.087513 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560870    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560873    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560875    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560878    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560881    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560883    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560886    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560889    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560891    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560894    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560896    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560899    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560901    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560904    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560907    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560909    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560911    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560914    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560916    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560919    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:07:10.088167 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560921    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560924    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560927    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560934    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560937    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560940    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560942    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560945    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560947    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560950    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560952    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560955    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560960    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560962    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560965    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560968    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560970    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560973    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560975    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560978    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:07:10.088749 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560981    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560983    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560986    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560988    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560991    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560993    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560996    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.560998    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561001    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561004    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561014    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561018    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561020    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561023    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561025    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561028    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561030    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561033    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561035    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561038    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:07:10.090464 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561040    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561043    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561045    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561047    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561052    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561055    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561057    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561060    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561062    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561065    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561068    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561072    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561075    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561079    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561081    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561084    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561087    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:07:10.091103 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:09.561090    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.561095    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.561197    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.564049    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.565273    2564 server.go:1019] "Starting client certificate rotation"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.565383    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.566077    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.567886    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.574100    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.585216    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.587126    2564 log.go:25] "Validated CRI v1 image API"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.587916    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 13:07:10.092381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.590214    2564 fs.go:135] Filesystem UUIDs: map[3b2f6678-1fd6-45bf-9a05-74eceb7baba8:/dev/nvme0n1p3 632bafd7-0778-48fe-b912-cffa9b8f3500:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 23 13:07:10.092813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.590241    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.601036    2564 manager.go:216] Machine: {Timestamp:2026-07-23 13:07:09.595916662 +0000 UTC m=+0.333149972 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102857 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a668683cabdb34222333b8893a96e SystemUUID:ec2a6686-83ca-bdb3-4222-333b8893a96e BootID:de3f1a79-c0ad-4d3a-bfab-0ce7859d08ee Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:e2:b4:36:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:e2:b4:36:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:71:e9:96:ad:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.601152    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.601251    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.604315    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.604347    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.605012    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.605023    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 13:07:10.093663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.605039    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.605831    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.606325    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.607089    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610081    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610204    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610233    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610244    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610257    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610266    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610276    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610655    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.610673    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.613246    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.614614    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.614650    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615314    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615330    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615336    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615341    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615350    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615355    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615364    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615373    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615380    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615386    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615394    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.615400    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.616355    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.616364    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.619587    2564 server.go:1268] "Started kubelet"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.619683    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.619769    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.619806    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.622538    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.623176    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.623269    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.623284    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.623933    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 13:07:10.094090 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.625809    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.626953    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-73.ec2.internal.18c4ed15a8514cf6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-73.ec2.internal,UID:ip-10-0-132-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-73.ec2.internal,},FirstTimestamp:2026-07-23 13:07:09.619555574 +0000 UTC m=+0.356788887,LastTimestamp:2026-07-23 13:07:09.619555574 +0000 UTC m=+0.356788887,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-73.ec2.internal,}"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.630810    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.630814    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.630985    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631535    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631554    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631738    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631741    2564 factory.go:55] Registering systemd factory
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631757    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631770    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.631745    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.632017    2564 factory.go:153] Registering CRI-O factory
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.632032    2564 factory.go:223] Registration of the crio container factory successfully
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.632079    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.632102    2564 factory.go:103] Registering Raw factory
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.632116    2564 manager.go:1196] Started watching for new ooms in manager
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.632465    2564 manager.go:349] Starting recovery of all containers
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.638948    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.638948    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.644460    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bqqwf"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.645036    2564 manager.go:354] Recovery completed
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.650417    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bqqwf"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.651000    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.652970    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.653005    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.653024    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.653598    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.653604    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.653609    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.653628    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.654412    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.095146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.654443    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.654471    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.654793    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-73.ec2.internal.18c4ed15aa4f7545  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-73.ec2.internal,UID:ip-10-0-132-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-73.ec2.internal,},FirstTimestamp:2026-07-23 13:07:09.652989253 +0000 UTC m=+0.390222564,LastTimestamp:2026-07-23 13:07:09.652989253 +0000 UTC m=+0.390222564,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-73.ec2.internal,}"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.655077    2564 policy_none.go:49] "None policy: Start"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.655093    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.655106    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.656172    2564 policy_none.go:47] "Start"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684439    2564 manager.go:337] "Starting Device Plugin manager"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.684472    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684481    2564 server.go:87] "Starting device plugin registration server"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684678    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684687    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684776    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684856    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.684885    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.685369    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.685407    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.761836    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.763088    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.763133    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.763161    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.763202    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.765846    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.785747    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.786744    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.786774    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.786787    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.786809    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.798059    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.798078    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-73.ec2.internal\": node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.820809    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.863947    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"]
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.864017    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.096026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.865657    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.865682    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.865692    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.867800    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.867908    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.867941    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.868465    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.868471    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.868491    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.868522    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.868492    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.868571    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.870553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.870573    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.871342    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.871360    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.871374    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.903388    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-73.ec2.internal\" not found" node="ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.906565    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-73.ec2.internal\" not found" node="ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:09.921967    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.933361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b09537983e90b5d8296ae811288f4fa5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-73.ec2.internal\" (UID: \"b09537983e90b5d8296ae811288f4fa5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.933382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11310718f4a61f3c5acea86e6346074a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"11310718f4a61f3c5acea86e6346074a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:09.933401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11310718f4a61f3c5acea86e6346074a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"11310718f4a61f3c5acea86e6346074a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.022700    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.097096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.034074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b09537983e90b5d8296ae811288f4fa5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-73.ec2.internal\" (UID: \"b09537983e90b5d8296ae811288f4fa5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097929 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.034104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11310718f4a61f3c5acea86e6346074a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"11310718f4a61f3c5acea86e6346074a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097929 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.034129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11310718f4a61f3c5acea86e6346074a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"11310718f4a61f3c5acea86e6346074a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097929 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.034172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11310718f4a61f3c5acea86e6346074a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"11310718f4a61f3c5acea86e6346074a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097929 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.034211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b09537983e90b5d8296ae811288f4fa5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-73.ec2.internal\" (UID: \"b09537983e90b5d8296ae811288f4fa5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.097929 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.034214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11310718f4a61f3c5acea86e6346074a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"11310718f4a61f3c5acea86e6346074a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.152884 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.123521    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.214761 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.205108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.214761 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.210973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:10.225062 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.224362    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.382331 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.324900    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.543158 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.425374    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.543158 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.526474    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.737199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.564542    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 13:07:10.737199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.564677    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 13:07:10.737199 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.627040    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.737199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.656134    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 13:02:10 +0000 UTC" deadline="2028-02-04 08:35:19.707448104 +0000 UTC"
Jul 23 13:07:10.737199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.656164    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13459h28m9.051288276s"
Jul 23 13:07:10.737199 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.727980    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.910697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.770656    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:10.910697 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.828514    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:10.910697 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:10.857545    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11310718f4a61f3c5acea86e6346074a.slice/crio-11f98336efbb211d8437805f91347932d179f5c753db12fc903ecbd2ba0431c6 WatchSource:0}: Error finding container 11f98336efbb211d8437805f91347932d179f5c753db12fc903ecbd2ba0431c6: Status 404 returned error can't find the container with id 11f98336efbb211d8437805f91347932d179f5c753db12fc903ecbd2ba0431c6
Jul 23 13:07:10.910697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.863183    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:07:10.910697 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:10.869111    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09537983e90b5d8296ae811288f4fa5.slice/crio-5abfe79048f2535942e2e4c7cf4ddd32299109a4185f324128363f22396842f7 WatchSource:0}: Error finding container 5abfe79048f2535942e2e4c7cf4ddd32299109a4185f324128363f22396842f7: Status 404 returned error can't find the container with id 5abfe79048f2535942e2e4c7cf4ddd32299109a4185f324128363f22396842f7
Jul 23 13:07:10.910697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:10.883886    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:11.070504 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:10.929030    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:11.070504 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.035563    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
Jul 23 13:07:11.257643 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.100803    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:11.257643 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.131128    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:11.257643 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.145536    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:07:11.257643 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.146620    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
Jul 23 13:07:11.257643 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.153540    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:07:11.611970 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.611937    2564 apiserver.go:52] "Watching apiserver"
Jul 23 13:07:11.620241 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.619744    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 13:07:11.621486 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.621451    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5xkxj","openshift-multus/multus-m6kfn","openshift-network-diagnostics/network-check-target-kxq2v","openshift-network-operator/iptables-alerter-58ndm","openshift-ovn-kubernetes/ovnkube-node-5fdfk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs","openshift-dns/node-resolver-mfjz8","openshift-image-registry/node-ca-vjk79","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-s7n2m","openshift-multus/network-metrics-daemon-8dz4q","kube-system/global-pull-secret-syncer-xzsbl","kube-system/konnectivity-agent-qlfxh"]
Jul 23 13:07:11.624747 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.624723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.626818 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.626761    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 13:07:11.627294 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.627115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pxtx2\""
Jul 23 13:07:11.627294 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.627245    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.627479 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.627407    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.627680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.627651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.627772 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.627746    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:11.630255 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.630235    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.632562 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.631916    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 13:07:11.632648 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.632614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:11.632725 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.632683    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:11.632930 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.632910    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 13:07:11.633172 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.633151    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.633294 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.633204    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 13:07:11.633413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.633377    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.633467 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.633458    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jw9mv\""
Jul 23 13:07:11.634968 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.634795    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.637070 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.636937    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.637170 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.637155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpt7v\""
Jul 23 13:07:11.637244 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.637179    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.637361 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.637339    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 13:07:11.637555 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.637535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640150    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640387    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640421    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640449    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640500    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2lrkt\""
Jul 23 13:07:11.640780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.640591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.642467 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.642448    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.643024 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.642949    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dzzrm\""
Jul 23 13:07:11.643158 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643140    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.643344 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643326    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643523    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-etc-kubernetes\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-registration-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-daemon-config\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6r58\" (UniqueName: \"kubernetes.io/projected/45386175-ba18-43a4-bcc6-e7a34f265e08-kube-api-access-f6r58\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-sys-fs\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-system-cni-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-cnibin\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-multus-certs\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-socket-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.643817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643810    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b1320da-c6b8-408a-b1a2-19d69a83827e-kubelet-config\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b1320da-c6b8-408a-b1a2-19d69a83827e-dbus\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-netns\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.643970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvxh\" (UniqueName: \"kubernetes.io/projected/15403431-5cfe-4f02-8c15-7d45807761e1-kube-api-access-hfvxh\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-os-release\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-k8s-cni-cncf-io\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-cni-bin\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-socket-dir-parent\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-cni-multus\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-conf-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-device-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.644656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-cni-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.645493 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45386175-ba18-43a4-bcc6-e7a34f265e08-cni-binary-copy\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.645493 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-kubelet\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.645493 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-hostroot\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.645493 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644683    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 13:07:11.645493 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.644935    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 13:07:11.645493 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.645378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pqzwf\""
Jul 23 13:07:11.645887 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.645852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.648256 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.648234    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.648352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.648338    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.648418 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.648349    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-22tcb\""
Jul 23 13:07:11.648760 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.648738    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.653271 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.652484    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tq4mm\""
Jul 23 13:07:11.653271 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.652661    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 13:07:11.653271 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.652798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.654954 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.653639    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 13:07:11.655516 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.655492    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 13:07:11.655600 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.655571    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9ft2\""
Jul 23 13:07:11.655954 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.655915    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 13:07:11.656049 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.656026    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:11.656138 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.656113    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:11.672496 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.672472    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xjflx"
Jul 23 13:07:11.681034 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.681016    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xjflx"
Jul 23 13:07:11.733409 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.733381    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 13:07:11.745391 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cnibin\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-etc-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-env-overrides\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovn-node-metrics-cert\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6b9s\" (UniqueName: \"kubernetes.io/projected/2e8532e3-ac35-4c72-9c45-38326764b1fa-kube-api-access-q6b9s\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvxh\" (UniqueName: \"kubernetes.io/projected/15403431-5cfe-4f02-8c15-7d45807761e1-kube-api-access-hfvxh\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-k8s-cni-cncf-io\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.745733    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-cni-bin\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-k8s-cni-cncf-io\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-cni-bin\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746032 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.745818    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:07:12.245792905 +0000 UTC m=+2.983026217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-os-release\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-socket-dir-parent\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-run-netns\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.745992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746017    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qc5\" (UniqueName: \"kubernetes.io/projected/3d86db36-c12c-4fcc-bb73-98670e8c48d8-kube-api-access-99qc5\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a174b199-278f-49d9-b8e5-d712bccd443d-agent-certs\") pod \"konnectivity-agent-qlfxh\" (UID: \"a174b199-278f-49d9-b8e5-d712bccd443d\") " pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-modprobe-d\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-socket-dir-parent\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-lib-modules\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-var-lib-kubelet\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45386175-ba18-43a4-bcc6-e7a34f265e08-cni-binary-copy\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-systemd-units\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.746669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-cni-netd\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-kubernetes\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysctl-d\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-sys\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cd926a6-c25e-48b6-b4a4-289a238fd94a-tmp\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-hostroot\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysctl-conf\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-tuned\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-hostroot\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrvw\" (UniqueName: \"kubernetes.io/projected/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-kube-api-access-vbrvw\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d130417-eced-44f2-b230-991da7816f1d-host-slash\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-system-cni-dir\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-host\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.747393 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls474\" (UniqueName: \"kubernetes.io/projected/8cd926a6-c25e-48b6-b4a4-289a238fd94a-kube-api-access-ls474\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-daemon-config\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6r58\" (UniqueName: \"kubernetes.io/projected/45386175-ba18-43a4-bcc6-e7a34f265e08-kube-api-access-f6r58\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fb22276-523d-40bb-a08d-797dee02ef5b-host\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-run\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45386175-ba18-43a4-bcc6-e7a34f265e08-cni-binary-copy\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-multus-certs\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746921    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-multus-certs\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.746970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-systemd\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b1320da-c6b8-408a-b1a2-19d69a83827e-kubelet-config\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjj7\" (UniqueName: \"kubernetes.io/projected/0d130417-eced-44f2-b230-991da7816f1d-kube-api-access-svjj7\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-var-lib-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b1320da-c6b8-408a-b1a2-19d69a83827e-kubelet-config\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.748152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-os-release\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-log-socket\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-daemon-config\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-cni-bin\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-os-release\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-cni-multus\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-conf-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-cni-multus\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fb22276-523d-40bb-a08d-797dee02ef5b-serviceca\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-conf-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42j7z\" (UniqueName: \"kubernetes.io/projected/0fb22276-523d-40bb-a08d-797dee02ef5b-kube-api-access-42j7z\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a174b199-278f-49d9-b8e5-d712bccd443d-konnectivity-ca\") pod \"konnectivity-agent-qlfxh\" (UID: \"a174b199-278f-49d9-b8e5-d712bccd443d\") " pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysconfig\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.748731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-hosts-file\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-device-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-device-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-cni-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-kubelet\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxnd\" (UniqueName: \"kubernetes.io/projected/d17da8d2-de85-43fb-ae9d-ba765c9a330b-kube-api-access-hqxnd\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-node-log\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovnkube-config\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-systemd\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-tmp-dir\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-kubelet\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-etc-kubernetes\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-var-lib-kubelet\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-multus-cni-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-registration-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.747987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-etc-kubernetes\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-slash\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-ovn\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovnkube-script-lib\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-registration-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-sys-fs\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-system-cni-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-cnibin\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-sys-fs\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d130417-eced-44f2-b230-991da7816f1d-iptables-alerter-script\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.749680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-cnibin\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-socket-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-system-cni-dir\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b1320da-c6b8-408a-b1a2-19d69a83827e-dbus\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-netns\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b1320da-c6b8-408a-b1a2-19d69a83827e-dbus\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15403431-5cfe-4f02-8c15-7d45807761e1-socket-dir\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.750129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.748492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45386175-ba18-43a4-bcc6-e7a34f265e08-host-run-netns\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.752587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.752566    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:07:11.754912 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.754862    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:11.754912 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.754914    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:11.755040 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.754929    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:11.755040 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.754993    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 13:07:11.755134 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.755074    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:12.255055897 +0000 UTC m=+2.992289223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:11.758743 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.758720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvxh\" (UniqueName: \"kubernetes.io/projected/15403431-5cfe-4f02-8c15-7d45807761e1-kube-api-access-hfvxh\") pod \"aws-ebs-csi-driver-node-4cvzs\" (UID: \"15403431-5cfe-4f02-8c15-7d45807761e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.758990 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.758964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6r58\" (UniqueName: \"kubernetes.io/projected/45386175-ba18-43a4-bcc6-e7a34f265e08-kube-api-access-f6r58\") pod \"multus-m6kfn\" (UID: \"45386175-ba18-43a4-bcc6-e7a34f265e08\") " pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.767644 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.767598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" event={"ID":"11310718f4a61f3c5acea86e6346074a","Type":"ContainerStarted","Data":"11f98336efbb211d8437805f91347932d179f5c753db12fc903ecbd2ba0431c6"}
Jul 23 13:07:11.769012 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.768977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal" event={"ID":"b09537983e90b5d8296ae811288f4fa5","Type":"ContainerStarted","Data":"5abfe79048f2535942e2e4c7cf4ddd32299109a4185f324128363f22396842f7"}
Jul 23 13:07:11.848744 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.848704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d130417-eced-44f2-b230-991da7816f1d-iptables-alerter-script\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.848983 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.848754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.848983 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.848906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:11.848983 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.848949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.848983 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.848979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cnibin\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-etc-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-env-overrides\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovn-node-metrics-cert\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.849076    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b9s\" (UniqueName: \"kubernetes.io/projected/2e8532e3-ac35-4c72-9c45-38326764b1fa-kube-api-access-q6b9s\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:11.849144    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:12.349122694 +0000 UTC m=+3.086356014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-os-release\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.849217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-run-netns\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qc5\" (UniqueName: \"kubernetes.io/projected/3d86db36-c12c-4fcc-bb73-98670e8c48d8-kube-api-access-99qc5\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a174b199-278f-49d9-b8e5-d712bccd443d-agent-certs\") pod \"konnectivity-agent-qlfxh\" (UID: \"a174b199-278f-49d9-b8e5-d712bccd443d\") " pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-modprobe-d\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-lib-modules\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-var-lib-kubelet\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d130417-eced-44f2-b230-991da7816f1d-iptables-alerter-script\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-systemd-units\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-cni-netd\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-var-lib-kubelet\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.849665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cnibin\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-kubernetes\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysctl-d\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-sys\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-os-release\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cd926a6-c25e-48b6-b4a4-289a238fd94a-tmp\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysctl-conf\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-tuned\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrvw\" (UniqueName: \"kubernetes.io/projected/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-kube-api-access-vbrvw\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-kubernetes\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d130417-eced-44f2-b230-991da7816f1d-host-slash\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-systemd-units\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-system-cni-dir\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-host\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-cni-netd\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.850465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-etc-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls474\" (UniqueName: \"kubernetes.io/projected/8cd926a6-c25e-48b6-b4a4-289a238fd94a-kube-api-access-ls474\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fb22276-523d-40bb-a08d-797dee02ef5b-host\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-run\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-systemd\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjj7\" (UniqueName: \"kubernetes.io/projected/0d130417-eced-44f2-b230-991da7816f1d-kube-api-access-svjj7\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-var-lib-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-log-socket\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-env-overrides\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-cni-bin\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fb22276-523d-40bb-a08d-797dee02ef5b-host\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-systemd\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-run\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.851330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-log-socket\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850288    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d130417-eced-44f2-b230-991da7816f1d-host-slash\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-modprobe-d\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-system-cni-dir\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-host\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-lib-modules\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-cni-bin\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-var-lib-openvswitch\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.849558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-run-netns\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fb22276-523d-40bb-a08d-797dee02ef5b-serviceca\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42j7z\" (UniqueName: \"kubernetes.io/projected/0fb22276-523d-40bb-a08d-797dee02ef5b-kube-api-access-42j7z\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-sys\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a174b199-278f-49d9-b8e5-d712bccd443d-konnectivity-ca\") pod \"konnectivity-agent-qlfxh\" (UID: \"a174b199-278f-49d9-b8e5-d712bccd443d\") " pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.852107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysconfig\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-hosts-file\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysctl-d\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.850624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxnd\" (UniqueName: \"kubernetes.io/projected/d17da8d2-de85-43fb-ae9d-ba765c9a330b-kube-api-access-hqxnd\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fb22276-523d-40bb-a08d-797dee02ef5b-serviceca\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysctl-conf\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d86db36-c12c-4fcc-bb73-98670e8c48d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-sysconfig\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-hosts-file\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d86db36-c12c-4fcc-bb73-98670e8c48d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-node-log\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovnkube-config\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-node-log\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-systemd\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-tmp-dir\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.852868 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-systemd\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-kubelet\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-slash\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-ovn\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovnkube-script-lib\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a174b199-278f-49d9-b8e5-d712bccd443d-konnectivity-ca\") pod \"konnectivity-agent-qlfxh\" (UID: \"a174b199-278f-49d9-b8e5-d712bccd443d\") " pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-slash\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-tmp-dir\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-host-kubelet\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e8532e3-ac35-4c72-9c45-38326764b1fa-run-ovn\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.851982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovnkube-config\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.852223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovnkube-script-lib\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.853469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cd926a6-c25e-48b6-b4a4-289a238fd94a-etc-tuned\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.854558 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.854532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cd926a6-c25e-48b6-b4a4-289a238fd94a-tmp\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.855541 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.855507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a174b199-278f-49d9-b8e5-d712bccd443d-agent-certs\") pod \"konnectivity-agent-qlfxh\" (UID: \"a174b199-278f-49d9-b8e5-d712bccd443d\") " pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.856300 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.856276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e8532e3-ac35-4c72-9c45-38326764b1fa-ovn-node-metrics-cert\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.859721 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.859674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6b9s\" (UniqueName: \"kubernetes.io/projected/2e8532e3-ac35-4c72-9c45-38326764b1fa-kube-api-access-q6b9s\") pod \"ovnkube-node-5fdfk\" (UID: \"2e8532e3-ac35-4c72-9c45-38326764b1fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.861851 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.861807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxnd\" (UniqueName: \"kubernetes.io/projected/d17da8d2-de85-43fb-ae9d-ba765c9a330b-kube-api-access-hqxnd\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:11.862752 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.862698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrvw\" (UniqueName: \"kubernetes.io/projected/85c3bafa-fdcd-4ebc-a8a5-829241bf2256-kube-api-access-vbrvw\") pod \"node-resolver-mfjz8\" (UID: \"85c3bafa-fdcd-4ebc-a8a5-829241bf2256\") " pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.864592 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.864459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42j7z\" (UniqueName: \"kubernetes.io/projected/0fb22276-523d-40bb-a08d-797dee02ef5b-kube-api-access-42j7z\") pod \"node-ca-vjk79\" (UID: \"0fb22276-523d-40bb-a08d-797dee02ef5b\") " pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.864826 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.864801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjj7\" (UniqueName: \"kubernetes.io/projected/0d130417-eced-44f2-b230-991da7816f1d-kube-api-access-svjj7\") pod \"iptables-alerter-58ndm\" (UID: \"0d130417-eced-44f2-b230-991da7816f1d\") " pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.865097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.865077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls474\" (UniqueName: \"kubernetes.io/projected/8cd926a6-c25e-48b6-b4a4-289a238fd94a-kube-api-access-ls474\") pod \"tuned-5xkxj\" (UID: \"8cd926a6-c25e-48b6-b4a4-289a238fd94a\") " pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.865553 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.865529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qc5\" (UniqueName: \"kubernetes.io/projected/3d86db36-c12c-4fcc-bb73-98670e8c48d8-kube-api-access-99qc5\") pod \"multus-additional-cni-plugins-s7n2m\" (UID: \"3d86db36-c12c-4fcc-bb73-98670e8c48d8\") " pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:11.938428 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.938356    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs"
Jul 23 13:07:11.946969 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.946938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6kfn"
Jul 23 13:07:11.959359 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.959329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-58ndm"
Jul 23 13:07:11.964533 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.964509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:11.972378 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.972357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vjk79"
Jul 23 13:07:11.979203 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.979168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:11.987129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.987106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5xkxj"
Jul 23 13:07:11.994001 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.993979    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mfjz8"
Jul 23 13:07:11.999922 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:11.999899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s7n2m"
Jul 23 13:07:12.255194 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:12.255049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:12.255194 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:12.255112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:12.255456 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.255260    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:12.255456 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.255339    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:12.255456 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.255360    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:07:13.255335453 +0000 UTC m=+3.992568777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:12.255456 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.255361    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:12.255456 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.255387    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:12.255456 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.255430    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:13.255418238 +0000 UTC m=+3.992651553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:12.356487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:12.356452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:12.356656 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.356628    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:12.356762 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.356747    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:13.356725043 +0000 UTC m=+4.093958361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:12.684357 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:12.684273    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:02:12 +0000 UTC" deadline="2028-04-21 01:18:25.291292004 +0000 UTC"
Jul 23 13:07:12.684357 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:12.684331    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15300h11m12.606991216s"
Jul 23 13:07:12.764347 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:12.764311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:12.764799 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:12.764468    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:13.029037 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.029004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d130417_eced_44f2_b230_991da7816f1d.slice/crio-1eec4c509369ce489aa67518b94d719a3dcf4ca315d2fb54f5967c43bf39c159 WatchSource:0}: Error finding container 1eec4c509369ce489aa67518b94d719a3dcf4ca315d2fb54f5967c43bf39c159: Status 404 returned error can't find the container with id 1eec4c509369ce489aa67518b94d719a3dcf4ca315d2fb54f5967c43bf39c159
Jul 23 13:07:13.032394 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.032367    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15403431_5cfe_4f02_8c15_7d45807761e1.slice/crio-70d04648e8db0678039cae84c0745d7ae4bedd79b05bb6da178be39bff847570 WatchSource:0}: Error finding container 70d04648e8db0678039cae84c0745d7ae4bedd79b05bb6da178be39bff847570: Status 404 returned error can't find the container with id 70d04648e8db0678039cae84c0745d7ae4bedd79b05bb6da178be39bff847570
Jul 23 13:07:13.033614 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.033584    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda174b199_278f_49d9_b8e5_d712bccd443d.slice/crio-675916dcfda8f9d4863111efd054da964a3650a15cf66c7559ecb51da18d32a3 WatchSource:0}: Error finding container 675916dcfda8f9d4863111efd054da964a3650a15cf66c7559ecb51da18d32a3: Status 404 returned error can't find the container with id 675916dcfda8f9d4863111efd054da964a3650a15cf66c7559ecb51da18d32a3
Jul 23 13:07:13.034392 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.034370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8532e3_ac35_4c72_9c45_38326764b1fa.slice/crio-85c09d3c8b275ff3839a2a528e405ec8eaf1e04a567bcda3e7abe964349d7afd WatchSource:0}: Error finding container 85c09d3c8b275ff3839a2a528e405ec8eaf1e04a567bcda3e7abe964349d7afd: Status 404 returned error can't find the container with id 85c09d3c8b275ff3839a2a528e405ec8eaf1e04a567bcda3e7abe964349d7afd
Jul 23 13:07:13.035189 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.035156    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb22276_523d_40bb_a08d_797dee02ef5b.slice/crio-dcea7b14cf88ca470c0bd2f15ed7718ec18e936ab40ba0b2011505b1c4435852 WatchSource:0}: Error finding container dcea7b14cf88ca470c0bd2f15ed7718ec18e936ab40ba0b2011505b1c4435852: Status 404 returned error can't find the container with id dcea7b14cf88ca470c0bd2f15ed7718ec18e936ab40ba0b2011505b1c4435852
Jul 23 13:07:13.036640 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.036617    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d86db36_c12c_4fcc_bb73_98670e8c48d8.slice/crio-dd6bba417fa8f078e9d721ab8be60130f9114e699f15793af5e5c49fd28661f8 WatchSource:0}: Error finding container dd6bba417fa8f078e9d721ab8be60130f9114e699f15793af5e5c49fd28661f8: Status 404 returned error can't find the container with id dd6bba417fa8f078e9d721ab8be60130f9114e699f15793af5e5c49fd28661f8
Jul 23 13:07:13.037149 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.037120    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45386175_ba18_43a4_bcc6_e7a34f265e08.slice/crio-7115f179aff08dba7b031794e3ad6ce3e0083937137429926d392adfeb9210f0 WatchSource:0}: Error finding container 7115f179aff08dba7b031794e3ad6ce3e0083937137429926d392adfeb9210f0: Status 404 returned error can't find the container with id 7115f179aff08dba7b031794e3ad6ce3e0083937137429926d392adfeb9210f0
Jul 23 13:07:13.038548 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.038308    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd926a6_c25e_48b6_b4a4_289a238fd94a.slice/crio-05382908f9005afc34c806413718b7abb786d48229b63e295fa12b9d41e2a30b WatchSource:0}: Error finding container 05382908f9005afc34c806413718b7abb786d48229b63e295fa12b9d41e2a30b: Status 404 returned error can't find the container with id 05382908f9005afc34c806413718b7abb786d48229b63e295fa12b9d41e2a30b
Jul 23 13:07:13.040605 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:13.040380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c3bafa_fdcd_4ebc_a8a5_829241bf2256.slice/crio-e24acb7d4379d04fe3be471465e031680dd5bc0db3766a37d9e2207d9bc4bf8c WatchSource:0}: Error finding container e24acb7d4379d04fe3be471465e031680dd5bc0db3766a37d9e2207d9bc4bf8c: Status 404 returned error can't find the container with id e24acb7d4379d04fe3be471465e031680dd5bc0db3766a37d9e2207d9bc4bf8c
Jul 23 13:07:13.264242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.264077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:13.264390 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.264267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:13.264390 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.264225    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:13.264390 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.264370    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:07:15.264353943 +0000 UTC m=+6.001587255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:13.264390 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.264385    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:13.264560 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.264402    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:13.264560 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.264417    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:13.264560 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.264472    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:15.26445867 +0000 UTC m=+6.001691970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:13.365143 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.365111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:13.365326 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.365301    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:13.365404 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.365392    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:15.365369824 +0000 UTC m=+6.102603141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:13.685230 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.685048    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:02:12 +0000 UTC" deadline="2028-01-11 13:17:06.397595869 +0000 UTC"
Jul 23 13:07:13.685230 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.685112    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12888h9m52.712487998s"
Jul 23 13:07:13.766689 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.766654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:13.767377 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.766804    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:13.767377 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.767243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:13.767377 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:13.767358    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:13.778133 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.778104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlfxh" event={"ID":"a174b199-278f-49d9-b8e5-d712bccd443d","Type":"ContainerStarted","Data":"675916dcfda8f9d4863111efd054da964a3650a15cf66c7559ecb51da18d32a3"}
Jul 23 13:07:13.784441 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.783110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal" event={"ID":"b09537983e90b5d8296ae811288f4fa5","Type":"ContainerStarted","Data":"0aa61445e115bab05c30c29e97f1d17fe5b67fe3e200ac031fba0ff1ab17a8e0"}
Jul 23 13:07:13.788068 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.788042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mfjz8" event={"ID":"85c3bafa-fdcd-4ebc-a8a5-829241bf2256","Type":"ContainerStarted","Data":"e24acb7d4379d04fe3be471465e031680dd5bc0db3766a37d9e2207d9bc4bf8c"}
Jul 23 13:07:13.793969 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.793923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5xkxj" event={"ID":"8cd926a6-c25e-48b6-b4a4-289a238fd94a","Type":"ContainerStarted","Data":"05382908f9005afc34c806413718b7abb786d48229b63e295fa12b9d41e2a30b"}
Jul 23 13:07:13.796699 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.796673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerStarted","Data":"dd6bba417fa8f078e9d721ab8be60130f9114e699f15793af5e5c49fd28661f8"}
Jul 23 13:07:13.803680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.803654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"85c09d3c8b275ff3839a2a528e405ec8eaf1e04a567bcda3e7abe964349d7afd"}
Jul 23 13:07:13.811402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.811373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs" event={"ID":"15403431-5cfe-4f02-8c15-7d45807761e1","Type":"ContainerStarted","Data":"70d04648e8db0678039cae84c0745d7ae4bedd79b05bb6da178be39bff847570"}
Jul 23 13:07:13.818907 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.818711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-58ndm" event={"ID":"0d130417-eced-44f2-b230-991da7816f1d","Type":"ContainerStarted","Data":"1eec4c509369ce489aa67518b94d719a3dcf4ca315d2fb54f5967c43bf39c159"}
Jul 23 13:07:13.827414 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.827384    2564 generic.go:356] "Generic (PLEG): container finished" podID="11310718f4a61f3c5acea86e6346074a" containerID="71aa715ebf56de1d2f6cdfda68ae2d291cc39f182da8f848996938741aadd929" exitCode=0
Jul 23 13:07:13.827516 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.827466    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" event={"ID":"11310718f4a61f3c5acea86e6346074a","Type":"ContainerDied","Data":"71aa715ebf56de1d2f6cdfda68ae2d291cc39f182da8f848996938741aadd929"}
Jul 23 13:07:13.832712 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.832638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6kfn" event={"ID":"45386175-ba18-43a4-bcc6-e7a34f265e08","Type":"ContainerStarted","Data":"7115f179aff08dba7b031794e3ad6ce3e0083937137429926d392adfeb9210f0"}
Jul 23 13:07:13.839096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.839068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vjk79" event={"ID":"0fb22276-523d-40bb-a08d-797dee02ef5b","Type":"ContainerStarted","Data":"dcea7b14cf88ca470c0bd2f15ed7718ec18e936ab40ba0b2011505b1c4435852"}
Jul 23 13:07:13.845282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:13.845227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal" podStartSLOduration=2.84520907 podStartE2EDuration="2.84520907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:13.803061515 +0000 UTC m=+4.540294838" watchObservedRunningTime="2026-07-23 13:07:13.84520907 +0000 UTC m=+4.582442399"
Jul 23 13:07:14.764111 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:14.764029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:14.764284 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:14.764184    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:14.855069 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:14.855029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" event={"ID":"11310718f4a61f3c5acea86e6346074a","Type":"ContainerStarted","Data":"49e25f037651feedc4be7d7f0c90f52c6f9745b5aaf21d3ab89216eed5bd18a7"}
Jul 23 13:07:14.872380 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:14.872322    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" podStartSLOduration=3.8722992830000003 podStartE2EDuration="3.872299283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:14.871287921 +0000 UTC m=+5.608521247" watchObservedRunningTime="2026-07-23 13:07:14.872299283 +0000 UTC m=+5.609532610"
Jul 23 13:07:15.281822 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:15.281788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:15.282048 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:15.281848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:15.282123 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.282045    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:15.282123 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.282119    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:07:19.282099145 +0000 UTC m=+10.019332447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:15.282604 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.282585    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:15.282699 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.282610    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:15.282699 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.282624    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:15.282699 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.282676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:19.282660585 +0000 UTC m=+10.019893887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:15.386003 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:15.382473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:15.386003 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.382640    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:15.386003 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.382711    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:19.382691692 +0000 UTC m=+10.119924994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:15.764675 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:15.764034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:15.764675 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.764190    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:15.765264 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:15.765068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:15.765264 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:15.765191    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:16.763976 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:16.763942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:16.764450 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:16.764073    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:17.763759 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:17.763722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:17.763979 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:17.763886    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:17.763979 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:17.763721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:17.764402 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:17.764052    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:18.764513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:18.764010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:18.764513 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:18.764163    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:19.319186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:19.319252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.319408    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.319426    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.319439    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.319498    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:27.319478435 +0000 UTC m=+18.056711755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.319567    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:19.319804 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.319601    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:07:27.319589867 +0000 UTC m=+18.056823181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:19.420276 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:19.420235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:19.420451 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.420411    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:19.420514 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.420483    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:27.420462066 +0000 UTC m=+18.157695369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:19.766023 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:19.764881    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:19.766023 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.765026    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:19.766023 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:19.765483    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:19.766023 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:19.765593    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:20.763661 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:20.763630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:20.763815 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:20.763773    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:21.764150 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:21.764116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:21.764605 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:21.764248    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:21.764693 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:21.764634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:21.764755 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:21.764735    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:22.764127 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:22.764089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:22.764319 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:22.764224    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:23.763905 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:23.763873    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:23.764134 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:23.764015    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:23.764134 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:23.764057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:23.764267 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:23.764174    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:24.763577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:24.763496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:24.764086 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:24.763613    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:25.763470 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:25.763441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:25.763470 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:25.763465    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:25.763978 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:25.763574    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:25.763978 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:25.763714    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:26.764305 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:26.764269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:26.764755 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:26.764382    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:27.381061 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:27.381023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:27.381328 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:27.381132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:27.381328 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.381200    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:27.381328 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.381228    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:27.381328 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.381241    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:27.381328 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.381303    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:07:43.381289572 +0000 UTC m=+34.118522882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:27.381588 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.381246    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:27.381588 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.381416    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:43.381397333 +0000 UTC m=+34.118630647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:27.482211 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:27.482182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:27.482395 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.482341    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:27.482459 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.482402    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:07:43.482386516 +0000 UTC m=+34.219619817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:27.763731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:27.763658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:27.763901 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:27.763662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:27.763901 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.763788    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:27.764018 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:27.763913    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:28.764074 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:28.764046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:28.764425 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:28.764139    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:29.764590 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:29.764549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:29.765071 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:29.764680    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:29.765071 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:29.764757    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:29.765071 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:29.764854    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:30.763353 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:30.763321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:30.763527 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:30.763449    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:31.764132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:31.764088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:31.764581 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:31.764105    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:31.764581 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:31.764236    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:31.764581 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:31.764317    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:32.764716 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.763351    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:32.764716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:32.763672    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:32.892719 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.892520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mfjz8" event={"ID":"85c3bafa-fdcd-4ebc-a8a5-829241bf2256","Type":"ContainerStarted","Data":"0131f0b7140e7aff7012efa38b28b36f12b686b86121ac9aaf25d7f1e396bf90"}
Jul 23 13:07:32.894191 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.894167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5xkxj" event={"ID":"8cd926a6-c25e-48b6-b4a4-289a238fd94a","Type":"ContainerStarted","Data":"75255f0c11878839bd67be6fb5b3caa280c8d0c73c4568226d0f7ca23a8b1045"}
Jul 23 13:07:32.895611 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.895590    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d86db36-c12c-4fcc-bb73-98670e8c48d8" containerID="5834aac35ead47f0d2856a46a23d4a26b81ecb65d99aaa22f76979a42a46a166" exitCode=0
Jul 23 13:07:32.895700 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.895667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerDied","Data":"5834aac35ead47f0d2856a46a23d4a26b81ecb65d99aaa22f76979a42a46a166"}
Jul 23 13:07:32.898281 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.898256    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"9cd2e71765201d544fe858b14fc0e5343af55968413cc196eaa37e3266cd1c12"}
Jul 23 13:07:32.898375 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.898337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"c176ee336769d2a995214ca17d642e9a531f32a9b5264f8f897ae08266a3c4da"}
Jul 23 13:07:32.900113 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.900074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs" event={"ID":"15403431-5cfe-4f02-8c15-7d45807761e1","Type":"ContainerStarted","Data":"0b6e7cc066054d70e19f39bea7b87ee5a3d52f5d4e8fc614d826597de8c59670"}
Jul 23 13:07:32.901823 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.901803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6kfn" event={"ID":"45386175-ba18-43a4-bcc6-e7a34f265e08","Type":"ContainerStarted","Data":"f475d861cc107bb553f4c8ae4faa3b79a7356ea9e770424f0736de8d809dc20a"}
Jul 23 13:07:32.906987 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.906959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vjk79" event={"ID":"0fb22276-523d-40bb-a08d-797dee02ef5b","Type":"ContainerStarted","Data":"d5e1cee73e69b47026fcb23f9cbbb6338399a4679796dd50e39201066a2d58ea"}
Jul 23 13:07:32.908485 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.908460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlfxh" event={"ID":"a174b199-278f-49d9-b8e5-d712bccd443d","Type":"ContainerStarted","Data":"52e1daa875722eae05998cb859c6b3dee51f7d6a9c7ba5c0dcbbb3bf366ea07d"}
Jul 23 13:07:32.917016 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.916979    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mfjz8" podStartSLOduration=3.373471288 podStartE2EDuration="22.91696677s" totalImagesPullingTime="19.543495482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:32.916932995 +0000 UTC m=+23.654166335" watchObservedRunningTime="2026-07-23 13:07:32.91696677 +0000 UTC m=+23.654200088"
Jul 23 13:07:32.935385 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.935346    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qlfxh" podStartSLOduration=11.423387525 podStartE2EDuration="22.935336094s" totalImagesPullingTime="11.511948569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:32.935010057 +0000 UTC m=+23.672243375" watchObservedRunningTime="2026-07-23 13:07:32.935336094 +0000 UTC m=+23.672569413"
Jul 23 13:07:32.984220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:32.984182    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5xkxj" podStartSLOduration=3.435581914 podStartE2EDuration="22.984165243s" totalImagesPullingTime="19.548583329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:32.9595953 +0000 UTC m=+23.696828629" watchObservedRunningTime="2026-07-23 13:07:32.984165243 +0000 UTC m=+23.721398562"
Jul 23 13:07:33.025344 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.025306    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m6kfn" podStartSLOduration=3.426622685 podStartE2EDuration="23.025291567s" totalImagesPullingTime="19.598668882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:33.025265988 +0000 UTC m=+23.762499297" watchObservedRunningTime="2026-07-23 13:07:33.025291567 +0000 UTC m=+23.762524885"
Jul 23 13:07:33.051452 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.051412    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vjk79" podStartSLOduration=3.503912906 podStartE2EDuration="23.051397212s" totalImagesPullingTime="19.547484306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:33.051216832 +0000 UTC m=+23.788450150" watchObservedRunningTime="2026-07-23 13:07:33.051397212 +0000 UTC m=+23.788630556"
Jul 23 13:07:33.621103 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.621072    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:33.621687 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.621665    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:33.763871 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.763840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:33.764004 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.763849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:33.764004 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:33.763972    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:33.764093 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:33.764020    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:33.913577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.913550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"14845996d8c599576fbf8a9d8877847f1554b5fdfe71cf061fddc1d7a1e350fa"}
Jul 23 13:07:33.914078 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.913634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"613160f7f0a3af228fd3548227059e3382f150fe510b76faf51ea7b1b28e6b3f"}
Jul 23 13:07:33.914078 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.913684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"0ec277fabe287c282656cc2100fe3c763fe8339d450f634fa4d30cf63117e27b"}
Jul 23 13:07:33.914078 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.913725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"57f1bbb0056bafcbc5fde7534bc8361ded5d180e70fe9bc14cd203dabb4bdca7"}
Jul 23 13:07:33.915665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.915645    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:33.915755 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:33.915708    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qlfxh"
Jul 23 13:07:34.230621 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.230595    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 13:07:34.699904 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.699758    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T13:07:34.230617152Z","UUID":"937a9a2b-30f1-449b-b419-2229b14ba08c","Handler":null,"Name":"","Endpoint":""}
Jul 23 13:07:34.701487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.701464    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 13:07:34.701595 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.701506    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 13:07:34.763409 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.763380    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:34.763568 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:34.763484    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:34.919402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.919365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs" event={"ID":"15403431-5cfe-4f02-8c15-7d45807761e1","Type":"ContainerStarted","Data":"3c79c9a0439a070bb653ae077dbe9fab6f3ab0d7ba5d108e0b0571ec3ceeaccb"}
Jul 23 13:07:34.920941 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.920911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-58ndm" event={"ID":"0d130417-eced-44f2-b230-991da7816f1d","Type":"ContainerStarted","Data":"51182cb29b079c702c62c5bb9b946c5a552e257daf3121f1b47e2c191c6cb907"}
Jul 23 13:07:34.935429 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:34.935390    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-58ndm" podStartSLOduration=5.381388197 podStartE2EDuration="24.9353748s" totalImagesPullingTime="19.553986603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:34.934993854 +0000 UTC m=+25.672227173" watchObservedRunningTime="2026-07-23 13:07:34.9353748 +0000 UTC m=+25.672608118"
Jul 23 13:07:35.763844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:35.763710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:35.763844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:35.763756    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:35.764053 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:35.763880    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:35.764053 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:35.763989    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:35.927688 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:35.927654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"bb09ab855135f0beb7463899f57bd9eccf07854cbf9214d64bad81c908b9a9f3"}
Jul 23 13:07:36.764490 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:36.764312    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:36.764669 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:36.764556    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:37.764134 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:37.764059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:37.764577 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:37.764194    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:37.764577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:37.764243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:37.764577 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:37.764368    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:38.764529 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.764364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:38.765163 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:38.764602    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:38.935618 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.935537    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d86db36-c12c-4fcc-bb73-98670e8c48d8" containerID="719d07409e23a6e4c30f8c9d17eff35e0a0e04d9505d9c94bbd2b231fb8b58dd" exitCode=0
Jul 23 13:07:38.935915 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.935616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerDied","Data":"719d07409e23a6e4c30f8c9d17eff35e0a0e04d9505d9c94bbd2b231fb8b58dd"}
Jul 23 13:07:38.939171 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.939147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" event={"ID":"2e8532e3-ac35-4c72-9c45-38326764b1fa","Type":"ContainerStarted","Data":"f08c36d9ccf410e00901f92688699a4137563f3536840643b4c641d1b04a711f"}
Jul 23 13:07:38.939395 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.939377    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:38.941359 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.941335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs" event={"ID":"15403431-5cfe-4f02-8c15-7d45807761e1","Type":"ContainerStarted","Data":"690a849d1121812f6c32e1bedbcc2a2d0d647230cd7355a4eccfb29d58d6a9be"}
Jul 23 13:07:38.954017 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.953999    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:38.976245 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.976210    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cvzs" podStartSLOduration=3.964087174 podStartE2EDuration="28.97619683s" totalImagesPullingTime="25.012109656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:38.975733931 +0000 UTC m=+29.712967250" watchObservedRunningTime="2026-07-23 13:07:38.97619683 +0000 UTC m=+29.713430149"
Jul 23 13:07:38.997971 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:38.997932    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk" podStartSLOduration=9.38589742 podStartE2EDuration="28.997919711s" totalImagesPullingTime="19.612022291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:38.997430405 +0000 UTC m=+29.734663725" watchObservedRunningTime="2026-07-23 13:07:38.997919711 +0000 UTC m=+29.735153029"
Jul 23 13:07:39.769740 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:39.769665    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:39.770159 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:39.769748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:39.770159 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:39.769759    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:39.770159 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:39.769881    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:39.943143 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:39.943116    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:39.943612 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:39.943574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:39.957418 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:39.957394    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:07:40.442657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.442581    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxq2v"]
Jul 23 13:07:40.442779 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.442687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:40.442821 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:40.442774    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:40.446736 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.446713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xzsbl"]
Jul 23 13:07:40.446856 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.446790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:40.446926 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:40.446887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:40.447553 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.447531    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8dz4q"]
Jul 23 13:07:40.447662 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.447613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:40.447715 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:40.447692    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:40.946951 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.946923    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d86db36-c12c-4fcc-bb73-98670e8c48d8" containerID="2a5343027153a6f9a51d3e985f012946d7102f77c5a21d7f2a1914b5d44023c6" exitCode=0
Jul 23 13:07:40.947324 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:40.947000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerDied","Data":"2a5343027153a6f9a51d3e985f012946d7102f77c5a21d7f2a1914b5d44023c6"}
Jul 23 13:07:41.763825 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:41.763744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:41.763982 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:41.763881    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:42.763713 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:42.763519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:42.764155 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:42.763519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:42.764155 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:42.763812    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:42.764155 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:42.763853    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:43.403321 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:43.403288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:43.403487 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.403466    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:07:43.403581 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.403499    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:07:43.403581 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.403512    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ml6wn for pod openshift-network-diagnostics/network-check-target-kxq2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:43.403581 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.403563    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:43.403581 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.403571    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn podName:3f547047-4af3-4766-91a9-84c3342dbf83 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:15.403554083 +0000 UTC m=+66.140787395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ml6wn" (UniqueName: "kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn") pod "network-check-target-kxq2v" (UID: "3f547047-4af3-4766-91a9-84c3342dbf83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:07:43.403786 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.403599    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret podName:3b1320da-c6b8-408a-b1a2-19d69a83827e nodeName:}" failed. No retries permitted until 2026-07-23 13:08:15.403588127 +0000 UTC m=+66.140821437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret") pod "global-pull-secret-syncer-xzsbl" (UID: "3b1320da-c6b8-408a-b1a2-19d69a83827e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:07:43.403786 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:43.403471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:43.504810 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:43.504779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:43.504953 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.504914    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:43.504989 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.504966    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs podName:d17da8d2-de85-43fb-ae9d-ba765c9a330b nodeName:}" failed. No retries permitted until 2026-07-23 13:08:15.504953266 +0000 UTC m=+66.242186567 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs") pod "network-metrics-daemon-8dz4q" (UID: "d17da8d2-de85-43fb-ae9d-ba765c9a330b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:07:43.763764 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:43.763679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:43.764266 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:43.763786    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dz4q" podUID="d17da8d2-de85-43fb-ae9d-ba765c9a330b"
Jul 23 13:07:43.956547 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:43.956514    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d86db36-c12c-4fcc-bb73-98670e8c48d8" containerID="f299c83691c1b0658048babbcf3997683b9ac9f8417385c09c72793253069b8d" exitCode=0
Jul 23 13:07:43.956691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:43.956570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerDied","Data":"f299c83691c1b0658048babbcf3997683b9ac9f8417385c09c72793253069b8d"}
Jul 23 13:07:44.763810 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:44.763782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:44.764249 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:44.763786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:44.764249 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:44.763911    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxq2v" podUID="3f547047-4af3-4766-91a9-84c3342dbf83"
Jul 23 13:07:44.764249 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:44.763954    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzsbl" podUID="3b1320da-c6b8-408a-b1a2-19d69a83827e"
Jul 23 13:07:45.530610 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.530537    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeReady"
Jul 23 13:07:45.530757 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.530657    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 13:07:45.568787 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.568759    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-694f8fbdb4-rm9b5"]
Jul 23 13:07:45.571552 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.571534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.576462 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.576438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9cnr7\""
Jul 23 13:07:45.576776 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.576725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 13:07:45.576776 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.576764    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 13:07:45.577496 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.577475    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 13:07:45.581967 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.581947    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 13:07:45.584342 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.584315    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"]
Jul 23 13:07:45.586201 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.586181    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"]
Jul 23 13:07:45.586439 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.586284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.588635 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.588618    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-z5s7f"]
Jul 23 13:07:45.588742 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.588725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.590891 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.590456    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"]
Jul 23 13:07:45.591004 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.590984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gbjh8\""
Jul 23 13:07:45.591064 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.591038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.591111 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.591071    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 13:07:45.591171 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.590988    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.592413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592191    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 13:07:45.592413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592192    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 13:07:45.592413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qgmxh\""
Jul 23 13:07:45.592413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592245    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.592413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592298    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.592694 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592545    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.592694 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.592549    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 13:07:45.593408 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.593387    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.594647 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.594024    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6997dd8868-5k8xv"]
Jul 23 13:07:45.594716 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.594703    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"
Jul 23 13:07:45.595460 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.595437    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 13:07:45.596091 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.595576    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 13:07:45.596091 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.595577    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.596091 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.595699    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2v29g\""
Jul 23 13:07:45.596339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.596323    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-694f8fbdb4-rm9b5"]
Jul 23 13:07:45.596417 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.596403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.599474 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.599333    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.599474 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.599353    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.599474 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.599411    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.599474 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.599419    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 13:07:45.600191 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.599663    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 13:07:45.600191 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.599725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t94v2\""
Jul 23 13:07:45.600300 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.600282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"]
Jul 23 13:07:45.600672 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.600654    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 13:07:45.600818 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.600658    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9kcp5\""
Jul 23 13:07:45.600954 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.600938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.601039 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.600947    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 13:07:45.608492 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.608140    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 13:07:45.608908 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.608853    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"]
Jul 23 13:07:45.611532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.611510    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"]
Jul 23 13:07:45.612483 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.612457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-z5s7f"]
Jul 23 13:07:45.613772 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.613110    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"]
Jul 23 13:07:45.615954 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.615906    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h8m6l"]
Jul 23 13:07:45.616160 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.616132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.618183 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.618160    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n77m8"]
Jul 23 13:07:45.618821 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.618382    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.620482 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.620355    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"]
Jul 23 13:07:45.620576 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.620541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.622067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.622048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 13:07:45.622293 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.622277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 13:07:45.622940 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.622921    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"]
Jul 23 13:07:45.623085 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.623042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:45.623619 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.623603    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.624517 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.624499    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 13:07:45.625339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.625321    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"]
Jul 23 13:07:45.625437 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.625420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:45.626274 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.626241    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.626595 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.626578    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.626691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.626649    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.626691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.626666    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 13:07:45.627058 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.626936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 13:07:45.627058 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.626942    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b6wbz\""
Jul 23 13:07:45.627058 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627053    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.627333 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6hgjx\""
Jul 23 13:07:45.627454 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627432    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 13:07:45.627560 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627492    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5s2mz"]
Jul 23 13:07:45.627620 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t9dt4\""
Jul 23 13:07:45.627682 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627665    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kdsrj\""
Jul 23 13:07:45.627784 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.627760    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 13:07:45.628442 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.628311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-59sxs\""
Jul 23 13:07:45.628904 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.628614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"
Jul 23 13:07:45.629010 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.628968    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 13:07:45.629104 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.629086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.629565 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.629550    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6997dd8868-5k8xv"]
Jul 23 13:07:45.629751 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.629734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.633123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.633103    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.633205 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.633154    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 13:07:45.633262 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.633200    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.633608 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.633587    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 13:07:45.633821 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.633805    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 13:07:45.633926 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.633891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mbwhb\""
Jul 23 13:07:45.634036 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.634020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 13:07:45.634435 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.634299    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-44btk\""
Jul 23 13:07:45.634984 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.634964    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 13:07:45.636564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.636548    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"]
Jul 23 13:07:45.640432 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.640208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"]
Jul 23 13:07:45.641361 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.641332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"]
Jul 23 13:07:45.641939 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.641920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"]
Jul 23 13:07:45.643321 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.643303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5s2mz"]
Jul 23 13:07:45.644198 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.644156    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n77m8"]
Jul 23 13:07:45.645041 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.645023    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8m6l"]
Jul 23 13:07:45.721134 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:45.721269 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218bcc1f-f828-406e-ac13-a2ddf646906e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.721269 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsf62\" (UniqueName: \"kubernetes.io/projected/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-kube-api-access-jsf62\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.721269 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-certificates\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.721269 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-trusted-ca\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.721476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-config-volume\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.721476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.721476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvf8\" (UniqueName: \"kubernetes.io/projected/b7d4cd49-3cd3-468c-a4a7-f939044f65fd-kube-api-access-tsvf8\") pod \"network-check-source-7bc5b6bf85-89t96\" (UID: \"b7d4cd49-3cd3-468c-a4a7-f939044f65fd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"
Jul 23 13:07:45.721476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.721476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.721476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c7dd86-9953-44df-8b97-18c3e13f3396-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218bcc1f-f828-406e-ac13-a2ddf646906e-config\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc4v5\" (UniqueName: \"kubernetes.io/projected/bbea7dc9-25d3-47ee-913b-aaee7899a192-kube-api-access-lc4v5\") pod \"volume-data-source-validator-78cf4c6f6-vn2ds\" (UID: \"bbea7dc9-25d3-47ee-913b-aaee7899a192\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hftq\" (UniqueName: \"kubernetes.io/projected/49c7dd86-9953-44df-8b97-18c3e13f3396-kube-api-access-8hftq\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v696p\" (UniqueName: \"kubernetes.io/projected/218bcc1f-f828-406e-ac13-a2ddf646906e-kube-api-access-v696p\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be520336-103b-4cd7-ac49-97d4f53ab17a-ca-trust-extracted\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49c7dd86-9953-44df-8b97-18c3e13f3396-serving-cert\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/152c4a8b-63d7-4b29-aaf1-68c108337779-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.721753 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-serving-cert\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-trusted-ca\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-tmp-dir\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-bound-sa-token\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-stats-auth\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5hz\" (UniqueName: \"kubernetes.io/projected/86887492-740c-4701-933e-9c22f54ea2c2-kube-api-access-7j5hz\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db4c1c22-a985-480c-8e0c-c50b8580ddea-cert\") pod \"ingress-canary-5s2mz\" (UID: \"db4c1c22-a985-480c-8e0c-c50b8580ddea\") " pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/49c7dd86-9953-44df-8b97-18c3e13f3396-snapshots\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.721974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-default-certificate\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5fpq\" (UniqueName: \"kubernetes.io/projected/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-kube-api-access-t5fpq\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c7dd86-9953-44df-8b97-18c3e13f3396-tmp\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c7dd86-9953-44df-8b97-18c3e13f3396-service-ca-bundle\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzbkw\" (UniqueName: \"kubernetes.io/projected/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-kube-api-access-fzbkw\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:45.722248 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd5n8\" (UniqueName: \"kubernetes.io/projected/db4c1c22-a985-480c-8e0c-c50b8580ddea-kube-api-access-hd5n8\") pod \"ingress-canary-5s2mz\" (UID: \"db4c1c22-a985-480c-8e0c-c50b8580ddea\") " pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9grgd\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-kube-api-access-9grgd\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-config\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/056168a5-4598-46b4-9073-6f5545103899-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg99t\" (UniqueName: \"kubernetes.io/projected/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-kube-api-access-jg99t\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-image-registry-private-configuration\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86887492-740c-4701-933e-9c22f54ea2c2-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-installation-pull-secrets\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/152c4a8b-63d7-4b29-aaf1-68c108337779-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.722844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.722463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-299mp\" (UniqueName: \"kubernetes.io/projected/152c4a8b-63d7-4b29-aaf1-68c108337779-kube-api-access-299mp\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.763588 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.763562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:07:45.765784 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.765762    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:07:45.766281 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.765965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5gct\""
Jul 23 13:07:45.823647 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.823647 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c7dd86-9953-44df-8b97-18c3e13f3396-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218bcc1f-f828-406e-ac13-a2ddf646906e-config\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc4v5\" (UniqueName: \"kubernetes.io/projected/bbea7dc9-25d3-47ee-913b-aaee7899a192-kube-api-access-lc4v5\") pod \"volume-data-source-validator-78cf4c6f6-vn2ds\" (UID: \"bbea7dc9-25d3-47ee-913b-aaee7899a192\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hftq\" (UniqueName: \"kubernetes.io/projected/49c7dd86-9953-44df-8b97-18c3e13f3396-kube-api-access-8hftq\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.823749    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v696p\" (UniqueName: \"kubernetes.io/projected/218bcc1f-f828-406e-ac13-a2ddf646906e-kube-api-access-v696p\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be520336-103b-4cd7-ac49-97d4f53ab17a-ca-trust-extracted\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.823821    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls podName:de2b7efa-7af3-4906-a5cc-7b5a0e1da935 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.323795831 +0000 UTC m=+37.061029142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls") pod "dns-default-h8m6l" (UID: "de2b7efa-7af3-4906-a5cc-7b5a0e1da935") : secret "dns-default-metrics-tls" not found
Jul 23 13:07:45.823880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49c7dd86-9953-44df-8b97-18c3e13f3396-serving-cert\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/152c4a8b-63d7-4b29-aaf1-68c108337779-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-serving-cert\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.823980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-trusted-ca\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-tmp-dir\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-bound-sa-token\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-stats-auth\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5hz\" (UniqueName: \"kubernetes.io/projected/86887492-740c-4701-933e-9c22f54ea2c2-kube-api-access-7j5hz\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db4c1c22-a985-480c-8e0c-c50b8580ddea-cert\") pod \"ingress-canary-5s2mz\" (UID: \"db4c1c22-a985-480c-8e0c-c50b8580ddea\") " pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/49c7dd86-9953-44df-8b97-18c3e13f3396-snapshots\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be520336-103b-4cd7-ac49-97d4f53ab17a-ca-trust-extracted\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-default-certificate\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5fpq\" (UniqueName: \"kubernetes.io/projected/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-kube-api-access-t5fpq\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.824398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c7dd86-9953-44df-8b97-18c3e13f3396-tmp\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.824271    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c7dd86-9953-44df-8b97-18c3e13f3396-service-ca-bundle\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzbkw\" (UniqueName: \"kubernetes.io/projected/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-kube-api-access-fzbkw\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.824340    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert podName:056168a5-4598-46b4-9073-6f5545103899 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.324323401 +0000 UTC m=+37.061556717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4hjgg" (UID: "056168a5-4598-46b4-9073-6f5545103899") : secret "networking-console-plugin-cert" not found
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd5n8\" (UniqueName: \"kubernetes.io/projected/db4c1c22-a985-480c-8e0c-c50b8580ddea-kube-api-access-hd5n8\") pod \"ingress-canary-5s2mz\" (UID: \"db4c1c22-a985-480c-8e0c-c50b8580ddea\") " pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218bcc1f-f828-406e-ac13-a2ddf646906e-config\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9grgd\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-kube-api-access-9grgd\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-config\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/056168a5-4598-46b4-9073-6f5545103899-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c7dd86-9953-44df-8b97-18c3e13f3396-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.824792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49c7dd86-9953-44df-8b97-18c3e13f3396-tmp\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.825059 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.825029    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.32500776 +0000 UTC m=+37.062241083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : configmap references non-existent config key: service-ca.crt
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-tmp-dir\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-trusted-ca\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c7dd86-9953-44df-8b97-18c3e13f3396-service-ca-bundle\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/056168a5-4598-46b4-9073-6f5545103899-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg99t\" (UniqueName: \"kubernetes.io/projected/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-kube-api-access-jg99t\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-image-registry-private-configuration\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86887492-740c-4701-933e-9c22f54ea2c2-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-installation-pull-secrets\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/152c4a8b-63d7-4b29-aaf1-68c108337779-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825505    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-299mp\" (UniqueName: \"kubernetes.io/projected/152c4a8b-63d7-4b29-aaf1-68c108337779-kube-api-access-299mp\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:45.825602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218bcc1f-f828-406e-ac13-a2ddf646906e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.826282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsf62\" (UniqueName: \"kubernetes.io/projected/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-kube-api-access-jsf62\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.826282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-certificates\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.826282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-trusted-ca\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.826282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.825958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-config\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.826282 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.826253    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:07:45.826513 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.826299    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.326283848 +0000 UTC m=+37.063517145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : secret "router-metrics-certs-default" not found
Jul 23 13:07:45.826513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.826394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/49c7dd86-9953-44df-8b97-18c3e13f3396-snapshots\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.826661 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.826637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-trusted-ca\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.826976 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.826956    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:07:45.827061 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.827009    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls podName:2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.326994694 +0000 UTC m=+37.064228007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xssgj" (UID: "2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71") : secret "samples-operator-tls" not found
Jul 23 13:07:45.827230 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.827208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-config-volume\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.830085 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.829969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.830531    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvf8\" (UniqueName: \"kubernetes.io/projected/b7d4cd49-3cd3-468c-a4a7-f939044f65fd-kube-api-access-tsvf8\") pod \"network-check-source-7bc5b6bf85-89t96\" (UID: \"b7d4cd49-3cd3-468c-a4a7-f939044f65fd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.830571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.828589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86887492-740c-4701-933e-9c22f54ea2c2-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.829913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-serving-cert\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.827345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-certificates\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.830268    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.830728    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls podName:86887492-740c-4701-933e-9c22f54ea2c2 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.330711884 +0000 UTC m=+37.067945185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s6klq" (UID: "86887492-740c-4701-933e-9c22f54ea2c2") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.827869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-config-volume\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.830925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.830876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-installation-pull-secrets\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.831073    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.831088    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-694f8fbdb4-rm9b5: secret "image-registry-tls" not found
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:45.831140    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls podName:be520336-103b-4cd7-ac49-97d4f53ab17a nodeName:}" failed. No retries permitted until 2026-07-23 13:07:46.331124174 +0000 UTC m=+37.068357473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls") pod "image-registry-694f8fbdb4-rm9b5" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a") : secret "image-registry-tls" not found
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.827946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/152c4a8b-63d7-4b29-aaf1-68c108337779-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.830478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49c7dd86-9953-44df-8b97-18c3e13f3396-serving-cert\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.831317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-default-certificate\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.831413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.831373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-stats-auth\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.832119 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.831818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-image-registry-private-configuration\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.832622 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.832594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db4c1c22-a985-480c-8e0c-c50b8580ddea-cert\") pod \"ingress-canary-5s2mz\" (UID: \"db4c1c22-a985-480c-8e0c-c50b8580ddea\") " pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.833723 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.833698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc4v5\" (UniqueName: \"kubernetes.io/projected/bbea7dc9-25d3-47ee-913b-aaee7899a192-kube-api-access-lc4v5\") pod \"volume-data-source-validator-78cf4c6f6-vn2ds\" (UID: \"bbea7dc9-25d3-47ee-913b-aaee7899a192\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"
Jul 23 13:07:45.833898 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.833875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v696p\" (UniqueName: \"kubernetes.io/projected/218bcc1f-f828-406e-ac13-a2ddf646906e-kube-api-access-v696p\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.834216 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.834191    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218bcc1f-f828-406e-ac13-a2ddf646906e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ffjnd\" (UID: \"218bcc1f-f828-406e-ac13-a2ddf646906e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.834920 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.834878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/152c4a8b-63d7-4b29-aaf1-68c108337779-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.836077 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.835968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzbkw\" (UniqueName: \"kubernetes.io/projected/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-kube-api-access-fzbkw\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:45.836356 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.836314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9grgd\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-kube-api-access-9grgd\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.836437 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.836396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5fpq\" (UniqueName: \"kubernetes.io/projected/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-kube-api-access-t5fpq\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:45.837239 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.837181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg99t\" (UniqueName: \"kubernetes.io/projected/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-kube-api-access-jg99t\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:45.837335 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.837261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-bound-sa-token\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:45.837407 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.837384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5hz\" (UniqueName: \"kubernetes.io/projected/86887492-740c-4701-933e-9c22f54ea2c2-kube-api-access-7j5hz\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:45.837510 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.837487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hftq\" (UniqueName: \"kubernetes.io/projected/49c7dd86-9953-44df-8b97-18c3e13f3396-kube-api-access-8hftq\") pod \"insights-operator-555d9d7885-z5s7f\" (UID: \"49c7dd86-9953-44df-8b97-18c3e13f3396\") " pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.838344 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.838322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd5n8\" (UniqueName: \"kubernetes.io/projected/db4c1c22-a985-480c-8e0c-c50b8580ddea-kube-api-access-hd5n8\") pod \"ingress-canary-5s2mz\" (UID: \"db4c1c22-a985-480c-8e0c-c50b8580ddea\") " pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:45.840245 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.840151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-299mp\" (UniqueName: \"kubernetes.io/projected/152c4a8b-63d7-4b29-aaf1-68c108337779-kube-api-access-299mp\") pod \"kube-storage-version-migrator-operator-7658d9b749-7wbhx\" (UID: \"152c4a8b-63d7-4b29-aaf1-68c108337779\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.841734 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.841700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsf62\" (UniqueName: \"kubernetes.io/projected/3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca-kube-api-access-jsf62\") pod \"console-operator-565b7b569d-n77m8\" (UID: \"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca\") " pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.842304 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.842287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvf8\" (UniqueName: \"kubernetes.io/projected/b7d4cd49-3cd3-468c-a4a7-f939044f65fd-kube-api-access-tsvf8\") pod \"network-check-source-7bc5b6bf85-89t96\" (UID: \"b7d4cd49-3cd3-468c-a4a7-f939044f65fd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"
Jul 23 13:07:45.910801 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.910770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"
Jul 23 13:07:45.922551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.922512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-z5s7f"
Jul 23 13:07:45.935094 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.934917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"
Jul 23 13:07:45.951261 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.951236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"
Jul 23 13:07:45.967015 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.966834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:45.988347 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.988273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"
Jul 23 13:07:45.996465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:45.996059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5s2mz"
Jul 23 13:07:46.162061 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.161631    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-z5s7f"]
Jul 23 13:07:46.166810 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.166777    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c7dd86_9953_44df_8b97_18c3e13f3396.slice/crio-d40e61f92c3f5269e3bf763ba97b36c9c285c6fafed1e38bf09d3f3c2290ca56 WatchSource:0}: Error finding container d40e61f92c3f5269e3bf763ba97b36c9c285c6fafed1e38bf09d3f3c2290ca56: Status 404 returned error can't find the container with id d40e61f92c3f5269e3bf763ba97b36c9c285c6fafed1e38bf09d3f3c2290ca56
Jul 23 13:07:46.175930 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.175850    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx"]
Jul 23 13:07:46.181894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.181834    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds"]
Jul 23 13:07:46.189808 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.189604    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbea7dc9_25d3_47ee_913b_aaee7899a192.slice/crio-f79aae86b92055f3b39bdc98f6668a860102dd53e7fb0ba863e37413d2b922a1 WatchSource:0}: Error finding container f79aae86b92055f3b39bdc98f6668a860102dd53e7fb0ba863e37413d2b922a1: Status 404 returned error can't find the container with id f79aae86b92055f3b39bdc98f6668a860102dd53e7fb0ba863e37413d2b922a1
Jul 23 13:07:46.190529 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.190219    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152c4a8b_63d7_4b29_aaf1_68c108337779.slice/crio-19de406e03b729243d0e6083bfd2eb7c4f3a72c6957105da89b9fc12ebdde5ac WatchSource:0}: Error finding container 19de406e03b729243d0e6083bfd2eb7c4f3a72c6957105da89b9fc12ebdde5ac: Status 404 returned error can't find the container with id 19de406e03b729243d0e6083bfd2eb7c4f3a72c6957105da89b9fc12ebdde5ac
Jul 23 13:07:46.213352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.213226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n77m8"]
Jul 23 13:07:46.215513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.215488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd"]
Jul 23 13:07:46.217046 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.216944    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6a6f39_bd9e_4f3c_8498_3eecb2b113ca.slice/crio-332bb320b628b3319a25880ac3bebbc66046ebfbb5f22201aa1088c3feeff030 WatchSource:0}: Error finding container 332bb320b628b3319a25880ac3bebbc66046ebfbb5f22201aa1088c3feeff030: Status 404 returned error can't find the container with id 332bb320b628b3319a25880ac3bebbc66046ebfbb5f22201aa1088c3feeff030
Jul 23 13:07:46.219316 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.219291    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218bcc1f_f828_406e_ac13_a2ddf646906e.slice/crio-ac7ab99d11878360b5ffcf0f2d585775d060d321cfaec0f288237a8150d34790 WatchSource:0}: Error finding container ac7ab99d11878360b5ffcf0f2d585775d060d321cfaec0f288237a8150d34790: Status 404 returned error can't find the container with id ac7ab99d11878360b5ffcf0f2d585775d060d321cfaec0f288237a8150d34790
Jul 23 13:07:46.228148 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.228125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96"]
Jul 23 13:07:46.230601 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.230576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d4cd49_3cd3_468c_a4a7_f939044f65fd.slice/crio-be4ed0acd5970054357b8dd09ee391ecbb9ebb5d626d035566d4122ac13fa202 WatchSource:0}: Error finding container be4ed0acd5970054357b8dd09ee391ecbb9ebb5d626d035566d4122ac13fa202: Status 404 returned error can't find the container with id be4ed0acd5970054357b8dd09ee391ecbb9ebb5d626d035566d4122ac13fa202
Jul 23 13:07:46.239194 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.239173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5s2mz"]
Jul 23 13:07:46.242410 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:46.242375    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4c1c22_a985_480c_8e0c_c50b8580ddea.slice/crio-3b09bb3d49f6de2a88333eaf5115af8822f59a9369f8906b327d044639512a3a WatchSource:0}: Error finding container 3b09bb3d49f6de2a88333eaf5115af8822f59a9369f8906b327d044639512a3a: Status 404 returned error can't find the container with id 3b09bb3d49f6de2a88333eaf5115af8822f59a9369f8906b327d044639512a3a
Jul 23 13:07:46.307821 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.307781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:46.334905 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.334788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:46.334905 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.334850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:46.335124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.334924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:46.335124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.334974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:46.335124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.335088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:46.335124 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.334976    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335136    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-694f8fbdb4-rm9b5: secret "image-registry-tls" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335141    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.335122676 +0000 UTC m=+38.072355981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : configmap references non-existent config key: service-ca.crt
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335180    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.335116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335043    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335111    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335206    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls podName:be520336-103b-4cd7-ac49-97d4f53ab17a nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.335187497 +0000 UTC m=+38.072420813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls") pod "image-registry-694f8fbdb4-rm9b5" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a") : secret "image-registry-tls" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335202    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335286    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls podName:2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.335274474 +0000 UTC m=+38.072507776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xssgj" (UID: "2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71") : secret "samples-operator-tls" not found
Jul 23 13:07:46.335297 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335302    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls podName:de2b7efa-7af3-4906-a5cc-7b5a0e1da935 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.33529424 +0000 UTC m=+38.072527537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls") pod "dns-default-h8m6l" (UID: "de2b7efa-7af3-4906-a5cc-7b5a0e1da935") : secret "dns-default-metrics-tls" not found
Jul 23 13:07:46.335730 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335318    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert podName:056168a5-4598-46b4-9073-6f5545103899 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.33531053 +0000 UTC m=+38.072543828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4hjgg" (UID: "056168a5-4598-46b4-9073-6f5545103899") : secret "networking-console-plugin-cert" not found
Jul 23 13:07:46.335730 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335333    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.335325899 +0000 UTC m=+38.072559201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : secret "router-metrics-certs-default" not found
Jul 23 13:07:46.335730 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.335394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:46.335730 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335482    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:46.335730 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:46.335525    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls podName:86887492-740c-4701-933e-9c22f54ea2c2 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:47.335513806 +0000 UTC m=+38.072747120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s6klq" (UID: "86887492-740c-4701-933e-9c22f54ea2c2") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:46.401960 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.401916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:46.601203 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.601101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:46.659816 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.659770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:46.764227 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.764178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:07:46.764227 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.764199    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:07:46.766773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.766751    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:07:46.767322 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.766807    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xq2s8\""
Jul 23 13:07:46.966970 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.966886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96" event={"ID":"b7d4cd49-3cd3-468c-a4a7-f939044f65fd","Type":"ContainerStarted","Data":"be4ed0acd5970054357b8dd09ee391ecbb9ebb5d626d035566d4122ac13fa202"}
Jul 23 13:07:46.973791 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.973760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" event={"ID":"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca","Type":"ContainerStarted","Data":"332bb320b628b3319a25880ac3bebbc66046ebfbb5f22201aa1088c3feeff030"}
Jul 23 13:07:46.977582 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.977553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd" event={"ID":"218bcc1f-f828-406e-ac13-a2ddf646906e","Type":"ContainerStarted","Data":"ac7ab99d11878360b5ffcf0f2d585775d060d321cfaec0f288237a8150d34790"}
Jul 23 13:07:46.979476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.979411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds" event={"ID":"bbea7dc9-25d3-47ee-913b-aaee7899a192","Type":"ContainerStarted","Data":"f79aae86b92055f3b39bdc98f6668a860102dd53e7fb0ba863e37413d2b922a1"}
Jul 23 13:07:46.983207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.983155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-z5s7f" event={"ID":"49c7dd86-9953-44df-8b97-18c3e13f3396","Type":"ContainerStarted","Data":"d40e61f92c3f5269e3bf763ba97b36c9c285c6fafed1e38bf09d3f3c2290ca56"}
Jul 23 13:07:46.987467 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.987411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx" event={"ID":"152c4a8b-63d7-4b29-aaf1-68c108337779","Type":"ContainerStarted","Data":"19de406e03b729243d0e6083bfd2eb7c4f3a72c6957105da89b9fc12ebdde5ac"}
Jul 23 13:07:46.989343 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:46.989292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5s2mz" event={"ID":"db4c1c22-a985-480c-8e0c-c50b8580ddea","Type":"ContainerStarted","Data":"3b09bb3d49f6de2a88333eaf5115af8822f59a9369f8906b327d044639512a3a"}
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.345767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.345830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.345875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.345910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.345957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.345988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:47.346092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346240    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346302    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.346283377 +0000 UTC m=+40.083516687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : secret "router-metrics-certs-default" not found
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346693    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346743    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls podName:2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.346727912 +0000 UTC m=+40.083961230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xssgj" (UID: "2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71") : secret "samples-operator-tls" not found
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346818    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:47.347340 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346851    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls podName:86887492-740c-4701-933e-9c22f54ea2c2 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.346840403 +0000 UTC m=+40.084073704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s6klq" (UID: "86887492-740c-4701-933e-9c22f54ea2c2") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346941    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346953    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-694f8fbdb4-rm9b5: secret "image-registry-tls" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.346985    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls podName:be520336-103b-4cd7-ac49-97d4f53ab17a nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.346974405 +0000 UTC m=+40.084207716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls") pod "image-registry-694f8fbdb4-rm9b5" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a") : secret "image-registry-tls" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.347051    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.347079    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls podName:de2b7efa-7af3-4906-a5cc-7b5a0e1da935 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.347069376 +0000 UTC m=+40.084302702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls") pod "dns-default-h8m6l" (UID: "de2b7efa-7af3-4906-a5cc-7b5a0e1da935") : secret "dns-default-metrics-tls" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.347135    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.347165    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert podName:056168a5-4598-46b4-9073-6f5545103899 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.347155407 +0000 UTC m=+40.084388719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4hjgg" (UID: "056168a5-4598-46b4-9073-6f5545103899") : secret "networking-console-plugin-cert" not found
Jul 23 13:07:47.348207 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:47.347232    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:49.347221267 +0000 UTC m=+40.084454569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : configmap references non-existent config key: service-ca.crt
Jul 23 13:07:49.368855 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.368814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.368883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.368965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.368970    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.369048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.369081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369115    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls podName:86887492-740c-4701-933e-9c22f54ea2c2 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.369094403 +0000 UTC m=+44.106327715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s6klq" (UID: "86887492-740c-4701-933e-9c22f54ea2c2") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369116    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369039    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369177    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-694f8fbdb4-rm9b5: secret "image-registry-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369177    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls podName:de2b7efa-7af3-4906-a5cc-7b5a0e1da935 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.369158567 +0000 UTC m=+44.106391882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls") pod "dns-default-h8m6l" (UID: "de2b7efa-7af3-4906-a5cc-7b5a0e1da935") : secret "dns-default-metrics-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369189    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369209    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls podName:be520336-103b-4cd7-ac49-97d4f53ab17a nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.369198663 +0000 UTC m=+44.106431981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls") pod "image-registry-694f8fbdb4-rm9b5" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a") : secret "image-registry-tls" not found
Jul 23 13:07:49.369383 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369246    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.369221152 +0000 UTC m=+44.106454463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : configmap references non-existent config key: service-ca.crt
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369280    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert podName:056168a5-4598-46b4-9073-6f5545103899 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.369270357 +0000 UTC m=+44.106503656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4hjgg" (UID: "056168a5-4598-46b4-9073-6f5545103899") : secret "networking-console-plugin-cert" not found
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.369351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:49.369381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369592    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369680    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls podName:2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.36966635 +0000 UTC m=+44.106899664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xssgj" (UID: "2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71") : secret "samples-operator-tls" not found
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369593    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:07:49.370042 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:49.369814    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:53.369791502 +0000 UTC m=+44.107024813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : secret "router-metrics-certs-default" not found
Jul 23 13:07:50.642476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:50.642438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:50.693215 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:50.693166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:53.404440 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:53.404440 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:53.404552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404576    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404638    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404643    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404643    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404655    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-694f8fbdb4-rm9b5: secret "image-registry-tls" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404693    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404576    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404659    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls podName:2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404638365 +0000 UTC m=+52.141871676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xssgj" (UID: "2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71") : secret "samples-operator-tls" not found
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404758    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404740177 +0000 UTC m=+52.141973489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : configmap references non-existent config key: service-ca.crt
Jul 23 13:07:53.405052 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404770    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls podName:de2b7efa-7af3-4906-a5cc-7b5a0e1da935 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404763596 +0000 UTC m=+52.141996896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls") pod "dns-default-h8m6l" (UID: "de2b7efa-7af3-4906-a5cc-7b5a0e1da935") : secret "dns-default-metrics-tls" not found
Jul 23 13:07:53.405838 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404780    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls podName:86887492-740c-4701-933e-9c22f54ea2c2 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404775096 +0000 UTC m=+52.142008392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s6klq" (UID: "86887492-740c-4701-933e-9c22f54ea2c2") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:07:53.405838 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404792    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls podName:be520336-103b-4cd7-ac49-97d4f53ab17a nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404785 +0000 UTC m=+52.142018300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls") pod "image-registry-694f8fbdb4-rm9b5" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a") : secret "image-registry-tls" not found
Jul 23 13:07:53.405838 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404806    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404798531 +0000 UTC m=+52.142031832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : secret "router-metrics-certs-default" not found
Jul 23 13:07:53.405838 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:53.404825    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert podName:056168a5-4598-46b4-9073-6f5545103899 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.404817744 +0000 UTC m=+52.142051048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4hjgg" (UID: "056168a5-4598-46b4-9073-6f5545103899") : secret "networking-console-plugin-cert" not found
Jul 23 13:07:56.023176 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.022134    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx" event={"ID":"152c4a8b-63d7-4b29-aaf1-68c108337779","Type":"ContainerStarted","Data":"9a2adc2cc9d896b0ae24068b8b71e424e3c92a3c53d4a083d511d0f7dfd95510"}
Jul 23 13:07:56.048779 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.048721    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx" podStartSLOduration=26.519739258 podStartE2EDuration="36.048700019s" totalImagesPullingTime="9.528960761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:56.04605147 +0000 UTC m=+46.783284785" watchObservedRunningTime="2026-07-23 13:07:56.048700019 +0000 UTC m=+46.785933342"
Jul 23 13:07:56.053145 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.053050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerStarted","Data":"7d92fbd14b3de95bb667e1f4ab56f06af684f30359d780b59a8e60fe4c79895b"}
Jul 23 13:07:56.055996 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.055322    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5s2mz" event={"ID":"db4c1c22-a985-480c-8e0c-c50b8580ddea","Type":"ContainerStarted","Data":"447474c54e47d7c3bb234faafcce696f3061759f79a2c8938c174107495550b2"}
Jul 23 13:07:56.067585 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.067564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96" event={"ID":"b7d4cd49-3cd3-468c-a4a7-f939044f65fd","Type":"ContainerStarted","Data":"5a262962f2f3e7aadaee3cbd5abd6d464109911c1d8d71133c7826b0d7d7d132"}
Jul 23 13:07:56.074096 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.074038    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5s2mz" podStartSLOduration=1.591259575 podStartE2EDuration="11.074019742s" totalImagesPullingTime="9.482760167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:56.070683462 +0000 UTC m=+46.807916782" watchObservedRunningTime="2026-07-23 13:07:56.074019742 +0000 UTC m=+46.811253059"
Jul 23 13:07:56.077143 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.075335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" event={"ID":"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca","Type":"ContainerStarted","Data":"79eabecd5480d6288b1a6a413df7fa29164f3c5eafb5e6e29339db1acdf725c5"}
Jul 23 13:07:56.077654 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.077350    2564 patch_prober.go:28] interesting pod/console-operator-565b7b569d-n77m8 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 23 13:07:56.077654 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.077393    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" podUID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 23 13:07:56.077654 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.077457    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:07:56.087049 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.084393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd" event={"ID":"218bcc1f-f828-406e-ac13-a2ddf646906e","Type":"ContainerStarted","Data":"b1c5dd0e0a6edde5676106fbb2ee7bb8816a7523d6383bb91262e65941ebe7f0"}
Jul 23 13:07:56.108455 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.108399    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-89t96" podStartSLOduration=25.617000289 podStartE2EDuration="35.108361831s" totalImagesPullingTime="9.491361542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:56.086831029 +0000 UTC m=+46.824064351" watchObservedRunningTime="2026-07-23 13:07:56.108361831 +0000 UTC m=+46.845595194"
Jul 23 13:07:56.110458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.110395    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd" podStartSLOduration=25.608332652 podStartE2EDuration="35.110378234s" totalImagesPullingTime="9.502045582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:56.106900512 +0000 UTC m=+46.844133840" watchObservedRunningTime="2026-07-23 13:07:56.110378234 +0000 UTC m=+46.847611554"
Jul 23 13:07:56.124577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.124516    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" podStartSLOduration=25.616152278 podStartE2EDuration="35.124496794s" totalImagesPullingTime="9.508344516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:56.123632236 +0000 UTC m=+46.860865555" watchObservedRunningTime="2026-07-23 13:07:56.124496794 +0000 UTC m=+46.861730118"
Jul 23 13:07:56.247592 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.247549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:56.306773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:56.306730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.026126 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.026011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.080819 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.080781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.094300 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.094272    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/0.log"
Jul 23 13:07:57.094466 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.094316    2564 generic.go:356] "Generic (PLEG): container finished" podID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca" containerID="79eabecd5480d6288b1a6a413df7fa29164f3c5eafb5e6e29339db1acdf725c5" exitCode=255
Jul 23 13:07:57.094608 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.094575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" event={"ID":"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca","Type":"ContainerDied","Data":"79eabecd5480d6288b1a6a413df7fa29164f3c5eafb5e6e29339db1acdf725c5"}
Jul 23 13:07:57.094760 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.094665    2564 scope.go:117] "RemoveContainer" containerID="79eabecd5480d6288b1a6a413df7fa29164f3c5eafb5e6e29339db1acdf725c5"
Jul 23 13:07:57.096306 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.096286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds" event={"ID":"bbea7dc9-25d3-47ee-913b-aaee7899a192","Type":"ContainerStarted","Data":"f0b486836fef657fc0ce36cd98b7705691409ae4da2d19358e212e59db52e9e6"}
Jul 23 13:07:57.098076 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.098051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-z5s7f" event={"ID":"49c7dd86-9953-44df-8b97-18c3e13f3396","Type":"ContainerStarted","Data":"c1b0f4a9eb89ad3e73fe9517c16be65b1a5873a4956b44697d07840ee7ea81b4"}
Jul 23 13:07:57.101195 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.101174    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d86db36-c12c-4fcc-bb73-98670e8c48d8" containerID="7d92fbd14b3de95bb667e1f4ab56f06af684f30359d780b59a8e60fe4c79895b" exitCode=0
Jul 23 13:07:57.101303 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.101265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerDied","Data":"7d92fbd14b3de95bb667e1f4ab56f06af684f30359d780b59a8e60fe4c79895b"}
Jul 23 13:07:57.111933 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.111887    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-vn2ds" podStartSLOduration=27.576872193 podStartE2EDuration="37.111850637s" totalImagesPullingTime="9.534978444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:56.149732327 +0000 UTC m=+46.886965648" watchObservedRunningTime="2026-07-23 13:07:57.111850637 +0000 UTC m=+47.849083958"
Jul 23 13:07:57.145198 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.145134    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-z5s7f" podStartSLOduration=27.583049485 podStartE2EDuration="37.145115949s" totalImagesPullingTime="9.562066464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:57.145085451 +0000 UTC m=+47.882318770" watchObservedRunningTime="2026-07-23 13:07:57.145115949 +0000 UTC m=+47.882349269"
Jul 23 13:07:57.279360 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.279289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.298520 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.298497    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"]
Jul 23 13:07:57.320902 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.320873    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"]
Jul 23 13:07:57.321033 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.320955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"
Jul 23 13:07:57.326039 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.326014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r4qsq\""
Jul 23 13:07:57.326462 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.326445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 13:07:57.326746 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.326730    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 13:07:57.345815 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.345787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.349933 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.349911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzpsm\" (UniqueName: \"kubernetes.io/projected/6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a-kube-api-access-hzpsm\") pod \"migrator-7cc9c7ffd7-gpdss\" (UID: \"6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"
Jul 23 13:07:57.399155 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.399123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.451685 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.451649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzpsm\" (UniqueName: \"kubernetes.io/projected/6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a-kube-api-access-hzpsm\") pod \"migrator-7cc9c7ffd7-gpdss\" (UID: \"6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"
Jul 23 13:07:57.460596 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.460572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzpsm\" (UniqueName: \"kubernetes.io/projected/6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a-kube-api-access-hzpsm\") pod \"migrator-7cc9c7ffd7-gpdss\" (UID: \"6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"
Jul 23 13:07:57.571544 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.569995    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-szvzt"]
Jul 23 13:07:57.592691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.592665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szvzt"]
Jul 23 13:07:57.592828 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.592772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.595352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.595327    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 13:07:57.595352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.595333    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 13:07:57.595560 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.595423    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-njgx6\""
Jul 23 13:07:57.604525 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.604504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.653289 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.653258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.653476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.653332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.653476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.653387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56eb01a4-e992-42b3-9569-9233dd796221-crio-socket\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.653476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.653411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56eb01a4-e992-42b3-9569-9233dd796221-data-volume\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.653476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.653465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6ggk\" (UniqueName: \"kubernetes.io/projected/56eb01a4-e992-42b3-9569-9233dd796221-kube-api-access-h6ggk\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.665467 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.665400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.698585 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.698558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"
Jul 23 13:07:57.753985 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.753959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56eb01a4-e992-42b3-9569-9233dd796221-crio-socket\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754103 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.753990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56eb01a4-e992-42b3-9569-9233dd796221-data-volume\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754103 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.754047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6ggk\" (UniqueName: \"kubernetes.io/projected/56eb01a4-e992-42b3-9569-9233dd796221-kube-api-access-h6ggk\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754103 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.754075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56eb01a4-e992-42b3-9569-9233dd796221-crio-socket\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754231 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.754175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754285 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.754231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754339 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:57.754310    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:07:57.754391 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:57.754333    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:07:57.754391 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:57.754379    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:58.254359481 +0000 UTC m=+48.991592793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : configmap "kube-rbac-proxy" not found
Jul 23 13:07:57.754391 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.754374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56eb01a4-e992-42b3-9569-9233dd796221-data-volume\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.754534 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:57.754407    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:58.254390914 +0000 UTC m=+48.991624226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:07:57.765322 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.765296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6ggk\" (UniqueName: \"kubernetes.io/projected/56eb01a4-e992-42b3-9569-9233dd796221-kube-api-access-h6ggk\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:57.768792 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.768765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.839060 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.838978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss"]
Jul 23 13:07:57.842557 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:57.842522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:57.842557 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:57.842549    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3f8f0c_afb2_49a7_b5f9_6f46c821c17a.slice/crio-96cbb09f0d30d2d5562ade1c5607936202c7025b5653e3ac3468fa78252d32aa WatchSource:0}: Error finding container 96cbb09f0d30d2d5562ade1c5607936202c7025b5653e3ac3468fa78252d32aa: Status 404 returned error can't find the container with id 96cbb09f0d30d2d5562ade1c5607936202c7025b5653e3ac3468fa78252d32aa
Jul 23 13:07:58.106415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.106333    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:07:58.106763 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.106723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/0.log"
Jul 23 13:07:58.106763 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.106755    2564 generic.go:356] "Generic (PLEG): container finished" podID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca" containerID="491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2" exitCode=255
Jul 23 13:07:58.106836 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.106821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" event={"ID":"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca","Type":"ContainerDied","Data":"491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2"}
Jul 23 13:07:58.106890 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.106883    2564 scope.go:117] "RemoveContainer" containerID="79eabecd5480d6288b1a6a413df7fa29164f3c5eafb5e6e29339db1acdf725c5"
Jul 23 13:07:58.107098 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.107065    2564 scope.go:117] "RemoveContainer" containerID="491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2"
Jul 23 13:07:58.107292 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:58.107269    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n77m8_openshift-console-operator(3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" podUID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca"
Jul 23 13:07:58.110046 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.108521    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss" event={"ID":"6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a","Type":"ContainerStarted","Data":"96cbb09f0d30d2d5562ade1c5607936202c7025b5653e3ac3468fa78252d32aa"}
Jul 23 13:07:58.112979 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.112961    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d86db36-c12c-4fcc-bb73-98670e8c48d8" containerID="11b9bd8adf26367814f60e84d5d44811ea770132654cce6a2a58ad8e6f17ea3c" exitCode=0
Jul 23 13:07:58.113061 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.113038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerDied","Data":"11b9bd8adf26367814f60e84d5d44811ea770132654cce6a2a58ad8e6f17ea3c"}
Jul 23 13:07:58.258450 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.258427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:58.258570 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:58.258530    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:07:58.258625 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:58.258582    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:59.25856534 +0000 UTC m=+49.995798656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:07:58.258625 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.258602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:58.258738 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:58.258692    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:07:58.258794 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:58.258737    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:07:59.258718909 +0000 UTC m=+49.995952210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : configmap "kube-rbac-proxy" not found
Jul 23 13:07:58.863476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.863441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:58.922168 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:58.922132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:59.118831 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.118760    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:07:59.119279 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.119166    2564 scope.go:117] "RemoveContainer" containerID="491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2"
Jul 23 13:07:59.119398 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:59.119367    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n77m8_openshift-console-operator(3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" podUID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca"
Jul 23 13:07:59.122782 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.122759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" event={"ID":"3d86db36-c12c-4fcc-bb73-98670e8c48d8","Type":"ContainerStarted","Data":"42b498b5465907d4748067851668aef019620a7a77efc731049b463a8ea83be9"}
Jul 23 13:07:59.158878 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.156910    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s7n2m" podStartSLOduration=8.553797457 podStartE2EDuration="49.156890536s" totalImagesPullingTime="40.603093079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:07:59.154733821 +0000 UTC m=+49.891967133" watchObservedRunningTime="2026-07-23 13:07:59.156890536 +0000 UTC m=+49.894123856"
Jul 23 13:07:59.266714 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.266681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:59.266883 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.266740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:07:59.266883 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:59.266829    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:07:59.266883 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:59.266877    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:07:59.266993 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:59.266926    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.266909526 +0000 UTC m=+52.004142828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:07:59.266993 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:07:59.266941    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:01.266934314 +0000 UTC m=+52.004167611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : configmap "kube-rbac-proxy" not found
Jul 23 13:07:59.275205 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.275177    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:59.339476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.339449    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wx7zw"]
Jul 23 13:07:59.352411 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.352391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wx7zw"]
Jul 23 13:07:59.352541 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.352478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.355182 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.355162    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 13:07:59.355374 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.355349    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 13:07:59.355506 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.355390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 13:07:59.355716 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.355700    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 13:07:59.355840 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.355820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nzb74\""
Jul 23 13:07:59.356728 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.356703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:59.368026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.368008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2f7a1b8-3753-42b0-8088-cda7a15542bf-signing-cabundle\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.368106 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.368039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2f7a1b8-3753-42b0-8088-cda7a15542bf-signing-key\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.368106 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.368056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4jmm\" (UniqueName: \"kubernetes.io/projected/a2f7a1b8-3753-42b0-8088-cda7a15542bf-kube-api-access-d4jmm\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.468920 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.468888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2f7a1b8-3753-42b0-8088-cda7a15542bf-signing-key\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.468920 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.468922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4jmm\" (UniqueName: \"kubernetes.io/projected/a2f7a1b8-3753-42b0-8088-cda7a15542bf-kube-api-access-d4jmm\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.469095 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.469072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2f7a1b8-3753-42b0-8088-cda7a15542bf-signing-cabundle\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.469638 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.469607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2f7a1b8-3753-42b0-8088-cda7a15542bf-signing-cabundle\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.471140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.471107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2f7a1b8-3753-42b0-8088-cda7a15542bf-signing-key\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.472350 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.472327    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:59.478070 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.478050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4jmm\" (UniqueName: \"kubernetes.io/projected/a2f7a1b8-3753-42b0-8088-cda7a15542bf-kube-api-access-d4jmm\") pod \"service-ca-58598695f7-wx7zw\" (UID: \"a2f7a1b8-3753-42b0-8088-cda7a15542bf\") " pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.564499 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.564468    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mfjz8_85c3bafa-fdcd-4ebc-a8a5-829241bf2256/dns-node-resolver/0.log"
Jul 23 13:07:59.565138 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.565109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:07:59.662171 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.662150    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wx7zw"
Jul 23 13:07:59.823339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:07:59.823315    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wx7zw"]
Jul 23 13:07:59.825764 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:07:59.825742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f7a1b8_3753_42b0_8088_cda7a15542bf.slice/crio-d2a0102c1843bd808be8bd43f8f425a4858428a9e930effc260411d1170e66e4 WatchSource:0}: Error finding container d2a0102c1843bd808be8bd43f8f425a4858428a9e930effc260411d1170e66e4: Status 404 returned error can't find the container with id d2a0102c1843bd808be8bd43f8f425a4858428a9e930effc260411d1170e66e4
Jul 23 13:08:00.128161 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.128067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wx7zw" event={"ID":"a2f7a1b8-3753-42b0-8088-cda7a15542bf","Type":"ContainerStarted","Data":"450ff8d03022fa27ba37d849cad3c4a590a0c6796b3610fe46760b090ff6b2ab"}
Jul 23 13:08:00.128161 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.128123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wx7zw" event={"ID":"a2f7a1b8-3753-42b0-8088-cda7a15542bf","Type":"ContainerStarted","Data":"d2a0102c1843bd808be8bd43f8f425a4858428a9e930effc260411d1170e66e4"}
Jul 23 13:08:00.129787 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.129765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss" event={"ID":"6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a","Type":"ContainerStarted","Data":"be72b68729831194e42d57bfd1d9562be0644cc39921ca0fd872a3d1fd6187ce"}
Jul 23 13:08:00.129937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.129811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss" event={"ID":"6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a","Type":"ContainerStarted","Data":"8e43a341d454e3de2434ad3347edac9f32c61045e76053d700756499bf0e40eb"}
Jul 23 13:08:00.146002 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.145953    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-wx7zw" podStartSLOduration=1.145935407 podStartE2EDuration="1.145935407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:00.14419899 +0000 UTC m=+50.881432310" watchObservedRunningTime="2026-07-23 13:08:00.145935407 +0000 UTC m=+50.883168727"
Jul 23 13:08:00.161372 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.161330    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-gpdss" podStartSLOduration=1.408384334 podStartE2EDuration="3.161315855s" totalImagesPullingTime="1.752931521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:00.160006354 +0000 UTC m=+50.897239673" watchObservedRunningTime="2026-07-23 13:08:00.161315855 +0000 UTC m=+50.898549203"
Jul 23 13:08:00.510694 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.510659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:00.764980 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:00.764907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vjk79_0fb22276-523d-40bb-a08d-797dee02ef5b/node-ca/0.log"
Jul 23 13:08:01.011017 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.010975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:01.164830 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.164806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5s2mz_db4c1c22-a985-480c-8e0c-c50b8580ddea/serve-healthcheck-canary/0.log"
Jul 23 13:08:01.184307 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.184280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:01.287818 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.287788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:01.288003 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.287886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:01.288106 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.288088    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:08:01.288229 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.288166    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:08:01.288288 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.288232    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:05.288193384 +0000 UTC m=+56.025426695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : configmap "kube-rbac-proxy" not found
Jul 23 13:08:01.288288 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.288254    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:05.288243695 +0000 UTC m=+56.025476994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:08:01.299362 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.299337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:01.365383 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.365358    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-gpdss_6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a/migrator/0.log"
Jul 23 13:08:01.415660 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.415569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:01.490336 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:08:01.490503 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:08:01.490503 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:01.490503 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490482    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:08:01.490503 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490482    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490541    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls podName:de2b7efa-7af3-4906-a5cc-7b5a0e1da935 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490523915 +0000 UTC m=+68.227757215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls") pod "dns-default-h8m6l" (UID: "de2b7efa-7af3-4906-a5cc-7b5a0e1da935") : secret "dns-default-metrics-tls" not found
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490576    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490600    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490605    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490584736 +0000 UTC m=+68.227818040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : configmap references non-existent config key: service-ca.crt
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert podName:056168a5-4598-46b4-9073-6f5545103899 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490661178 +0000 UTC m=+68.227894478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4hjgg" (UID: "056168a5-4598-46b4-9073-6f5545103899") : secret "networking-console-plugin-cert" not found
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490691    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls podName:2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490681753 +0000 UTC m=+68.227915059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xssgj" (UID: "2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71") : secret "samples-operator-tls" not found
Jul 23 13:08:01.490716 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490712    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs podName:30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490703922 +0000 UTC m=+68.227937219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs") pod "router-default-6997dd8868-5k8xv" (UID: "30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1") : secret "router-metrics-certs-default" not found
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.490782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490832    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490880    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls podName:86887492-740c-4701-933e-9c22f54ea2c2 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490853578 +0000 UTC m=+68.228086901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s6klq" (UID: "86887492-740c-4701-933e-9c22f54ea2c2") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490886    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490898    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-694f8fbdb4-rm9b5: secret "image-registry-tls" not found
Jul 23 13:08:01.491198 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:01.490933    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls podName:be520336-103b-4cd7-ac49-97d4f53ab17a nodeName:}" failed. No retries permitted until 2026-07-23 13:08:17.490921751 +0000 UTC m=+68.228155049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls") pod "image-registry-694f8fbdb4-rm9b5" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a") : secret "image-registry-tls" not found
Jul 23 13:08:01.562997 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.562949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log" limit=1024
Jul 23 13:08:01.563715 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.563688    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-gpdss_6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a/graceful-termination/0.log"
Jul 23 13:08:01.767097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:01.767006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7wbhx_152c4a8b-63d7-4b29-aaf1-68c108337779/kube-storage-version-migrator-operator/0.log"
Jul 23 13:08:05.323990 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:05.323961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:05.324498 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:05.324011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:05.324498 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:05.324125    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:08:05.324498 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:05.324201    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls podName:56eb01a4-e992-42b3-9569-9233dd796221 nodeName:}" failed. No retries permitted until 2026-07-23 13:08:13.324185696 +0000 UTC m=+64.061419014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szvzt" (UID: "56eb01a4-e992-42b3-9569-9233dd796221") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:08:05.324730 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:05.324708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56eb01a4-e992-42b3-9569-9233dd796221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:05.967843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:05.967814    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:08:05.968224 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:05.968211    2564 scope.go:117] "RemoveContainer" containerID="491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2"
Jul 23 13:08:05.968380 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:05.968362    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n77m8_openshift-console-operator(3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" podUID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca"
Jul 23 13:08:06.076799 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:06.076753    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:08:06.152845 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:06.152818    2564 scope.go:117] "RemoveContainer" containerID="491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2"
Jul 23 13:08:06.153011 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:08:06.152992    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n77m8_openshift-console-operator(3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" podUID="3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca"
Jul 23 13:08:11.959617 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:11.959588    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fdfk"
Jul 23 13:08:13.398045 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:13.397995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:13.400314 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:13.400290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56eb01a4-e992-42b3-9569-9233dd796221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szvzt\" (UID: \"56eb01a4-e992-42b3-9569-9233dd796221\") " pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:13.504419 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:13.504389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-njgx6\""
Jul 23 13:08:13.512576 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:13.512557    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szvzt"
Jul 23 13:08:13.636296 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:13.636257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szvzt"]
Jul 23 13:08:13.639257 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:13.639225    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56eb01a4_e992_42b3_9569_9233dd796221.slice/crio-6f9b6f275c531122023fbbb72b8461fe1660c79776f33d82bab5d5ef28967b05 WatchSource:0}: Error finding container 6f9b6f275c531122023fbbb72b8461fe1660c79776f33d82bab5d5ef28967b05: Status 404 returned error can't find the container with id 6f9b6f275c531122023fbbb72b8461fe1660c79776f33d82bab5d5ef28967b05
Jul 23 13:08:14.183550 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:14.183510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szvzt" event={"ID":"56eb01a4-e992-42b3-9569-9233dd796221","Type":"ContainerStarted","Data":"6f9b6f275c531122023fbbb72b8461fe1660c79776f33d82bab5d5ef28967b05"}
Jul 23 13:08:15.419827 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.419786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:08:15.420289 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.419916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:08:15.422722 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.422694    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:08:15.422850 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.422761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6wn\" (UniqueName: \"kubernetes.io/projected/3f547047-4af3-4766-91a9-84c3342dbf83-kube-api-access-ml6wn\") pod \"network-check-target-kxq2v\" (UID: \"3f547047-4af3-4766-91a9-84c3342dbf83\") " pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:08:15.432852 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.432829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b1320da-c6b8-408a-b1a2-19d69a83827e-original-pull-secret\") pod \"global-pull-secret-syncer-xzsbl\" (UID: \"3b1320da-c6b8-408a-b1a2-19d69a83827e\") " pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:08:15.520484 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.520444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:08:15.523033 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.523001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:08:15.534240 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.534200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d17da8d2-de85-43fb-ae9d-ba765c9a330b-metrics-certs\") pod \"network-metrics-daemon-8dz4q\" (UID: \"d17da8d2-de85-43fb-ae9d-ba765c9a330b\") " pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:08:15.578380 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.578345    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzsbl"
Jul 23 13:08:15.586343 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.586319    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xq2s8\""
Jul 23 13:08:15.594298 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.594268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:08:15.742966 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.742927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xzsbl"]
Jul 23 13:08:15.747451 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:15.747422    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1320da_c6b8_408a_b1a2_19d69a83827e.slice/crio-8a2711a44c10b231786f5f815c45fc4467bf7eb82f63b55b99adbfc33c04d444 WatchSource:0}: Error finding container 8a2711a44c10b231786f5f815c45fc4467bf7eb82f63b55b99adbfc33c04d444: Status 404 returned error can't find the container with id 8a2711a44c10b231786f5f815c45fc4467bf7eb82f63b55b99adbfc33c04d444
Jul 23 13:08:15.763345 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.763316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxq2v"]
Jul 23 13:08:15.766789 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:15.766763    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f547047_4af3_4766_91a9_84c3342dbf83.slice/crio-20450a61eeff5b21d4e67a8a59670a37cc4e6702937338c911cd80596f3a8354 WatchSource:0}: Error finding container 20450a61eeff5b21d4e67a8a59670a37cc4e6702937338c911cd80596f3a8354: Status 404 returned error can't find the container with id 20450a61eeff5b21d4e67a8a59670a37cc4e6702937338c911cd80596f3a8354
Jul 23 13:08:15.776420 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.776401    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5gct\""
Jul 23 13:08:15.783604 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:15.783584    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dz4q"
Jul 23 13:08:16.192098 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:16.192050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xzsbl" event={"ID":"3b1320da-c6b8-408a-b1a2-19d69a83827e","Type":"ContainerStarted","Data":"8a2711a44c10b231786f5f815c45fc4467bf7eb82f63b55b99adbfc33c04d444"}
Jul 23 13:08:16.193722 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:16.193695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxq2v" event={"ID":"3f547047-4af3-4766-91a9-84c3342dbf83","Type":"ContainerStarted","Data":"541be0fa2ae2c57b207c362dd995431903e9a37832b6db8d6fdfd8dc22dbd3e8"}
Jul 23 13:08:16.193855 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:16.193740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxq2v" event={"ID":"3f547047-4af3-4766-91a9-84c3342dbf83","Type":"ContainerStarted","Data":"20450a61eeff5b21d4e67a8a59670a37cc4e6702937338c911cd80596f3a8354"}
Jul 23 13:08:16.193930 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:16.193873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:08:16.212639 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:16.212566    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kxq2v" podStartSLOduration=66.212544973 podStartE2EDuration="1m6.212544973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:16.211381051 +0000 UTC m=+66.948614370" watchObservedRunningTime="2026-07-23 13:08:16.212544973 +0000 UTC m=+66.949778293"
Jul 23 13:08:17.539625 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:17.540222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:08:17.540222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:08:17.540222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:08:17.540222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:08:17.540222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:08:17.540222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.539813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:17.540744 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.540713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-service-ca-bundle\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:17.542705 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.542681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056168a5-4598-46b4-9073-6f5545103899-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4hjgg\" (UID: \"056168a5-4598-46b4-9073-6f5545103899\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:08:17.543149 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.543128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86887492-740c-4701-933e-9c22f54ea2c2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s6klq\" (UID: \"86887492-740c-4701-933e-9c22f54ea2c2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:08:17.543244 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.543216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"image-registry-694f8fbdb4-rm9b5\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") " pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:08:17.543286 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.543250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1-metrics-certs\") pod \"router-default-6997dd8868-5k8xv\" (UID: \"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1\") " pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:17.543286 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.543256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xssgj\" (UID: \"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:08:17.543954 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.543924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2b7efa-7af3-4906-a5cc-7b5a0e1da935-metrics-tls\") pod \"dns-default-h8m6l\" (UID: \"de2b7efa-7af3-4906-a5cc-7b5a0e1da935\") " pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:08:17.684996 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.684965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9cnr7\""
Jul 23 13:08:17.692873 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.692842    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:08:17.700695 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.700670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gbjh8\""
Jul 23 13:08:17.709241 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.709214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"
Jul 23 13:08:17.744678 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.744644    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9kcp5\""
Jul 23 13:08:17.752951 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.752926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:17.763182 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.763167    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b6wbz\""
Jul 23 13:08:17.771953 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.771905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:08:17.776323 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.776309    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6hgjx\""
Jul 23 13:08:17.784177 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.784155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-59sxs\""
Jul 23 13:08:17.784320 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.784290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"
Jul 23 13:08:17.792140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:17.792096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"
Jul 23 13:08:18.876119 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.875893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq"]
Jul 23 13:08:18.878831 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:18.878799    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86887492_740c_4701_933e_9c22f54ea2c2.slice/crio-bec7d92715a50051cc9ac3bf53551ca43dea45212fd47199e8337e62f32ddba9 WatchSource:0}: Error finding container bec7d92715a50051cc9ac3bf53551ca43dea45212fd47199e8337e62f32ddba9: Status 404 returned error can't find the container with id bec7d92715a50051cc9ac3bf53551ca43dea45212fd47199e8337e62f32ddba9
Jul 23 13:08:18.881748 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.881688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg"]
Jul 23 13:08:18.884799 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:18.884772    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056168a5_4598_46b4_9073_6f5545103899.slice/crio-418a8b96be5cfbb6f8f080bee031ea50a9c756a10fddc864c95c1d07ed7eb050 WatchSource:0}: Error finding container 418a8b96be5cfbb6f8f080bee031ea50a9c756a10fddc864c95c1d07ed7eb050: Status 404 returned error can't find the container with id 418a8b96be5cfbb6f8f080bee031ea50a9c756a10fddc864c95c1d07ed7eb050
Jul 23 13:08:18.886601 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.886142    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6997dd8868-5k8xv"]
Jul 23 13:08:18.887376 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.887351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-694f8fbdb4-rm9b5"]
Jul 23 13:08:18.890631 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:18.890584    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe520336_103b_4cd7_ac49_97d4f53ab17a.slice/crio-b2f9f0e19d6a5147a749dbecdec32bed5ba6cbd381c1b402bbc405450cc4b688 WatchSource:0}: Error finding container b2f9f0e19d6a5147a749dbecdec32bed5ba6cbd381c1b402bbc405450cc4b688: Status 404 returned error can't find the container with id b2f9f0e19d6a5147a749dbecdec32bed5ba6cbd381c1b402bbc405450cc4b688
Jul 23 13:08:18.893956 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:18.893935    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bab3ae_5e53_40c4_b81d_2bf5f14ad9b1.slice/crio-48c092da2faca255c5fdd5f3b90b35e9b688fbf35b24ba6b9282687e6cc6db9e WatchSource:0}: Error finding container 48c092da2faca255c5fdd5f3b90b35e9b688fbf35b24ba6b9282687e6cc6db9e: Status 404 returned error can't find the container with id 48c092da2faca255c5fdd5f3b90b35e9b688fbf35b24ba6b9282687e6cc6db9e
Jul 23 13:08:18.938335 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.938310    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8dz4q"]
Jul 23 13:08:18.942638 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.942599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj"]
Jul 23 13:08:18.943752 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:18.943637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8m6l"]
Jul 23 13:08:19.208850 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.208696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szvzt" event={"ID":"56eb01a4-e992-42b3-9569-9233dd796221","Type":"ContainerStarted","Data":"81255e9582c6714d85ce11d9e92b2d18073c0929a8eb17f29750388293403052"}
Jul 23 13:08:19.210686 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.210654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dz4q" event={"ID":"d17da8d2-de85-43fb-ae9d-ba765c9a330b","Type":"ContainerStarted","Data":"629c39ab4f629ed85f9a03271499ef2e36938367644d06e89dad1fd7adc024d8"}
Jul 23 13:08:19.212728 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.212703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" event={"ID":"be520336-103b-4cd7-ac49-97d4f53ab17a","Type":"ContainerStarted","Data":"d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a"}
Jul 23 13:08:19.212822 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.212748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" event={"ID":"be520336-103b-4cd7-ac49-97d4f53ab17a","Type":"ContainerStarted","Data":"b2f9f0e19d6a5147a749dbecdec32bed5ba6cbd381c1b402bbc405450cc4b688"}
Jul 23 13:08:19.213570 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.213551    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:08:19.215465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.215439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8m6l" event={"ID":"de2b7efa-7af3-4906-a5cc-7b5a0e1da935","Type":"ContainerStarted","Data":"2d3d05a863a0e43232030916da48f6695e8053ae19e3fcceb812f5c24c3339da"}
Jul 23 13:08:19.217752 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.217732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj" event={"ID":"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71","Type":"ContainerStarted","Data":"2e893b3574f6484582f9d76d8516dd072c9ede852b647d6dfedb25ffae2f11d0"}
Jul 23 13:08:19.219890 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.219833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg" event={"ID":"056168a5-4598-46b4-9073-6f5545103899","Type":"ContainerStarted","Data":"418a8b96be5cfbb6f8f080bee031ea50a9c756a10fddc864c95c1d07ed7eb050"}
Jul 23 13:08:19.221089 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.221029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq" event={"ID":"86887492-740c-4701-933e-9c22f54ea2c2","Type":"ContainerStarted","Data":"bec7d92715a50051cc9ac3bf53551ca43dea45212fd47199e8337e62f32ddba9"}
Jul 23 13:08:19.223175 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.223151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6997dd8868-5k8xv" event={"ID":"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1","Type":"ContainerStarted","Data":"060015e3ffa1e0f87e7e216f99d3c26f46661142f5373cb6cdace73caaa6e909"}
Jul 23 13:08:19.223266 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.223191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6997dd8868-5k8xv" event={"ID":"30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1","Type":"ContainerStarted","Data":"48c092da2faca255c5fdd5f3b90b35e9b688fbf35b24ba6b9282687e6cc6db9e"}
Jul 23 13:08:19.234998 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.234951    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" podStartSLOduration=68.234933234 podStartE2EDuration="1m8.234933234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:19.233522476 +0000 UTC m=+69.970755806" watchObservedRunningTime="2026-07-23 13:08:19.234933234 +0000 UTC m=+69.972166555"
Jul 23 13:08:19.256450 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.256361    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6997dd8868-5k8xv" podStartSLOduration=59.256343606 podStartE2EDuration="59.256343606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:19.254303561 +0000 UTC m=+69.991536881" watchObservedRunningTime="2026-07-23 13:08:19.256343606 +0000 UTC m=+69.993576925"
Jul 23 13:08:19.753739 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.753700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:19.756966 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:19.756737    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:20.232529 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.232186    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:20.233735 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.233521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6997dd8868-5k8xv"
Jul 23 13:08:20.822541 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.822447    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"]
Jul 23 13:08:20.826955 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.825877    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"]
Jul 23 13:08:20.826955 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.826775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:20.831203 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.829409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"]
Jul 23 13:08:20.831203 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.830850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:20.833486 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.832749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.836107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.836084    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.836308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.836553    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.836807    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.836888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.837037    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.837116    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qgstg\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.837274    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 13:08:20.837458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.837299    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 13:08:20.839526 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.839505    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 13:08:20.849196 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.847647    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"]
Jul 23 13:08:20.852662 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.852601    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"]
Jul 23 13:08:20.853663 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.853547    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"]
Jul 23 13:08:20.975267 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2722767-4f42-4a8d-811c-8cf08033bf13-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54676d5f6-dvsw8\" (UID: \"c2722767-4f42-4a8d-811c-8cf08033bf13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:20.975434 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-hub\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.975434 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.975434 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-klusterlet-config\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:20.975434 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-ca\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.975657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5ss\" (UniqueName: \"kubernetes.io/projected/c2722767-4f42-4a8d-811c-8cf08033bf13-kube-api-access-kf5ss\") pod \"managed-serviceaccount-addon-agent-54676d5f6-dvsw8\" (UID: \"c2722767-4f42-4a8d-811c-8cf08033bf13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:20.975657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-additional-service-ca\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.975657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4mk5\" (UniqueName: \"kubernetes.io/projected/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-kube-api-access-r4mk5\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.975657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:20.975657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-tmp\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:20.975657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:20.975609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctjj8\" (UniqueName: \"kubernetes.io/projected/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-kube-api-access-ctjj8\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.076891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-tmp\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.076950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctjj8\" (UniqueName: \"kubernetes.io/projected/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-kube-api-access-ctjj8\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.076991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2722767-4f42-4a8d-811c-8cf08033bf13-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54676d5f6-dvsw8\" (UID: \"c2722767-4f42-4a8d-811c-8cf08033bf13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-hub\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-klusterlet-config\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-ca\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077169    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5ss\" (UniqueName: \"kubernetes.io/projected/c2722767-4f42-4a8d-811c-8cf08033bf13-kube-api-access-kf5ss\") pod \"managed-serviceaccount-addon-agent-54676d5f6-dvsw8\" (UID: \"c2722767-4f42-4a8d-811c-8cf08033bf13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-additional-service-ca\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mk5\" (UniqueName: \"kubernetes.io/projected/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-kube-api-access-r4mk5\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.077288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.078407 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.077343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-tmp\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.078407 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.078337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-additional-service-ca\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.082199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.082146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.082932 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.082805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-klusterlet-config\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.082932 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.082879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.083486 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.083378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-ca\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.084261 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.084220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-hub\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.086711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.086690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2722767-4f42-4a8d-811c-8cf08033bf13-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54676d5f6-dvsw8\" (UID: \"c2722767-4f42-4a8d-811c-8cf08033bf13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:21.090932 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.090217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4mk5\" (UniqueName: \"kubernetes.io/projected/73dcbe0b-c7b5-41f2-aca7-b956238a7e05-kube-api-access-r4mk5\") pod \"cluster-proxy-proxy-agent-747445c64-m8tfx\" (UID: \"73dcbe0b-c7b5-41f2-aca7-b956238a7e05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.095546 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.095501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5ss\" (UniqueName: \"kubernetes.io/projected/c2722767-4f42-4a8d-811c-8cf08033bf13-kube-api-access-kf5ss\") pod \"managed-serviceaccount-addon-agent-54676d5f6-dvsw8\" (UID: \"c2722767-4f42-4a8d-811c-8cf08033bf13\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:21.102555 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.102513    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctjj8\" (UniqueName: \"kubernetes.io/projected/c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01-kube-api-access-ctjj8\") pod \"klusterlet-addon-workmgr-76cdf4654c-m7hl4\" (UID: \"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.165893 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.165604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"
Jul 23 13:08:21.176744 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.176573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:21.188094 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.187885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"
Jul 23 13:08:21.764465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:21.764436    2564 scope.go:117] "RemoveContainer" containerID="491218ce62424266cfb9ded5b35239d6253174bb4b2cbde67099103aad05a3e2"
Jul 23 13:08:27.322731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:27.322682    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"]
Jul 23 13:08:27.380142 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:27.380116    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bcb4dc_ba9b_4187_93dd_e5a8e3613b01.slice/crio-905508cb6688d7524d7cee364e46fc3e03e57da3134265588420e701f7454bdd WatchSource:0}: Error finding container 905508cb6688d7524d7cee364e46fc3e03e57da3134265588420e701f7454bdd: Status 404 returned error can't find the container with id 905508cb6688d7524d7cee364e46fc3e03e57da3134265588420e701f7454bdd
Jul 23 13:08:27.560587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:27.560555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8"]
Jul 23 13:08:27.566670 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:27.566389    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2722767_4f42_4a8d_811c_8cf08033bf13.slice/crio-3ffda6a0853f9f8a95e89bba8ecf784eafc9ec39a01d2245ce5014078f2a21eb WatchSource:0}: Error finding container 3ffda6a0853f9f8a95e89bba8ecf784eafc9ec39a01d2245ce5014078f2a21eb: Status 404 returned error can't find the container with id 3ffda6a0853f9f8a95e89bba8ecf784eafc9ec39a01d2245ce5014078f2a21eb
Jul 23 13:08:27.585621 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:27.585594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx"]
Jul 23 13:08:27.591333 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:27.591287    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73dcbe0b_c7b5_41f2_aca7_b956238a7e05.slice/crio-c73d280b8c433a87659624ab2b97c17459a073a8a597d4ce7f22ab6bb9972b64 WatchSource:0}: Error finding container c73d280b8c433a87659624ab2b97c17459a073a8a597d4ce7f22ab6bb9972b64: Status 404 returned error can't find the container with id c73d280b8c433a87659624ab2b97c17459a073a8a597d4ce7f22ab6bb9972b64
Jul 23 13:08:28.268218 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.268133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8m6l" event={"ID":"de2b7efa-7af3-4906-a5cc-7b5a0e1da935","Type":"ContainerStarted","Data":"626e6435d24542cae7ee794bc1a07115667be7515803f4d2f63bdbfe4a30485d"}
Jul 23 13:08:28.268435 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.268252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8m6l" event={"ID":"de2b7efa-7af3-4906-a5cc-7b5a0e1da935","Type":"ContainerStarted","Data":"9fa5c68b476b864a0f475a1642fc49a28e816021e6bc940f35824888950f4cf6"}
Jul 23 13:08:28.268435 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.268328    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:08:28.271148 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.271114    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj" event={"ID":"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71","Type":"ContainerStarted","Data":"53b04da52ff4f6dcc7976e6da49f59d4f87fd426da20a0050d0a1440bafd1eec"}
Jul 23 13:08:28.271256 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.271170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj" event={"ID":"2fbd6b00-1dd1-4d82-94fe-d12e3bddcb71","Type":"ContainerStarted","Data":"d08e1632f6472412534a251bcbdc999bcd5c977778835910b61e6e348a1691fc"}
Jul 23 13:08:28.274450 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.274425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xzsbl" event={"ID":"3b1320da-c6b8-408a-b1a2-19d69a83827e","Type":"ContainerStarted","Data":"5b7a44570d76d215663282deaa67a8c862a368324abef949c23ea50f975b59d8"}
Jul 23 13:08:28.277231 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.277101    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:08:28.277231 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.277199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n77m8" event={"ID":"3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca","Type":"ContainerStarted","Data":"b0d65c7780b7c78ba1736dd123a84bd9761dd9bbbee630c37be55369d06fc524"}
Jul 23 13:08:28.277580 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.277561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:08:28.279423 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.279401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg" event={"ID":"056168a5-4598-46b4-9073-6f5545103899","Type":"ContainerStarted","Data":"c4e62a0e7fed5739cb53732746ba522bd7a13a30e49b057e644b8af6c88688da"}
Jul 23 13:08:28.282081 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.282061    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq" event={"ID":"86887492-740c-4701-933e-9c22f54ea2c2","Type":"ContainerStarted","Data":"5f96dfe7f962a528a07696ee51ada77b239cd3a9fab04a760654edbd5732b0fb"}
Jul 23 13:08:28.283792 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.283774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-n77m8"
Jul 23 13:08:28.283979 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.283958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4" event={"ID":"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01","Type":"ContainerStarted","Data":"905508cb6688d7524d7cee364e46fc3e03e57da3134265588420e701f7454bdd"}
Jul 23 13:08:28.288208 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.286963    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h8m6l" podStartSLOduration=34.851879023 podStartE2EDuration="43.286946117s" totalImagesPullingTime="8.435067094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:28.285467942 +0000 UTC m=+79.022701261" watchObservedRunningTime="2026-07-23 13:08:28.286946117 +0000 UTC m=+79.024179449"
Jul 23 13:08:28.288979 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.288818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szvzt" event={"ID":"56eb01a4-e992-42b3-9569-9233dd796221","Type":"ContainerStarted","Data":"be16c7d251a93b6f4d3fb6f87343ce8fcfd28d3ad38b0b72ab9ad9e962844a41"}
Jul 23 13:08:28.291322 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.291300    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8" event={"ID":"c2722767-4f42-4a8d-811c-8cf08033bf13","Type":"ContainerStarted","Data":"3ffda6a0853f9f8a95e89bba8ecf784eafc9ec39a01d2245ce5014078f2a21eb"}
Jul 23 13:08:28.293153 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.293128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx" event={"ID":"73dcbe0b-c7b5-41f2-aca7-b956238a7e05","Type":"ContainerStarted","Data":"c73d280b8c433a87659624ab2b97c17459a073a8a597d4ce7f22ab6bb9972b64"}
Jul 23 13:08:28.296785 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.296721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dz4q" event={"ID":"d17da8d2-de85-43fb-ae9d-ba765c9a330b","Type":"ContainerStarted","Data":"6bd50d220ffcd8881dc21db8c25bb0b7323c39ac3634445dc7a6bbf587bc41c2"}
Jul 23 13:08:28.296785 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.296770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dz4q" event={"ID":"d17da8d2-de85-43fb-ae9d-ba765c9a330b","Type":"ContainerStarted","Data":"35e2fb26d93bca4417c1f62650e79619a7c1480553d6d4e28f25d0edb254d68c"}
Jul 23 13:08:28.303070 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.302999    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xssgj" podStartSLOduration=58.898046366 podStartE2EDuration="1m7.302987468s" totalImagesPullingTime="8.404941102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:28.30227343 +0000 UTC m=+79.039506751" watchObservedRunningTime="2026-07-23 13:08:28.302987468 +0000 UTC m=+79.040220786"
Jul 23 13:08:28.318146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.318094    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4hjgg" podStartSLOduration=38.014372054 podStartE2EDuration="46.318077081s" totalImagesPullingTime="8.303705027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:28.316766224 +0000 UTC m=+79.053999543" watchObservedRunningTime="2026-07-23 13:08:28.318077081 +0000 UTC m=+79.055310401"
Jul 23 13:08:28.335652 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.335583    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s6klq" podStartSLOduration=59.833416733 podStartE2EDuration="1m8.33556474s" totalImagesPullingTime="8.502148007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:28.334509005 +0000 UTC m=+79.071742326" watchObservedRunningTime="2026-07-23 13:08:28.33556474 +0000 UTC m=+79.072798063"
Jul 23 13:08:28.352848 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.352485    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xzsbl" podStartSLOduration=66.909638543 podStartE2EDuration="1m18.352466098s" totalImagesPullingTime="11.442827555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:28.350039521 +0000 UTC m=+79.087272841" watchObservedRunningTime="2026-07-23 13:08:28.352466098 +0000 UTC m=+79.089699418"
Jul 23 13:08:28.387129 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:28.386913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8dz4q" podStartSLOduration=71.23067953 podStartE2EDuration="1m18.386895444s" totalImagesPullingTime="7.156215914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:28.386520034 +0000 UTC m=+79.123753353" watchObservedRunningTime="2026-07-23 13:08:28.386895444 +0000 UTC m=+79.124128765"
Jul 23 13:08:36.340533 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.340496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szvzt" event={"ID":"56eb01a4-e992-42b3-9569-9233dd796221","Type":"ContainerStarted","Data":"bc220f4f8d3b8837149b7f0a6846e074b2049b30f331511e57a7295cc9b70e48"}
Jul 23 13:08:36.342720 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.342679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8" event={"ID":"c2722767-4f42-4a8d-811c-8cf08033bf13","Type":"ContainerStarted","Data":"eefbeeaae4016dfddcdf2077bf653222a04dd8d4b368469fefca832cffdf96d0"}
Jul 23 13:08:36.346938 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.346910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx" event={"ID":"73dcbe0b-c7b5-41f2-aca7-b956238a7e05","Type":"ContainerStarted","Data":"2cb52bc7e8e337e0c8e59c8d2604168a7a5653b53c51c190cb8f1cc38b96e2d0"}
Jul 23 13:08:36.347065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.346955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx" event={"ID":"73dcbe0b-c7b5-41f2-aca7-b956238a7e05","Type":"ContainerStarted","Data":"f933e04fded84537ec32e9122984a7d918260e6c42f60e7f9a5651e85c1448ac"}
Jul 23 13:08:36.347065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.346972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx" event={"ID":"73dcbe0b-c7b5-41f2-aca7-b956238a7e05","Type":"ContainerStarted","Data":"f629e1434d74861cbaeace3079f46add332b42e892ed2f3193bed6e21d9fcc56"}
Jul 23 13:08:36.348436 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.348413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4" event={"ID":"c1bcb4dc-ba9b-4187-93dd-e5a8e3613b01","Type":"ContainerStarted","Data":"37e4a4171d54a7bad7065d6702237fc6c34d42f31f39b23adc246ac3c8636600"}
Jul 23 13:08:36.348546 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.348478    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:36.350127 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.350109    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4"
Jul 23 13:08:36.358965 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.358927    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-szvzt" podStartSLOduration=17.722954296 podStartE2EDuration="39.358913307s" totalImagesPullingTime="21.635959011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:07:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.357363877 +0000 UTC m=+87.094597200" watchObservedRunningTime="2026-07-23 13:08:36.358913307 +0000 UTC m=+87.096146625"
Jul 23 13:08:36.372814 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.372776    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54676d5f6-dvsw8" podStartSLOduration=8.37588084 podStartE2EDuration="16.372762322s" totalImagesPullingTime="7.996881482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.371517117 +0000 UTC m=+87.108750437" watchObservedRunningTime="2026-07-23 13:08:36.372762322 +0000 UTC m=+87.109995672"
Jul 23 13:08:36.390723 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.390676    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-747445c64-m8tfx" podStartSLOduration=8.397154646 podStartE2EDuration="16.390663348s" totalImagesPullingTime="7.993508702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.389443877 +0000 UTC m=+87.126677195" watchObservedRunningTime="2026-07-23 13:08:36.390663348 +0000 UTC m=+87.127896667"
Jul 23 13:08:36.405387 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:36.405347    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76cdf4654c-m7hl4" podStartSLOduration=8.205345209 podStartE2EDuration="16.405334521s" totalImagesPullingTime="8.199989312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:36.404472132 +0000 UTC m=+87.141705457" watchObservedRunningTime="2026-07-23 13:08:36.405334521 +0000 UTC m=+87.142567840"
Jul 23 13:08:37.696901 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:37.696846    2564 patch_prober.go:28] interesting pod/image-registry-694f8fbdb4-rm9b5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 13:08:37.697267 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:37.696922    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" podUID="be520336-103b-4cd7-ac49-97d4f53ab17a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 13:08:38.309346 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:38.309312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h8m6l"
Jul 23 13:08:41.240347 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:41.240321    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:08:47.199939 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:47.199904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kxq2v"
Jul 23 13:08:48.808123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:48.808084    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-694f8fbdb4-rm9b5"]
Jul 23 13:08:51.563216 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.563176    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v6d9h"]
Jul 23 13:08:51.580485 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.580454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.582980 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.582937    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 13:08:51.583127 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.583109    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 13:08:51.583786 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.583769    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 13:08:51.583919 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.583831    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 13:08:51.584121 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.584104    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wkhqp\""
Jul 23 13:08:51.631564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7szk7\" (UniqueName: \"kubernetes.io/projected/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-kube-api-access-7szk7\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.631564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-sys\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.631799 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-textfile\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.631799 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-tls\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.631799 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-root\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.631799 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-metrics-client-ca\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.632028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.632028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.632028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.631987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-wtmp\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-wtmp\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7szk7\" (UniqueName: \"kubernetes.io/projected/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-kube-api-access-7szk7\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-sys\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-textfile\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-tls\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-sys\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-root\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-wtmp\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-metrics-client-ca\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-root\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.732577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.733072 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.732825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-textfile\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.733121 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.733094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-metrics-client-ca\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.733155 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.733139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.734699 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.734678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.734801 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.734783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-node-exporter-tls\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.740645 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.740621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7szk7\" (UniqueName: \"kubernetes.io/projected/3f2b2ea9-02d5-4ece-b335-d34afa2eff8d-kube-api-access-7szk7\") pod \"node-exporter-v6d9h\" (UID: \"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d\") " pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.891999 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:51.891930    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v6d9h"
Jul 23 13:08:51.903400 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:08:51.903370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2b2ea9_02d5_4ece_b335_d34afa2eff8d.slice/crio-8915855cad2c364ea0eae56e5b38f46abe6e071b431bea55a81f3ece70cbec5c WatchSource:0}: Error finding container 8915855cad2c364ea0eae56e5b38f46abe6e071b431bea55a81f3ece70cbec5c: Status 404 returned error can't find the container with id 8915855cad2c364ea0eae56e5b38f46abe6e071b431bea55a81f3ece70cbec5c
Jul 23 13:08:52.412421 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:52.412380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6d9h" event={"ID":"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d","Type":"ContainerStarted","Data":"8915855cad2c364ea0eae56e5b38f46abe6e071b431bea55a81f3ece70cbec5c"}
Jul 23 13:08:53.417869 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:53.417821    2564 generic.go:356] "Generic (PLEG): container finished" podID="3f2b2ea9-02d5-4ece-b335-d34afa2eff8d" containerID="0bf64ed8e42e65f932d560702ce9b63a386e645d5b8867efa2e978069df7fa19" exitCode=0
Jul 23 13:08:53.418242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:53.417892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6d9h" event={"ID":"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d","Type":"ContainerDied","Data":"0bf64ed8e42e65f932d560702ce9b63a386e645d5b8867efa2e978069df7fa19"}
Jul 23 13:08:54.423660 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:54.423622    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6d9h" event={"ID":"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d","Type":"ContainerStarted","Data":"b496c490422df1d1ad8df6ea65daf1aa3981397e721b19138307f112341c9706"}
Jul 23 13:08:54.424026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:54.423688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6d9h" event={"ID":"3f2b2ea9-02d5-4ece-b335-d34afa2eff8d","Type":"ContainerStarted","Data":"53a485cdf8295cb8a5bca1791bed1f833ac7fa84749f25bb5d67fec32d480ebc"}
Jul 23 13:08:54.462237 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:08:54.462186    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v6d9h" podStartSLOduration=2.41813189 podStartE2EDuration="3.462170038s" totalImagesPullingTime="981.154722ms" totalInitContainerRuntime="62.883426ms" isStatefulPod=true podCreationTimestamp="2026-07-23 13:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:08:54.459947889 +0000 UTC m=+105.197181209" watchObservedRunningTime="2026-07-23 13:08:54.462170038 +0000 UTC m=+105.199403357"
Jul 23 13:09:01.452430 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:01.452395    2564 generic.go:356] "Generic (PLEG): container finished" podID="218bcc1f-f828-406e-ac13-a2ddf646906e" containerID="b1c5dd0e0a6edde5676106fbb2ee7bb8816a7523d6383bb91262e65941ebe7f0" exitCode=0
Jul 23 13:09:01.452830 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:01.452474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd" event={"ID":"218bcc1f-f828-406e-ac13-a2ddf646906e","Type":"ContainerDied","Data":"b1c5dd0e0a6edde5676106fbb2ee7bb8816a7523d6383bb91262e65941ebe7f0"}
Jul 23 13:09:01.452894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:01.452829    2564 scope.go:117] "RemoveContainer" containerID="b1c5dd0e0a6edde5676106fbb2ee7bb8816a7523d6383bb91262e65941ebe7f0"
Jul 23 13:09:02.458513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:02.458479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ffjnd" event={"ID":"218bcc1f-f828-406e-ac13-a2ddf646906e","Type":"ContainerStarted","Data":"052dbe9a54aaa11b12431ee5839685ef6b05fb1d5a6d2f8f76b928310b11961e"}
Jul 23 13:09:07.478447 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:07.478412    2564 generic.go:356] "Generic (PLEG): container finished" podID="49c7dd86-9953-44df-8b97-18c3e13f3396" containerID="c1b0f4a9eb89ad3e73fe9517c16be65b1a5873a4956b44697d07840ee7ea81b4" exitCode=0
Jul 23 13:09:07.478886 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:07.478482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-z5s7f" event={"ID":"49c7dd86-9953-44df-8b97-18c3e13f3396","Type":"ContainerDied","Data":"c1b0f4a9eb89ad3e73fe9517c16be65b1a5873a4956b44697d07840ee7ea81b4"}
Jul 23 13:09:07.478941 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:07.478885    2564 scope.go:117] "RemoveContainer" containerID="c1b0f4a9eb89ad3e73fe9517c16be65b1a5873a4956b44697d07840ee7ea81b4"
Jul 23 13:09:08.484396 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:08.484359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-z5s7f" event={"ID":"49c7dd86-9953-44df-8b97-18c3e13f3396","Type":"ContainerStarted","Data":"402b69b89da30259cc483638758d1c5849ad22ecc58dc274782b2caebfdefe4f"}
Jul 23 13:09:10.699233 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:10.699200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-s6klq_86887492-740c-4701-933e-9c22f54ea2c2/cluster-monitoring-operator/0.log"
Jul 23 13:09:13.095823 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:13.095794    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6d9h_3f2b2ea9-02d5-4ece-b335-d34afa2eff8d/init-textfile/0.log"
Jul 23 13:09:13.296651 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:13.296618    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6d9h_3f2b2ea9-02d5-4ece-b335-d34afa2eff8d/node-exporter/0.log"
Jul 23 13:09:13.496464 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:13.496438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6d9h_3f2b2ea9-02d5-4ece-b335-d34afa2eff8d/kube-rbac-proxy/0.log"
Jul 23 13:09:13.828512 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:13.828432    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" podUID="be520336-103b-4cd7-ac49-97d4f53ab17a" containerName="registry" containerID="cri-o://d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a" gracePeriod=30
Jul 23 13:09:14.072644 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.072617    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:09:14.226723 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226688    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9grgd\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-kube-api-access-9grgd\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226746    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-installation-pull-secrets\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-trusted-ca\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226827    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-certificates\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226854    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-bound-sa-token\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-image-registry-private-configuration\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226938    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be520336-103b-4cd7-ac49-97d4f53ab17a-ca-trust-extracted\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227207 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.226982    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") pod \"be520336-103b-4cd7-ac49-97d4f53ab17a\" (UID: \"be520336-103b-4cd7-ac49-97d4f53ab17a\") "
Jul 23 13:09:14.227571 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.227381    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:14.227625 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.227557    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:09:14.229874 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.229828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:09:14.229985 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.229832    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:09:14.229985 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.229895    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-kube-api-access-9grgd" (OuterVolumeSpecName: "kube-api-access-9grgd") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "kube-api-access-9grgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:09:14.230083 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.229992    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:09:14.230083 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.230058    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:09:14.236263 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.236238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be520336-103b-4cd7-ac49-97d4f53ab17a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "be520336-103b-4cd7-ac49-97d4f53ab17a" (UID: "be520336-103b-4cd7-ac49-97d4f53ab17a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:09:14.328180 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328141    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328180 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328176    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9grgd\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-kube-api-access-9grgd\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328190    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-installation-pull-secrets\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328202    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-trusted-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328214    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be520336-103b-4cd7-ac49-97d4f53ab17a-registry-certificates\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328225    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be520336-103b-4cd7-ac49-97d4f53ab17a-bound-sa-token\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328238    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be520336-103b-4cd7-ac49-97d4f53ab17a-image-registry-private-configuration\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.328386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.328251    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be520336-103b-4cd7-ac49-97d4f53ab17a-ca-trust-extracted\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:09:14.507771 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.507689    2564 generic.go:356] "Generic (PLEG): container finished" podID="be520336-103b-4cd7-ac49-97d4f53ab17a" containerID="d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a" exitCode=0
Jul 23 13:09:14.507771 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.507732    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5"
Jul 23 13:09:14.507771 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.507739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" event={"ID":"be520336-103b-4cd7-ac49-97d4f53ab17a","Type":"ContainerDied","Data":"d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a"}
Jul 23 13:09:14.508066 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.507780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-694f8fbdb4-rm9b5" event={"ID":"be520336-103b-4cd7-ac49-97d4f53ab17a","Type":"ContainerDied","Data":"b2f9f0e19d6a5147a749dbecdec32bed5ba6cbd381c1b402bbc405450cc4b688"}
Jul 23 13:09:14.508066 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.507801    2564 scope.go:117] "RemoveContainer" containerID="d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a"
Jul 23 13:09:14.516595 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.516577    2564 scope.go:117] "RemoveContainer" containerID="d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a"
Jul 23 13:09:14.516842 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:09:14.516823    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a\": container with ID starting with d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a not found: ID does not exist" containerID="d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a"
Jul 23 13:09:14.516934 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.516854    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a"} err="failed to get container status \"d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a\": rpc error: code = NotFound desc = could not find container \"d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a\": container with ID starting with d438ba76c5c55072d1bfd769af31b10cdd502a8ea3f34928cef046e9718de91a not found: ID does not exist"
Jul 23 13:09:14.527907 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.527853    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-694f8fbdb4-rm9b5"]
Jul 23 13:09:14.531288 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:14.531267    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-694f8fbdb4-rm9b5"]
Jul 23 13:09:15.768271 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:15.768240    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be520336-103b-4cd7-ac49-97d4f53ab17a" path="/var/lib/kubelet/pods/be520336-103b-4cd7-ac49-97d4f53ab17a/volumes"
Jul 23 13:09:17.496057 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:17.496019    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-4hjgg_056168a5-4598-46b4-9073-6f5545103899/networking-console-plugin/0.log"
Jul 23 13:09:17.695877 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:17.695837    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:09:17.898526 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:17.898438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/2.log"
Jul 23 13:09:18.896693 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:18.896652    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6997dd8868-5k8xv_30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1/router/0.log"
Jul 23 13:09:19.096188 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:19.096161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5s2mz_db4c1c22-a985-480c-8e0c-c50b8580ddea/serve-healthcheck-canary/0.log"
Jul 23 13:09:21.536903 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:21.536849    2564 generic.go:356] "Generic (PLEG): container finished" podID="152c4a8b-63d7-4b29-aaf1-68c108337779" containerID="9a2adc2cc9d896b0ae24068b8b71e424e3c92a3c53d4a083d511d0f7dfd95510" exitCode=0
Jul 23 13:09:21.537257 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:21.536900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx" event={"ID":"152c4a8b-63d7-4b29-aaf1-68c108337779","Type":"ContainerDied","Data":"9a2adc2cc9d896b0ae24068b8b71e424e3c92a3c53d4a083d511d0f7dfd95510"}
Jul 23 13:09:21.537257 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:21.537234    2564 scope.go:117] "RemoveContainer" containerID="9a2adc2cc9d896b0ae24068b8b71e424e3c92a3c53d4a083d511d0f7dfd95510"
Jul 23 13:09:22.543402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:09:22.543363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-7wbhx" event={"ID":"152c4a8b-63d7-4b29-aaf1-68c108337779","Type":"ContainerStarted","Data":"a49c25e14cf812c6d6fbe65334922e1eca422a2feca3178c06b43a588bd29a46"}
Jul 23 13:12:09.638908 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:12:09.638878    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:12:09.645182 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:12:09.645157    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:12:09.649656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:12:09.649633    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 13:13:34.435696 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.435610    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"]
Jul 23 13:13:34.436174 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.435941    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be520336-103b-4cd7-ac49-97d4f53ab17a" containerName="registry"
Jul 23 13:13:34.436174 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.435955    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be520336-103b-4cd7-ac49-97d4f53ab17a" containerName="registry"
Jul 23 13:13:34.436174 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.436020    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be520336-103b-4cd7-ac49-97d4f53ab17a" containerName="registry"
Jul 23 13:13:34.438059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.438043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.442064 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:34.442033    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object" podUID="5796ad6d-2219-44cb-9b70-dec85d3a0f88" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.442064 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:34.442036    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Jul 23 13:13:34.442260 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:34.442036    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 23 13:13:34.442260 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:34.442036    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 23 13:13:34.442260 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:34.442060    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-md9mv\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-md9mv\"" type="*v1.Secret"
Jul 23 13:13:34.442260 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:34.442087    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 23 13:13:34.452913 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.452892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5796ad6d-2219-44cb-9b70-dec85d3a0f88-tmp\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.453020 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.452953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5796ad6d-2219-44cb-9b70-dec85d3a0f88-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.453020 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.452987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pb89\" (UniqueName: \"kubernetes.io/projected/5796ad6d-2219-44cb-9b70-dec85d3a0f88-kube-api-access-4pb89\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.453020 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.453016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5796ad6d-2219-44cb-9b70-dec85d3a0f88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.453154 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.453071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5796ad6d-2219-44cb-9b70-dec85d3a0f88-manifests\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.465469 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.465444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"]
Jul 23 13:13:34.554175 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.554143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pb89\" (UniqueName: \"kubernetes.io/projected/5796ad6d-2219-44cb-9b70-dec85d3a0f88-kube-api-access-4pb89\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.554352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.554182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5796ad6d-2219-44cb-9b70-dec85d3a0f88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.554352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.554209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5796ad6d-2219-44cb-9b70-dec85d3a0f88-manifests\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.554352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.554244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5796ad6d-2219-44cb-9b70-dec85d3a0f88-tmp\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.554352 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.554282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5796ad6d-2219-44cb-9b70-dec85d3a0f88-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.554602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.554583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5796ad6d-2219-44cb-9b70-dec85d3a0f88-manifests\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:34.556364 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:34.556346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5796ad6d-2219-44cb-9b70-dec85d3a0f88-tmp\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:35.252703 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.252673    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 13:13:35.314965 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.314941    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-md9mv\""
Jul 23 13:13:35.359938 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.359910    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 13:13:35.367165 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.367142    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5796ad6d-2219-44cb-9b70-dec85d3a0f88-webhook-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:35.367270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.367206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5796ad6d-2219-44cb-9b70-dec85d3a0f88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:35.560669 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:35.560589    2564 projected.go:291] Couldn't get configMap opendatahub/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 23 13:13:35.562123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.562104    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 13:13:35.571719 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:35.571704    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4pb89 for pod opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b: failed to sync configmap cache: timed out waiting for the condition
Jul 23 13:13:35.571788 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:13:35.571763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5796ad6d-2219-44cb-9b70-dec85d3a0f88-kube-api-access-4pb89 podName:5796ad6d-2219-44cb-9b70-dec85d3a0f88 nodeName:}" failed. No retries permitted until 2026-07-23 13:13:36.07174964 +0000 UTC m=+386.808982937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4pb89" (UniqueName: "kubernetes.io/projected/5796ad6d-2219-44cb-9b70-dec85d3a0f88-kube-api-access-4pb89") pod "opendatahub-operator-controller-manager-779cfbfdf-rsl2b" (UID: "5796ad6d-2219-44cb-9b70-dec85d3a0f88") : failed to sync configmap cache: timed out waiting for the condition
Jul 23 13:13:35.791598 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:35.791565    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 13:13:36.166809 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:36.166771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pb89\" (UniqueName: \"kubernetes.io/projected/5796ad6d-2219-44cb-9b70-dec85d3a0f88-kube-api-access-4pb89\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:36.169385 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:36.169360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pb89\" (UniqueName: \"kubernetes.io/projected/5796ad6d-2219-44cb-9b70-dec85d3a0f88-kube-api-access-4pb89\") pod \"opendatahub-operator-controller-manager-779cfbfdf-rsl2b\" (UID: \"5796ad6d-2219-44cb-9b70-dec85d3a0f88\") " pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:36.248614 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:36.248579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:36.396332 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:36.396297    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"]
Jul 23 13:13:36.398788 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:13:36.398759    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5796ad6d_2219_44cb_9b70_dec85d3a0f88.slice/crio-51316bc74c3ed4abf8e1bedc28a7b21371f5d78ae1faef0367c82ded1bbed7c1 WatchSource:0}: Error finding container 51316bc74c3ed4abf8e1bedc28a7b21371f5d78ae1faef0367c82ded1bbed7c1: Status 404 returned error can't find the container with id 51316bc74c3ed4abf8e1bedc28a7b21371f5d78ae1faef0367c82ded1bbed7c1
Jul 23 13:13:36.401153 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:36.401135    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:13:36.507612 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:36.507530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b" event={"ID":"5796ad6d-2219-44cb-9b70-dec85d3a0f88","Type":"ContainerStarted","Data":"51316bc74c3ed4abf8e1bedc28a7b21371f5d78ae1faef0367c82ded1bbed7c1"}
Jul 23 13:13:40.527271 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:40.527226    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b" event={"ID":"5796ad6d-2219-44cb-9b70-dec85d3a0f88","Type":"ContainerStarted","Data":"a098f24597e07933476ea4b21a77efefa73b7ddd567506016aa712b9bec8d333"}
Jul 23 13:13:41.532714 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:41.532676    2564 generic.go:356] "Generic (PLEG): container finished" podID="5796ad6d-2219-44cb-9b70-dec85d3a0f88" containerID="a098f24597e07933476ea4b21a77efefa73b7ddd567506016aa712b9bec8d333" exitCode=0
Jul 23 13:13:41.533155 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:41.532766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b" event={"ID":"5796ad6d-2219-44cb-9b70-dec85d3a0f88","Type":"ContainerDied","Data":"a098f24597e07933476ea4b21a77efefa73b7ddd567506016aa712b9bec8d333"}
Jul 23 13:13:42.538262 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:42.538228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b" event={"ID":"5796ad6d-2219-44cb-9b70-dec85d3a0f88","Type":"ContainerStarted","Data":"f1e230b04f97baf629bf041433c2d6b1e1986a11581acee75c68a1776ae202c1"}
Jul 23 13:13:42.538737 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:42.538301    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:13:42.561324 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:42.561275    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b" podStartSLOduration=4.012297285 podStartE2EDuration="8.561259017s" totalImagesPullingTime="3.386728815s" totalInitContainerRuntime="1.162232917s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:13:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:13:42.560241192 +0000 UTC m=+393.297474511" watchObservedRunningTime="2026-07-23 13:13:42.561259017 +0000 UTC m=+393.298492336"
Jul 23 13:13:53.546624 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:13:53.546590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779cfbfdf-rsl2b"
Jul 23 13:14:06.656990 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.656957    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"]
Jul 23 13:14:06.660205 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.660182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.666908 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.666808    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 13:14:06.666988 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.666922    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 13:14:06.666988 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.666959    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:14:06.667092 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.667072    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 13:14:06.667238 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.667222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4qt5p\""
Jul 23 13:14:06.667293 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.667247    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 13:14:06.673156 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.673134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"]
Jul 23 13:14:06.810820 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.810781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/675179c4-d719-4187-b3de-95ccbc13cacc-metrics-cert\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.811011 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.810838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5tq\" (UniqueName: \"kubernetes.io/projected/675179c4-d719-4187-b3de-95ccbc13cacc-kube-api-access-dt5tq\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.811011 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.810933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/675179c4-d719-4187-b3de-95ccbc13cacc-cert\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.811011 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.810994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/675179c4-d719-4187-b3de-95ccbc13cacc-manager-config\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.912106 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.912076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/675179c4-d719-4187-b3de-95ccbc13cacc-manager-config\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.912243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.912132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/675179c4-d719-4187-b3de-95ccbc13cacc-metrics-cert\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.912243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.912180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5tq\" (UniqueName: \"kubernetes.io/projected/675179c4-d719-4187-b3de-95ccbc13cacc-kube-api-access-dt5tq\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.912243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.912234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/675179c4-d719-4187-b3de-95ccbc13cacc-cert\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.912963 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.912938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/675179c4-d719-4187-b3de-95ccbc13cacc-manager-config\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.914933 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.914905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/675179c4-d719-4187-b3de-95ccbc13cacc-cert\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.915022 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.914905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/675179c4-d719-4187-b3de-95ccbc13cacc-metrics-cert\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.921646 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.921625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5tq\" (UniqueName: \"kubernetes.io/projected/675179c4-d719-4187-b3de-95ccbc13cacc-kube-api-access-dt5tq\") pod \"lws-controller-manager-789dbd6fbb-c9d5z\" (UID: \"675179c4-d719-4187-b3de-95ccbc13cacc\") " pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:06.969253 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:06.969233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:07.118986 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:07.118952    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"]
Jul 23 13:14:07.122698 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:14:07.122670    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675179c4_d719_4187_b3de_95ccbc13cacc.slice/crio-afdbe57858841aee1aab3849afc059fd502394f291b230e50b5bd2520eff4456 WatchSource:0}: Error finding container afdbe57858841aee1aab3849afc059fd502394f291b230e50b5bd2520eff4456: Status 404 returned error can't find the container with id afdbe57858841aee1aab3849afc059fd502394f291b230e50b5bd2520eff4456
Jul 23 13:14:07.645205 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:07.645170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z" event={"ID":"675179c4-d719-4187-b3de-95ccbc13cacc","Type":"ContainerStarted","Data":"afdbe57858841aee1aab3849afc059fd502394f291b230e50b5bd2520eff4456"}
Jul 23 13:14:08.964383 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:08.964352    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"]
Jul 23 13:14:08.969737 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:08.969705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:08.974326 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:08.974138    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7dck2\""
Jul 23 13:14:08.978726 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:08.978705    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 13:14:08.992714 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:08.992688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"]
Jul 23 13:14:09.036745 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.036713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.036928 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.036819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wzh8\" (UniqueName: \"kubernetes.io/projected/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-kube-api-access-6wzh8\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.137694 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.137653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wzh8\" (UniqueName: \"kubernetes.io/projected/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-kube-api-access-6wzh8\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.137890 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.137741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.137979 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:14:09.137924    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 13:14:09.138031 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:14:09.138002    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-cert podName:b6bfab74-6fdd-4149-8eb8-d35d3b11c0df nodeName:}" failed. No retries permitted until 2026-07-23 13:14:09.63798071 +0000 UTC m=+420.375214011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-cert") pod "llmisvc-controller-manager-777c6bd7d5-nhkkj" (UID: "b6bfab74-6fdd-4149-8eb8-d35d3b11c0df") : secret "llmisvc-webhook-server-cert" not found
Jul 23 13:14:09.150416 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.150356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wzh8\" (UniqueName: \"kubernetes.io/projected/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-kube-api-access-6wzh8\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.642977 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.642945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.645469 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.645441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6bfab74-6fdd-4149-8eb8-d35d3b11c0df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nhkkj\" (UID: \"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:09.885991 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.885955    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7dck2\""
Jul 23 13:14:09.894363 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:09.894293    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:10.088745 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:10.088725    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"]
Jul 23 13:14:10.091057 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:14:10.091030    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6bfab74_6fdd_4149_8eb8_d35d3b11c0df.slice/crio-8005b01aa5ab0c5069e3e81fa902f78a831c38ad5128899b17456088f93f8e7f WatchSource:0}: Error finding container 8005b01aa5ab0c5069e3e81fa902f78a831c38ad5128899b17456088f93f8e7f: Status 404 returned error can't find the container with id 8005b01aa5ab0c5069e3e81fa902f78a831c38ad5128899b17456088f93f8e7f
Jul 23 13:14:10.660709 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:10.660671    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z" event={"ID":"675179c4-d719-4187-b3de-95ccbc13cacc","Type":"ContainerStarted","Data":"aac19884fc3e49de93bae3dbd76d93cb3b4b94a0e61aefe19eed3f9ae6c8d107"}
Jul 23 13:14:10.660936 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:10.660773    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:10.662053 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:10.662029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj" event={"ID":"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df","Type":"ContainerStarted","Data":"8005b01aa5ab0c5069e3e81fa902f78a831c38ad5128899b17456088f93f8e7f"}
Jul 23 13:14:10.679684 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:10.679643    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z" podStartSLOduration=1.792970923 podStartE2EDuration="4.679628576s" totalImagesPullingTime="2.886657653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:14:10.678933631 +0000 UTC m=+421.416166950" watchObservedRunningTime="2026-07-23 13:14:10.679628576 +0000 UTC m=+421.416861894"
Jul 23 13:14:13.682521 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:13.682440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj" event={"ID":"b6bfab74-6fdd-4149-8eb8-d35d3b11c0df","Type":"ContainerStarted","Data":"d02951944b469cfc46d6685c36f753426829cc268b1d690d401cc4b98fe15770"}
Jul 23 13:14:13.682967 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:13.682596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:14:13.700305 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:13.700255    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj" podStartSLOduration=2.379770171 podStartE2EDuration="5.700239725s" totalImagesPullingTime="3.320469554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:14:13.69936995 +0000 UTC m=+424.436603271" watchObservedRunningTime="2026-07-23 13:14:13.700239725 +0000 UTC m=+424.437473043"
Jul 23 13:14:21.668790 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:21.668760    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-789dbd6fbb-c9d5z"
Jul 23 13:14:44.688923 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:14:44.688828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nhkkj"
Jul 23 13:15:34.849805 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.849772    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"]
Jul 23 13:15:34.852771 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.852755    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:15:34.855181 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.855162    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 13:15:34.855630 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.855615    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 13:15:34.855980 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.855965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jlthm\""
Jul 23 13:15:34.866917 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.866899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"]
Jul 23 13:15:34.932470 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:34.932448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdmz\" (UniqueName: \"kubernetes.io/projected/30e4eec3-a060-434c-9a9c-2b445a24c694-kube-api-access-vbdmz\") pod \"authorino-operator-75cc8d5cb7-7tgbb\" (UID: \"30e4eec3-a060-434c-9a9c-2b445a24c694\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:15:35.032811 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:35.032781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdmz\" (UniqueName: \"kubernetes.io/projected/30e4eec3-a060-434c-9a9c-2b445a24c694-kube-api-access-vbdmz\") pod \"authorino-operator-75cc8d5cb7-7tgbb\" (UID: \"30e4eec3-a060-434c-9a9c-2b445a24c694\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:15:35.041637 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:35.041601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdmz\" (UniqueName: \"kubernetes.io/projected/30e4eec3-a060-434c-9a9c-2b445a24c694-kube-api-access-vbdmz\") pod \"authorino-operator-75cc8d5cb7-7tgbb\" (UID: \"30e4eec3-a060-434c-9a9c-2b445a24c694\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:15:35.162361 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:35.162332    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:15:35.317869 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:35.317825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"]
Jul 23 13:15:35.323642 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:15:35.323620    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e4eec3_a060_434c_9a9c_2b445a24c694.slice/crio-7704740e22c521d4a8ba87c1b5a46224d1048c3daca45ace18585a610fdb071f WatchSource:0}: Error finding container 7704740e22c521d4a8ba87c1b5a46224d1048c3daca45ace18585a610fdb071f: Status 404 returned error can't find the container with id 7704740e22c521d4a8ba87c1b5a46224d1048c3daca45ace18585a610fdb071f
Jul 23 13:15:36.014076 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:36.014038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb" event={"ID":"30e4eec3-a060-434c-9a9c-2b445a24c694","Type":"ContainerStarted","Data":"7704740e22c521d4a8ba87c1b5a46224d1048c3daca45ace18585a610fdb071f"}
Jul 23 13:15:41.038737 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:41.038696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb" event={"ID":"30e4eec3-a060-434c-9a9c-2b445a24c694","Type":"ContainerStarted","Data":"e20f32e68a4e06a82145f6f7b7baf33d6021ecb271e91b6cf00c575bbb78b7e6"}
Jul 23 13:15:41.039174 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:41.038840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:15:41.055504 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:41.055446    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb" podStartSLOduration=2.102173484 podStartE2EDuration="7.055432219s" totalImagesPullingTime="4.953258735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:15:41.054915215 +0000 UTC m=+511.792148539" watchObservedRunningTime="2026-07-23 13:15:41.055432219 +0000 UTC m=+511.792665537"
Jul 23 13:15:52.045453 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:15:52.045420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7tgbb"
Jul 23 13:16:40.792097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.792019    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:40.795182 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.795165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:40.797566 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.797545    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5jhxm\""
Jul 23 13:16:40.797674 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.797548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 13:16:40.803379 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.803357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:40.871381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.871333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4xcr\" (UniqueName: \"kubernetes.io/projected/73518d51-58af-4b72-812d-9a4dbfe528e3-kube-api-access-k4xcr\") pod \"limitador-limitador-64c94fd64f-lczdl\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:40.871539 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.871403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73518d51-58af-4b72-812d-9a4dbfe528e3-config-file\") pod \"limitador-limitador-64c94fd64f-lczdl\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:40.889124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.889092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:40.972721 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.972686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73518d51-58af-4b72-812d-9a4dbfe528e3-config-file\") pod \"limitador-limitador-64c94fd64f-lczdl\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:40.972908 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.972765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4xcr\" (UniqueName: \"kubernetes.io/projected/73518d51-58af-4b72-812d-9a4dbfe528e3-kube-api-access-k4xcr\") pod \"limitador-limitador-64c94fd64f-lczdl\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:40.973311 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.973292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73518d51-58af-4b72-812d-9a4dbfe528e3-config-file\") pod \"limitador-limitador-64c94fd64f-lczdl\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:40.985039 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:40.985013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4xcr\" (UniqueName: \"kubernetes.io/projected/73518d51-58af-4b72-812d-9a4dbfe528e3-kube-api-access-k4xcr\") pod \"limitador-limitador-64c94fd64f-lczdl\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:41.106815 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:41.106733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:41.242659 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:41.242631    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:41.245246 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:16:41.245218    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73518d51_58af_4b72_812d_9a4dbfe528e3.slice/crio-4bde9a731e27e1855136b3da0108c51e9997fb50bdb94f55db573bb4464ff0a0 WatchSource:0}: Error finding container 4bde9a731e27e1855136b3da0108c51e9997fb50bdb94f55db573bb4464ff0a0: Status 404 returned error can't find the container with id 4bde9a731e27e1855136b3da0108c51e9997fb50bdb94f55db573bb4464ff0a0
Jul 23 13:16:41.300238 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:41.300211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl" event={"ID":"73518d51-58af-4b72-812d-9a4dbfe528e3","Type":"ContainerStarted","Data":"4bde9a731e27e1855136b3da0108c51e9997fb50bdb94f55db573bb4464ff0a0"}
Jul 23 13:16:44.318724 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:44.318680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl" event={"ID":"73518d51-58af-4b72-812d-9a4dbfe528e3","Type":"ContainerStarted","Data":"36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126"}
Jul 23 13:16:44.319126 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:44.318751    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:44.335745 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:44.335688    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl" podStartSLOduration=1.442048838 podStartE2EDuration="4.335669783s" totalImagesPullingTime="2.893620945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:16:44.334888255 +0000 UTC m=+575.072121568" watchObservedRunningTime="2026-07-23 13:16:44.335669783 +0000 UTC m=+575.072903103"
Jul 23 13:16:55.329264 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:55.329234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:58.164444 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.164409    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:58.164916 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.164599    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl" podUID="73518d51-58af-4b72-812d-9a4dbfe528e3" containerName="limitador" containerID="cri-o://36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126" gracePeriod=30
Jul 23 13:16:58.704691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.704664    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:58.818103 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.818009    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73518d51-58af-4b72-812d-9a4dbfe528e3-config-file\") pod \"73518d51-58af-4b72-812d-9a4dbfe528e3\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") "
Jul 23 13:16:58.818278 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.818114    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4xcr\" (UniqueName: \"kubernetes.io/projected/73518d51-58af-4b72-812d-9a4dbfe528e3-kube-api-access-k4xcr\") pod \"73518d51-58af-4b72-812d-9a4dbfe528e3\" (UID: \"73518d51-58af-4b72-812d-9a4dbfe528e3\") "
Jul 23 13:16:58.818372 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.818347    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73518d51-58af-4b72-812d-9a4dbfe528e3-config-file" (OuterVolumeSpecName: "config-file") pod "73518d51-58af-4b72-812d-9a4dbfe528e3" (UID: "73518d51-58af-4b72-812d-9a4dbfe528e3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:16:58.820302 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.820276    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73518d51-58af-4b72-812d-9a4dbfe528e3-kube-api-access-k4xcr" (OuterVolumeSpecName: "kube-api-access-k4xcr") pod "73518d51-58af-4b72-812d-9a4dbfe528e3" (UID: "73518d51-58af-4b72-812d-9a4dbfe528e3"). InnerVolumeSpecName "kube-api-access-k4xcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:16:58.918835 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.918804    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4xcr\" (UniqueName: \"kubernetes.io/projected/73518d51-58af-4b72-812d-9a4dbfe528e3-kube-api-access-k4xcr\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:16:58.918835 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:58.918829    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73518d51-58af-4b72-812d-9a4dbfe528e3-config-file\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:16:59.389892 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.389845    2564 generic.go:356] "Generic (PLEG): container finished" podID="73518d51-58af-4b72-812d-9a4dbfe528e3" containerID="36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126" exitCode=0
Jul 23 13:16:59.390381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.389923    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl"
Jul 23 13:16:59.390381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.389930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl" event={"ID":"73518d51-58af-4b72-812d-9a4dbfe528e3","Type":"ContainerDied","Data":"36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126"}
Jul 23 13:16:59.390381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.389997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lczdl" event={"ID":"73518d51-58af-4b72-812d-9a4dbfe528e3","Type":"ContainerDied","Data":"4bde9a731e27e1855136b3da0108c51e9997fb50bdb94f55db573bb4464ff0a0"}
Jul 23 13:16:59.390381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.390031    2564 scope.go:117] "RemoveContainer" containerID="36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126"
Jul 23 13:16:59.398507 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.398489    2564 scope.go:117] "RemoveContainer" containerID="36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126"
Jul 23 13:16:59.398750 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:16:59.398732    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126\": container with ID starting with 36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126 not found: ID does not exist" containerID="36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126"
Jul 23 13:16:59.398812 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.398762    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126"} err="failed to get container status \"36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126\": rpc error: code = NotFound desc = could not find container \"36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126\": container with ID starting with 36448ef1aec2199bf795948577db9aff9de09d2a174d9d8db1df5f3eadf95126 not found: ID does not exist"
Jul 23 13:16:59.415507 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.415485    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:59.421516 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.421493    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lczdl"]
Jul 23 13:16:59.770272 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:16:59.770244    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73518d51-58af-4b72-812d-9a4dbfe528e3" path="/var/lib/kubelet/pods/73518d51-58af-4b72-812d-9a4dbfe528e3/volumes"
Jul 23 13:17:00.821680 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.821649    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"]
Jul 23 13:17:00.822171 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.822154    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73518d51-58af-4b72-812d-9a4dbfe528e3" containerName="limitador"
Jul 23 13:17:00.822225 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.822174    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73518d51-58af-4b72-812d-9a4dbfe528e3" containerName="limitador"
Jul 23 13:17:00.822270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.822259    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73518d51-58af-4b72-812d-9a4dbfe528e3" containerName="limitador"
Jul 23 13:17:00.826641 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.826622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:00.829249 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.829227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:17:00.829249 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.829247    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 13:17:00.829997 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.829977    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:17:00.830084 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.829977    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tjpxk\""
Jul 23 13:17:00.837744 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.837721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"]
Jul 23 13:17:00.936422 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.936394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f5ef7262-5871-48a3-b72a-a827bf1bc926-data\") pod \"postgres-69fb4594cf-9ft86\" (UID: \"f5ef7262-5871-48a3-b72a-a827bf1bc926\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:00.936587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:00.936477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfbm\" (UniqueName: \"kubernetes.io/projected/f5ef7262-5871-48a3-b72a-a827bf1bc926-kube-api-access-8jfbm\") pod \"postgres-69fb4594cf-9ft86\" (UID: \"f5ef7262-5871-48a3-b72a-a827bf1bc926\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:01.037785 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.037748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfbm\" (UniqueName: \"kubernetes.io/projected/f5ef7262-5871-48a3-b72a-a827bf1bc926-kube-api-access-8jfbm\") pod \"postgres-69fb4594cf-9ft86\" (UID: \"f5ef7262-5871-48a3-b72a-a827bf1bc926\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:01.037785 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.037789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f5ef7262-5871-48a3-b72a-a827bf1bc926-data\") pod \"postgres-69fb4594cf-9ft86\" (UID: \"f5ef7262-5871-48a3-b72a-a827bf1bc926\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:01.038127 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.038112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f5ef7262-5871-48a3-b72a-a827bf1bc926-data\") pod \"postgres-69fb4594cf-9ft86\" (UID: \"f5ef7262-5871-48a3-b72a-a827bf1bc926\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:01.046950 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.046929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfbm\" (UniqueName: \"kubernetes.io/projected/f5ef7262-5871-48a3-b72a-a827bf1bc926-kube-api-access-8jfbm\") pod \"postgres-69fb4594cf-9ft86\" (UID: \"f5ef7262-5871-48a3-b72a-a827bf1bc926\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:01.137220 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.137147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:01.275897 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.275872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"]
Jul 23 13:17:01.278094 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:17:01.278068    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ef7262_5871_48a3_b72a_a827bf1bc926.slice/crio-97f8875a9653bcf495fda703579a4f275ddd031fca1c8c8e0ecd41e9947de7a3 WatchSource:0}: Error finding container 97f8875a9653bcf495fda703579a4f275ddd031fca1c8c8e0ecd41e9947de7a3: Status 404 returned error can't find the container with id 97f8875a9653bcf495fda703579a4f275ddd031fca1c8c8e0ecd41e9947de7a3
Jul 23 13:17:01.400632 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:01.400546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86" event={"ID":"f5ef7262-5871-48a3-b72a-a827bf1bc926","Type":"ContainerStarted","Data":"97f8875a9653bcf495fda703579a4f275ddd031fca1c8c8e0ecd41e9947de7a3"}
Jul 23 13:17:06.428565 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:06.428527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86" event={"ID":"f5ef7262-5871-48a3-b72a-a827bf1bc926","Type":"ContainerStarted","Data":"4db9b201209ac9e8f008c918316de2fcb941618c4377633cf75de7394d95c7f8"}
Jul 23 13:17:06.429039 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:06.428637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:06.445916 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:06.445842    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86" podStartSLOduration=1.5855371219999999 podStartE2EDuration="6.445828261s" totalImagesPullingTime="4.860291139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:06.444633946 +0000 UTC m=+597.181867265" watchObservedRunningTime="2026-07-23 13:17:06.445828261 +0000 UTC m=+597.183061612"
Jul 23 13:17:09.673036 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:09.673009    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:17:09.675154 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:09.675124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:17:12.462058 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:12.462029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9ft86"
Jul 23 13:17:19.795441 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:19.795389    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c987b87bc-jdzpf"]
Jul 23 13:17:19.993397 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:19.993362    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c987b87bc-jdzpf"]
Jul 23 13:17:19.993547 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:19.993471    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:19.997941 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:19.997915    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 13:17:19.998076 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:19.997982    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vbxcg\""
Jul 23 13:17:19.998243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:19.998229    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 13:17:20.016614 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.016588    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-vwsfq"]
Jul 23 13:17:20.030064 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.030037    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-vwsfq"]
Jul 23 13:17:20.030197 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.030141    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.098604 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.098535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-227td\" (UniqueName: \"kubernetes.io/projected/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-kube-api-access-227td\") pod \"maas-controller-c987b87bc-jdzpf\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") " pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.098604 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.098586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-webhook-cert\") pod \"maas-controller-c987b87bc-jdzpf\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") " pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.199402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.199364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-webhook-cert\") pod \"maas-controller-84c5ffc4c4-vwsfq\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") " pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.199565 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.199415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227td\" (UniqueName: \"kubernetes.io/projected/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-kube-api-access-227td\") pod \"maas-controller-c987b87bc-jdzpf\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") " pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.199565 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.199489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-webhook-cert\") pod \"maas-controller-c987b87bc-jdzpf\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") " pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.199565 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.199525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6bq2\" (UniqueName: \"kubernetes.io/projected/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-kube-api-access-t6bq2\") pod \"maas-controller-84c5ffc4c4-vwsfq\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") " pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.201891 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.201835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-webhook-cert\") pod \"maas-controller-c987b87bc-jdzpf\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") " pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.208809 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.208786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-227td\" (UniqueName: \"kubernetes.io/projected/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-kube-api-access-227td\") pod \"maas-controller-c987b87bc-jdzpf\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") " pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.300117 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.300085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-webhook-cert\") pod \"maas-controller-84c5ffc4c4-vwsfq\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") " pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.300256 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.300157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bq2\" (UniqueName: \"kubernetes.io/projected/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-kube-api-access-t6bq2\") pod \"maas-controller-84c5ffc4c4-vwsfq\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") " pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.302484 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.302464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-webhook-cert\") pod \"maas-controller-84c5ffc4c4-vwsfq\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") " pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.304364 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.304327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:20.311689 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.311662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bq2\" (UniqueName: \"kubernetes.io/projected/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-kube-api-access-t6bq2\") pod \"maas-controller-84c5ffc4c4-vwsfq\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") " pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.340269 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.340248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:20.494653 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.494619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c987b87bc-jdzpf"]
Jul 23 13:17:20.498020 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:17:20.497977    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65fa5d8_9bde_4a07_8374_7e0f0c9bca30.slice/crio-8e8f0fcbfba6b68415cd4ef694236fc613d2e7744e34c169ade2131ee263db22 WatchSource:0}: Error finding container 8e8f0fcbfba6b68415cd4ef694236fc613d2e7744e34c169ade2131ee263db22: Status 404 returned error can't find the container with id 8e8f0fcbfba6b68415cd4ef694236fc613d2e7744e34c169ade2131ee263db22
Jul 23 13:17:20.525514 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:20.525493    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-vwsfq"]
Jul 23 13:17:20.527788 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:17:20.527764    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01a6092_5ecf_4100_9a59_1f3fb8a55c09.slice/crio-cb0868b32a61c0f5d3ad0e03ac0aad96850bc84a5319e90f1baddfe554089c60 WatchSource:0}: Error finding container cb0868b32a61c0f5d3ad0e03ac0aad96850bc84a5319e90f1baddfe554089c60: Status 404 returned error can't find the container with id cb0868b32a61c0f5d3ad0e03ac0aad96850bc84a5319e90f1baddfe554089c60
Jul 23 13:17:21.499700 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:21.499609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" event={"ID":"d01a6092-5ecf-4100-9a59-1f3fb8a55c09","Type":"ContainerStarted","Data":"cb0868b32a61c0f5d3ad0e03ac0aad96850bc84a5319e90f1baddfe554089c60"}
Jul 23 13:17:21.501679 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:21.501612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c987b87bc-jdzpf" event={"ID":"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30","Type":"ContainerStarted","Data":"8e8f0fcbfba6b68415cd4ef694236fc613d2e7744e34c169ade2131ee263db22"}
Jul 23 13:17:23.512751 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:23.512711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" event={"ID":"d01a6092-5ecf-4100-9a59-1f3fb8a55c09","Type":"ContainerStarted","Data":"1c7b29620bac7e61e0232dcda5b2e92c38d76e10a392a0e96ad5781d607108f7"}
Jul 23 13:17:23.513263 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:23.512890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:23.514340 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:23.514309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c987b87bc-jdzpf" event={"ID":"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30","Type":"ContainerStarted","Data":"de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b"}
Jul 23 13:17:23.514465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:23.514374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:23.550407 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:23.550362    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" podStartSLOduration=2.045026043 podStartE2EDuration="4.550346105s" totalImagesPullingTime="2.505320062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:23.549914656 +0000 UTC m=+614.287147975" watchObservedRunningTime="2026-07-23 13:17:23.550346105 +0000 UTC m=+614.287579423"
Jul 23 13:17:34.521446 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.521367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:17:34.521446 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.521431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:34.541151 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.541109    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c987b87bc-jdzpf" podStartSLOduration=12.995374508 podStartE2EDuration="15.541094175s" totalImagesPullingTime="2.545719667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:23.595654452 +0000 UTC m=+614.332887771" watchObservedRunningTime="2026-07-23 13:17:34.541094175 +0000 UTC m=+625.278327493"
Jul 23 13:17:34.585545 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.585513    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c987b87bc-jdzpf"]
Jul 23 13:17:34.585744 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.585699    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c987b87bc-jdzpf" podUID="c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" containerName="manager" containerID="cri-o://de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b" gracePeriod=30
Jul 23 13:17:34.829695 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.829664    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:34.925250 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.925212    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-227td\" (UniqueName: \"kubernetes.io/projected/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-kube-api-access-227td\") pod \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") "
Jul 23 13:17:34.925417 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.925273    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-webhook-cert\") pod \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\" (UID: \"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30\") "
Jul 23 13:17:34.927367 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.927339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-kube-api-access-227td" (OuterVolumeSpecName: "kube-api-access-227td") pod "c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" (UID: "c65fa5d8-9bde-4a07-8374-7e0f0c9bca30"). InnerVolumeSpecName "kube-api-access-227td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:17:34.927470 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:34.927439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" (UID: "c65fa5d8-9bde-4a07-8374-7e0f0c9bca30"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:17:35.025935 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.025906    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-webhook-cert\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:17:35.025935 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.025931    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-227td\" (UniqueName: \"kubernetes.io/projected/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30-kube-api-access-227td\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:17:35.568285 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.568252    2564 generic.go:356] "Generic (PLEG): container finished" podID="c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" containerID="de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b" exitCode=0
Jul 23 13:17:35.568711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.568302    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c987b87bc-jdzpf"
Jul 23 13:17:35.568711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.568343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c987b87bc-jdzpf" event={"ID":"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30","Type":"ContainerDied","Data":"de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b"}
Jul 23 13:17:35.568711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.568404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c987b87bc-jdzpf" event={"ID":"c65fa5d8-9bde-4a07-8374-7e0f0c9bca30","Type":"ContainerDied","Data":"8e8f0fcbfba6b68415cd4ef694236fc613d2e7744e34c169ade2131ee263db22"}
Jul 23 13:17:35.568711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.568433    2564 scope.go:117] "RemoveContainer" containerID="de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b"
Jul 23 13:17:35.581066 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.581047    2564 scope.go:117] "RemoveContainer" containerID="de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b"
Jul 23 13:17:35.581327 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:17:35.581309    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b\": container with ID starting with de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b not found: ID does not exist" containerID="de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b"
Jul 23 13:17:35.581364 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.581336    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b"} err="failed to get container status \"de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b\": rpc error: code = NotFound desc = could not find container \"de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b\": container with ID starting with de457c5eb1f6e09ef4c53855927357e796d599036d860eba3e08e2b701717c8b not found: ID does not exist"
Jul 23 13:17:35.592954 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.592928    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c987b87bc-jdzpf"]
Jul 23 13:17:35.597191 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.597170    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c987b87bc-jdzpf"]
Jul 23 13:17:35.769157 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:35.769123    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" path="/var/lib/kubelet/pods/c65fa5d8-9bde-4a07-8374-7e0f0c9bca30/volumes"
Jul 23 13:17:56.292401 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.292364    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"]
Jul 23 13:17:56.292809 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.292768    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" containerName="manager"
Jul 23 13:17:56.292809 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.292784    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" containerName="manager"
Jul 23 13:17:56.292908 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.292889    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65fa5d8-9bde-4a07-8374-7e0f0c9bca30" containerName="manager"
Jul 23 13:17:56.296028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.296009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.298822 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.298803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 13:17:56.376491 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.376462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"]
Jul 23 13:17:56.393691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.393658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c86ffb-716a-45f1-9370-5f88818f203f-openshift-service-ca\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.393842 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.393716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxb5\" (UniqueName: \"kubernetes.io/projected/13c86ffb-716a-45f1-9370-5f88818f203f-kube-api-access-2qxb5\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.393899 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.393839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c86ffb-716a-45f1-9370-5f88818f203f-maas-api-tls\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.494665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.494631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c86ffb-716a-45f1-9370-5f88818f203f-openshift-service-ca\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.494837 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.494677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxb5\" (UniqueName: \"kubernetes.io/projected/13c86ffb-716a-45f1-9370-5f88818f203f-kube-api-access-2qxb5\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.494837 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.494769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c86ffb-716a-45f1-9370-5f88818f203f-maas-api-tls\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.494993 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:17:56.494898    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 23 13:17:56.494993 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:17:56.494972    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c86ffb-716a-45f1-9370-5f88818f203f-maas-api-tls podName:13c86ffb-716a-45f1-9370-5f88818f203f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:56.994950653 +0000 UTC m=+647.732183950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13c86ffb-716a-45f1-9370-5f88818f203f-maas-api-tls") pod "maas-api-ffc4758df-mk7fg" (UID: "13c86ffb-716a-45f1-9370-5f88818f203f") : secret "maas-api-serving-cert" not found
Jul 23 13:17:56.495431 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.495412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13c86ffb-716a-45f1-9370-5f88818f203f-openshift-service-ca\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.509593 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.509569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxb5\" (UniqueName: \"kubernetes.io/projected/13c86ffb-716a-45f1-9370-5f88818f203f-kube-api-access-2qxb5\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:56.919945 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.919915    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4w6p5"]
Jul 23 13:17:56.928697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.928675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:56.930948 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.930922    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pm4tx\""
Jul 23 13:17:56.931047 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.930922    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 13:17:56.937852 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.937831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4w6p5"]
Jul 23 13:17:56.948097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.948074    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"]
Jul 23 13:17:56.952055 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.952033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:56.971016 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:56.970996    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"]
Jul 23 13:17:57.000114 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.000087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsv2w\" (UniqueName: \"kubernetes.io/projected/0278fb3d-0e02-4662-9ffa-6e20c7f6499a-kube-api-access-fsv2w\") pod \"payload-pre-processing-7677b774bb-mbqjh\" (UID: \"0278fb3d-0e02-4662-9ffa-6e20c7f6499a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.000244 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.000127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c86ffb-716a-45f1-9370-5f88818f203f-maas-api-tls\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:57.000244 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.000148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0278fb3d-0e02-4662-9ffa-6e20c7f6499a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mbqjh\" (UID: \"0278fb3d-0e02-4662-9ffa-6e20c7f6499a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.000319 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.000248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35268edc-9f0e-4c61-8def-55e1609d828c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4w6p5\" (UID: \"35268edc-9f0e-4c61-8def-55e1609d828c\") " pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.000319 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.000269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smv2f\" (UniqueName: \"kubernetes.io/projected/35268edc-9f0e-4c61-8def-55e1609d828c-kube-api-access-smv2f\") pod \"payload-processing-5bf47cd988-4w6p5\" (UID: \"35268edc-9f0e-4c61-8def-55e1609d828c\") " pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.002449 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.002423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13c86ffb-716a-45f1-9370-5f88818f203f-maas-api-tls\") pod \"maas-api-ffc4758df-mk7fg\" (UID: \"13c86ffb-716a-45f1-9370-5f88818f203f\") " pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:57.101415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.101377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsv2w\" (UniqueName: \"kubernetes.io/projected/0278fb3d-0e02-4662-9ffa-6e20c7f6499a-kube-api-access-fsv2w\") pod \"payload-pre-processing-7677b774bb-mbqjh\" (UID: \"0278fb3d-0e02-4662-9ffa-6e20c7f6499a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.101415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.101420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0278fb3d-0e02-4662-9ffa-6e20c7f6499a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mbqjh\" (UID: \"0278fb3d-0e02-4662-9ffa-6e20c7f6499a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.101614 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.101568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35268edc-9f0e-4c61-8def-55e1609d828c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4w6p5\" (UID: \"35268edc-9f0e-4c61-8def-55e1609d828c\") " pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.101614 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.101605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smv2f\" (UniqueName: \"kubernetes.io/projected/35268edc-9f0e-4c61-8def-55e1609d828c-kube-api-access-smv2f\") pod \"payload-processing-5bf47cd988-4w6p5\" (UID: \"35268edc-9f0e-4c61-8def-55e1609d828c\") " pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.102123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.102106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0278fb3d-0e02-4662-9ffa-6e20c7f6499a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mbqjh\" (UID: \"0278fb3d-0e02-4662-9ffa-6e20c7f6499a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.102275 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.102257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35268edc-9f0e-4c61-8def-55e1609d828c-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4w6p5\" (UID: \"35268edc-9f0e-4c61-8def-55e1609d828c\") " pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.110203 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.110173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smv2f\" (UniqueName: \"kubernetes.io/projected/35268edc-9f0e-4c61-8def-55e1609d828c-kube-api-access-smv2f\") pod \"payload-processing-5bf47cd988-4w6p5\" (UID: \"35268edc-9f0e-4c61-8def-55e1609d828c\") " pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.110311 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.110210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsv2w\" (UniqueName: \"kubernetes.io/projected/0278fb3d-0e02-4662-9ffa-6e20c7f6499a-kube-api-access-fsv2w\") pod \"payload-pre-processing-7677b774bb-mbqjh\" (UID: \"0278fb3d-0e02-4662-9ffa-6e20c7f6499a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.205740 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.205663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:17:57.240334 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.240307    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:17:57.262161 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.261936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:17:57.381224 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.381195    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"]
Jul 23 13:17:57.383704 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:17:57.383603    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c86ffb_716a_45f1_9370_5f88818f203f.slice/crio-e86b224a6b6fc6787f92ef9a3de092b1753624b2580ed721a3b6c92c8ad0facc WatchSource:0}: Error finding container e86b224a6b6fc6787f92ef9a3de092b1753624b2580ed721a3b6c92c8ad0facc: Status 404 returned error can't find the container with id e86b224a6b6fc6787f92ef9a3de092b1753624b2580ed721a3b6c92c8ad0facc
Jul 23 13:17:57.432625 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.432595    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4w6p5"]
Jul 23 13:17:57.434560 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:17:57.434529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35268edc_9f0e_4c61_8def_55e1609d828c.slice/crio-30b909e9ef58c55b36ce63d25098b794051f0fcb0ad2e09c7066fb2b547c001b WatchSource:0}: Error finding container 30b909e9ef58c55b36ce63d25098b794051f0fcb0ad2e09c7066fb2b547c001b: Status 404 returned error can't find the container with id 30b909e9ef58c55b36ce63d25098b794051f0fcb0ad2e09c7066fb2b547c001b
Jul 23 13:17:57.452532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.452499    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"]
Jul 23 13:17:57.454751 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:17:57.454731    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0278fb3d_0e02_4662_9ffa_6e20c7f6499a.slice/crio-59c2b6400f150a66fd6fd24485b9dbaba1f79990308b18b43814d8625811e357 WatchSource:0}: Error finding container 59c2b6400f150a66fd6fd24485b9dbaba1f79990308b18b43814d8625811e357: Status 404 returned error can't find the container with id 59c2b6400f150a66fd6fd24485b9dbaba1f79990308b18b43814d8625811e357
Jul 23 13:17:57.665483 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.665446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh" event={"ID":"0278fb3d-0e02-4662-9ffa-6e20c7f6499a","Type":"ContainerStarted","Data":"59c2b6400f150a66fd6fd24485b9dbaba1f79990308b18b43814d8625811e357"}
Jul 23 13:17:57.666518 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.666492    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg" event={"ID":"13c86ffb-716a-45f1-9370-5f88818f203f","Type":"ContainerStarted","Data":"e86b224a6b6fc6787f92ef9a3de092b1753624b2580ed721a3b6c92c8ad0facc"}
Jul 23 13:17:57.667476 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:17:57.667451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5" event={"ID":"35268edc-9f0e-4c61-8def-55e1609d828c","Type":"ContainerStarted","Data":"30b909e9ef58c55b36ce63d25098b794051f0fcb0ad2e09c7066fb2b547c001b"}
Jul 23 13:18:00.691517 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.691479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5" event={"ID":"35268edc-9f0e-4c61-8def-55e1609d828c","Type":"ContainerStarted","Data":"eafec7bf06eed77b21d64c94c3e60fb9e63fcc18a2e4a78948e9817a77a1f037"}
Jul 23 13:18:00.691996 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.691658    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:18:00.693036 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.693005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh" event={"ID":"0278fb3d-0e02-4662-9ffa-6e20c7f6499a","Type":"ContainerStarted","Data":"40b9cc77383fd9873ac7c7d7408af5ceb134e6991a9207764dfa36f704fcece0"}
Jul 23 13:18:00.693165 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.693062    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:18:00.694398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.694375    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg" event={"ID":"13c86ffb-716a-45f1-9370-5f88818f203f","Type":"ContainerStarted","Data":"b5ab9d0cb6b1f2cd87fd6be409a29dec42541173e88568813ee53da2b8de2ce6"}
Jul 23 13:18:00.694535 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.694521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:18:00.713970 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.713930    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5" podStartSLOduration=2.162091405 podStartE2EDuration="4.713917122s" totalImagesPullingTime="2.551825717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:00.712222031 +0000 UTC m=+651.449455349" watchObservedRunningTime="2026-07-23 13:18:00.713917122 +0000 UTC m=+651.451150419"
Jul 23 13:18:00.732599 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.732561    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg" podStartSLOduration=2.188954632 podStartE2EDuration="4.732549593s" totalImagesPullingTime="2.543594961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:00.731172526 +0000 UTC m=+651.468405836" watchObservedRunningTime="2026-07-23 13:18:00.732549593 +0000 UTC m=+651.469782911"
Jul 23 13:18:00.751749 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:00.751610    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh" podStartSLOduration=2.219335847 podStartE2EDuration="4.751596553s" totalImagesPullingTime="2.532260706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:00.750105444 +0000 UTC m=+651.487338759" watchObservedRunningTime="2026-07-23 13:18:00.751596553 +0000 UTC m=+651.488829872"
Jul 23 13:18:06.704854 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:06.704826    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-ffc4758df-mk7fg"
Jul 23 13:18:11.701780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:11.701747    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-mbqjh"
Jul 23 13:18:11.702173 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:11.701910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-4w6p5"
Jul 23 13:18:23.071697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.071664    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"]
Jul 23 13:18:23.076524 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.076497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.080059 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.080037    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 13:18:23.080177 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.080104    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 13:18:23.080983 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.080967    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 13:18:23.081073 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.081005    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7r8qz\""
Jul 23 13:18:23.095913 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.095891    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"]
Jul 23 13:18:23.236200 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.236167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.236365 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.236209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1909a2d8-f252-4505-a0fe-603571a1e2d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.236365 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.236235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.236365 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.236302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.236556 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.236367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.236556 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.236417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7tw\" (UniqueName: \"kubernetes.io/projected/1909a2d8-f252-4505-a0fe-603571a1e2d6-kube-api-access-rn7tw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337357 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1909a2d8-f252-4505-a0fe-603571a1e2d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337357 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337357 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337554 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337554 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7tw\" (UniqueName: \"kubernetes.io/projected/1909a2d8-f252-4505-a0fe-603571a1e2d6-kube-api-access-rn7tw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337657 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337757 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337825 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.337901 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.337818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.339590 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.339566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1909a2d8-f252-4505-a0fe-603571a1e2d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.339765 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.339747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1909a2d8-f252-4505-a0fe-603571a1e2d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.346187 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.346166    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7tw\" (UniqueName: \"kubernetes.io/projected/1909a2d8-f252-4505-a0fe-603571a1e2d6-kube-api-access-rn7tw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9\" (UID: \"1909a2d8-f252-4505-a0fe-603571a1e2d6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.386810 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.386782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:23.524319 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.524283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"]
Jul 23 13:18:23.527588 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:18:23.527556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1909a2d8_f252_4505_a0fe_603571a1e2d6.slice/crio-cee185d0015d895c4b4146f4b18de105ea836aab45791ecde8b3683c68cdf650 WatchSource:0}: Error finding container cee185d0015d895c4b4146f4b18de105ea836aab45791ecde8b3683c68cdf650: Status 404 returned error can't find the container with id cee185d0015d895c4b4146f4b18de105ea836aab45791ecde8b3683c68cdf650
Jul 23 13:18:23.799500 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:23.799463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9" event={"ID":"1909a2d8-f252-4505-a0fe-603571a1e2d6","Type":"ContainerStarted","Data":"cee185d0015d895c4b4146f4b18de105ea836aab45791ecde8b3683c68cdf650"}
Jul 23 13:18:25.809587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:25.809550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9" event={"ID":"1909a2d8-f252-4505-a0fe-603571a1e2d6","Type":"ContainerStarted","Data":"e91c7d1c099717e43788ed86731af2f27474c1bf4a08a43df5a5886d6dc3b915"}
Jul 23 13:18:25.826634 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:25.826587    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9" podStartSLOduration=1.6092726000000002 podStartE2EDuration="2.826571264s" totalImagesPullingTime="1.217298664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:25.82522019 +0000 UTC m=+676.562453712" watchObservedRunningTime="2026-07-23 13:18:25.826571264 +0000 UTC m=+676.563804583"
Jul 23 13:18:33.386932 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:33.386899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:33.387310 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:33.386958    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:33.399432 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:33.399402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:18:33.854276 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:18:33.854248    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9"
Jul 23 13:19:38.776160 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.776083    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"]
Jul 23 13:19:38.779289 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.779272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.783903 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.783848    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 13:19:38.796957 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.796929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"]
Jul 23 13:19:38.885349 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.885312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc7af28f-ff83-4836-8b12-ecd7d815f30b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.885532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.885452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.885532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.885485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.885532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.885506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.885711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.885657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwmxs\" (UniqueName: \"kubernetes.io/projected/fc7af28f-ff83-4836-8b12-ecd7d815f30b-kube-api-access-fwmxs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.885711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.885704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.986582 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.986582 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.986813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.986813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwmxs\" (UniqueName: \"kubernetes.io/projected/fc7af28f-ff83-4836-8b12-ecd7d815f30b-kube-api-access-fwmxs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.986813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.986813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc7af28f-ff83-4836-8b12-ecd7d815f30b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.987040 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.986977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.987097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.987073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.987148 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.987103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.988874 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.988834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc7af28f-ff83-4836-8b12-ecd7d815f30b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.989088 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.989070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc7af28f-ff83-4836-8b12-ecd7d815f30b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:38.996836 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:38.996809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwmxs\" (UniqueName: \"kubernetes.io/projected/fc7af28f-ff83-4836-8b12-ecd7d815f30b-kube-api-access-fwmxs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8\" (UID: \"fc7af28f-ff83-4836-8b12-ecd7d815f30b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:39.088543 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:39.088454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:39.226578 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:39.226542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"]
Jul 23 13:19:39.229979 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:19:39.229946    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc7af28f_ff83_4836_8b12_ecd7d815f30b.slice/crio-5511b2ffe9cfcd00d7ea239bbc4a5538399b2e3e0c0c6730263f92d88330ff64 WatchSource:0}: Error finding container 5511b2ffe9cfcd00d7ea239bbc4a5538399b2e3e0c0c6730263f92d88330ff64: Status 404 returned error can't find the container with id 5511b2ffe9cfcd00d7ea239bbc4a5538399b2e3e0c0c6730263f92d88330ff64
Jul 23 13:19:39.231396 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:39.231373    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:19:40.137092 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:40.137054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8" event={"ID":"fc7af28f-ff83-4836-8b12-ecd7d815f30b","Type":"ContainerStarted","Data":"52106af003c6602e2dd05b96934f6d4510548d06fc88e40c629bf0a4e8f65d90"}
Jul 23 13:19:40.137092 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:40.137099    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8" event={"ID":"fc7af28f-ff83-4836-8b12-ecd7d815f30b","Type":"ContainerStarted","Data":"5511b2ffe9cfcd00d7ea239bbc4a5538399b2e3e0c0c6730263f92d88330ff64"}
Jul 23 13:19:40.157894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:40.157824    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8" podStartSLOduration=1.9280388419999999 podStartE2EDuration="2.157808966s" totalImagesPullingTime="229.770124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:40.156836518 +0000 UTC m=+750.894069839" watchObservedRunningTime="2026-07-23 13:19:40.157808966 +0000 UTC m=+750.895042286"
Jul 23 13:19:49.089445 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:49.089352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:49.089917 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:49.089468    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:49.102056 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:49.102032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:19:49.189414 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:19:49.189384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8"
Jul 23 13:21:14.351308 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.351269    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-vwsfq"]
Jul 23 13:21:14.351757 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.351460    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" podUID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" containerName="manager" containerID="cri-o://1c7b29620bac7e61e0232dcda5b2e92c38d76e10a392a0e96ad5781d607108f7" gracePeriod=30
Jul 23 13:21:14.571324 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.571294    2564 generic.go:356] "Generic (PLEG): container finished" podID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" containerID="1c7b29620bac7e61e0232dcda5b2e92c38d76e10a392a0e96ad5781d607108f7" exitCode=0
Jul 23 13:21:14.571483 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.571369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" event={"ID":"d01a6092-5ecf-4100-9a59-1f3fb8a55c09","Type":"ContainerDied","Data":"1c7b29620bac7e61e0232dcda5b2e92c38d76e10a392a0e96ad5781d607108f7"}
Jul 23 13:21:14.603974 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.603919    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:21:14.625882 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.625830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6bq2\" (UniqueName: \"kubernetes.io/projected/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-kube-api-access-t6bq2\") pod \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") "
Jul 23 13:21:14.626097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.626028    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-webhook-cert\") pod \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\" (UID: \"d01a6092-5ecf-4100-9a59-1f3fb8a55c09\") "
Jul 23 13:21:14.628907 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.628854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d01a6092-5ecf-4100-9a59-1f3fb8a55c09" (UID: "d01a6092-5ecf-4100-9a59-1f3fb8a55c09"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:21:14.629034 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.628934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-kube-api-access-t6bq2" (OuterVolumeSpecName: "kube-api-access-t6bq2") pod "d01a6092-5ecf-4100-9a59-1f3fb8a55c09" (UID: "d01a6092-5ecf-4100-9a59-1f3fb8a55c09"). InnerVolumeSpecName "kube-api-access-t6bq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:21:14.727539 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.727503    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-webhook-cert\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:21:14.727539 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:14.727533    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6bq2\" (UniqueName: \"kubernetes.io/projected/d01a6092-5ecf-4100-9a59-1f3fb8a55c09-kube-api-access-t6bq2\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:21:15.520763 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.520714    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" podUID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.32:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 13:21:15.577128 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.577091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq" event={"ID":"d01a6092-5ecf-4100-9a59-1f3fb8a55c09","Type":"ContainerDied","Data":"cb0868b32a61c0f5d3ad0e03ac0aad96850bc84a5319e90f1baddfe554089c60"}
Jul 23 13:21:15.577273 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.577136    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-vwsfq"
Jul 23 13:21:15.577273 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.577187    2564 scope.go:117] "RemoveContainer" containerID="1c7b29620bac7e61e0232dcda5b2e92c38d76e10a392a0e96ad5781d607108f7"
Jul 23 13:21:15.600546 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.600519    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-vwsfq"]
Jul 23 13:21:15.602943 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.602923    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-vwsfq"]
Jul 23 13:21:15.769217 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:21:15.769189    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" path="/var/lib/kubelet/pods/d01a6092-5ecf-4100-9a59-1f3fb8a55c09/volumes"
Jul 23 13:22:09.701153 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:09.701087    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:22:09.701153 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:09.701090    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:22:16.463113 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.463082    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-txss2"]
Jul 23 13:22:16.463487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.463473    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" containerName="manager"
Jul 23 13:22:16.463529 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.463488    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" containerName="manager"
Jul 23 13:22:16.463562 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.463556    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d01a6092-5ecf-4100-9a59-1f3fb8a55c09" containerName="manager"
Jul 23 13:22:16.467421 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.467405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.470661 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.470642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 13:22:16.470661 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.470650    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 13:22:16.470832 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.470640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vbxcg\""
Jul 23 13:22:16.476168 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.476148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-txss2"]
Jul 23 13:22:16.543563 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.543526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8adb505-b268-4682-9f67-61f3795c82e2-webhook-cert\") pod \"maas-controller-84c5ffc4c4-txss2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") " pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.543748 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.543585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpmx\" (UniqueName: \"kubernetes.io/projected/a8adb505-b268-4682-9f67-61f3795c82e2-kube-api-access-nxpmx\") pod \"maas-controller-84c5ffc4c4-txss2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") " pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.644390 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.644348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8adb505-b268-4682-9f67-61f3795c82e2-webhook-cert\") pod \"maas-controller-84c5ffc4c4-txss2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") " pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.644584 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.644428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpmx\" (UniqueName: \"kubernetes.io/projected/a8adb505-b268-4682-9f67-61f3795c82e2-kube-api-access-nxpmx\") pod \"maas-controller-84c5ffc4c4-txss2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") " pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.646743 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.646720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8adb505-b268-4682-9f67-61f3795c82e2-webhook-cert\") pod \"maas-controller-84c5ffc4c4-txss2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") " pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.653182 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.653158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpmx\" (UniqueName: \"kubernetes.io/projected/a8adb505-b268-4682-9f67-61f3795c82e2-kube-api-access-nxpmx\") pod \"maas-controller-84c5ffc4c4-txss2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") " pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.778781 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.778699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:16.910292 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:16.910267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-txss2"]
Jul 23 13:22:16.912827 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:22:16.912802    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8adb505_b268_4682_9f67_61f3795c82e2.slice/crio-354d358a469df7fc88a3b17ffd09091a2a396bd9fbb8b47a82803c7ae53533d4 WatchSource:0}: Error finding container 354d358a469df7fc88a3b17ffd09091a2a396bd9fbb8b47a82803c7ae53533d4: Status 404 returned error can't find the container with id 354d358a469df7fc88a3b17ffd09091a2a396bd9fbb8b47a82803c7ae53533d4
Jul 23 13:22:17.866749 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:17.866713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-txss2" event={"ID":"a8adb505-b268-4682-9f67-61f3795c82e2","Type":"ContainerStarted","Data":"a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d"}
Jul 23 13:22:17.867159 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:17.866764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-txss2" event={"ID":"a8adb505-b268-4682-9f67-61f3795c82e2","Type":"ContainerStarted","Data":"354d358a469df7fc88a3b17ffd09091a2a396bd9fbb8b47a82803c7ae53533d4"}
Jul 23 13:22:17.867159 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:17.866809    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:17.884121 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:17.884074    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84c5ffc4c4-txss2" podStartSLOduration=1.446884832 podStartE2EDuration="1.8840595s" totalImagesPullingTime="437.174668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:22:17.883018345 +0000 UTC m=+908.620251664" watchObservedRunningTime="2026-07-23 13:22:17.8840595 +0000 UTC m=+908.621292820"
Jul 23 13:22:28.873697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:28.873660    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:33.549653 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.549617    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-txss2"]
Jul 23 13:22:33.550116 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.549823    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84c5ffc4c4-txss2" podUID="a8adb505-b268-4682-9f67-61f3795c82e2" containerName="manager" containerID="cri-o://a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d" gracePeriod=30
Jul 23 13:22:33.895330 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.895305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:33.938232 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.938199    2564 generic.go:356] "Generic (PLEG): container finished" podID="a8adb505-b268-4682-9f67-61f3795c82e2" containerID="a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d" exitCode=0
Jul 23 13:22:33.938386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.938249    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-txss2"
Jul 23 13:22:33.938386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.938281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-txss2" event={"ID":"a8adb505-b268-4682-9f67-61f3795c82e2","Type":"ContainerDied","Data":"a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d"}
Jul 23 13:22:33.938386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.938333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-txss2" event={"ID":"a8adb505-b268-4682-9f67-61f3795c82e2","Type":"ContainerDied","Data":"354d358a469df7fc88a3b17ffd09091a2a396bd9fbb8b47a82803c7ae53533d4"}
Jul 23 13:22:33.938386 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.938363    2564 scope.go:117] "RemoveContainer" containerID="a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d"
Jul 23 13:22:33.947835 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.947809    2564 scope.go:117] "RemoveContainer" containerID="a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d"
Jul 23 13:22:33.948120 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:22:33.948102    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d\": container with ID starting with a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d not found: ID does not exist" containerID="a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d"
Jul 23 13:22:33.948186 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.948133    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d"} err="failed to get container status \"a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d\": rpc error: code = NotFound desc = could not find container \"a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d\": container with ID starting with a227b9bb823821cc7d700276697ae1cde96fbcc98df10cd48dd5d2d985e0ed8d not found: ID does not exist"
Jul 23 13:22:33.989539 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.989513    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxpmx\" (UniqueName: \"kubernetes.io/projected/a8adb505-b268-4682-9f67-61f3795c82e2-kube-api-access-nxpmx\") pod \"a8adb505-b268-4682-9f67-61f3795c82e2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") "
Jul 23 13:22:33.989637 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.989554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8adb505-b268-4682-9f67-61f3795c82e2-webhook-cert\") pod \"a8adb505-b268-4682-9f67-61f3795c82e2\" (UID: \"a8adb505-b268-4682-9f67-61f3795c82e2\") "
Jul 23 13:22:33.991458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.991433    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8adb505-b268-4682-9f67-61f3795c82e2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a8adb505-b268-4682-9f67-61f3795c82e2" (UID: "a8adb505-b268-4682-9f67-61f3795c82e2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:22:33.991532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:33.991499    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8adb505-b268-4682-9f67-61f3795c82e2-kube-api-access-nxpmx" (OuterVolumeSpecName: "kube-api-access-nxpmx") pod "a8adb505-b268-4682-9f67-61f3795c82e2" (UID: "a8adb505-b268-4682-9f67-61f3795c82e2"). InnerVolumeSpecName "kube-api-access-nxpmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:22:34.097068 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:34.091496    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxpmx\" (UniqueName: \"kubernetes.io/projected/a8adb505-b268-4682-9f67-61f3795c82e2-kube-api-access-nxpmx\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:22:34.097068 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:34.091545    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8adb505-b268-4682-9f67-61f3795c82e2-webhook-cert\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:22:34.260045 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:34.260019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-txss2"]
Jul 23 13:22:34.264300 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:34.264272    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-txss2"]
Jul 23 13:22:35.061268 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.061235    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-82mpg"]
Jul 23 13:22:35.061656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.061642    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8adb505-b268-4682-9f67-61f3795c82e2" containerName="manager"
Jul 23 13:22:35.061701 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.061659    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8adb505-b268-4682-9f67-61f3795c82e2" containerName="manager"
Jul 23 13:22:35.061735 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.061727    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8adb505-b268-4682-9f67-61f3795c82e2" containerName="manager"
Jul 23 13:22:35.066035 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.066015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.069404 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.069378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 13:22:35.069529 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.069408    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 13:22:35.069529 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.069377    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vbxcg\""
Jul 23 13:22:35.076381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.076362    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-82mpg"]
Jul 23 13:22:35.200704 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.200669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2pb4\" (UniqueName: \"kubernetes.io/projected/c5875e6e-cf6b-495a-952f-6598b6c8fe2b-kube-api-access-g2pb4\") pod \"maas-controller-84c5ffc4c4-82mpg\" (UID: \"c5875e6e-cf6b-495a-952f-6598b6c8fe2b\") " pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.200913 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.200718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5875e6e-cf6b-495a-952f-6598b6c8fe2b-webhook-cert\") pod \"maas-controller-84c5ffc4c4-82mpg\" (UID: \"c5875e6e-cf6b-495a-952f-6598b6c8fe2b\") " pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.302242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.302209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2pb4\" (UniqueName: \"kubernetes.io/projected/c5875e6e-cf6b-495a-952f-6598b6c8fe2b-kube-api-access-g2pb4\") pod \"maas-controller-84c5ffc4c4-82mpg\" (UID: \"c5875e6e-cf6b-495a-952f-6598b6c8fe2b\") " pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.302374 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.302253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5875e6e-cf6b-495a-952f-6598b6c8fe2b-webhook-cert\") pod \"maas-controller-84c5ffc4c4-82mpg\" (UID: \"c5875e6e-cf6b-495a-952f-6598b6c8fe2b\") " pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.304587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.304563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5875e6e-cf6b-495a-952f-6598b6c8fe2b-webhook-cert\") pod \"maas-controller-84c5ffc4c4-82mpg\" (UID: \"c5875e6e-cf6b-495a-952f-6598b6c8fe2b\") " pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.311229 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.311205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2pb4\" (UniqueName: \"kubernetes.io/projected/c5875e6e-cf6b-495a-952f-6598b6c8fe2b-kube-api-access-g2pb4\") pod \"maas-controller-84c5ffc4c4-82mpg\" (UID: \"c5875e6e-cf6b-495a-952f-6598b6c8fe2b\") " pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.376878 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.376801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.505459 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.505435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84c5ffc4c4-82mpg"]
Jul 23 13:22:35.507704 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:22:35.507675    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5875e6e_cf6b_495a_952f_6598b6c8fe2b.slice/crio-d33d5b4d3e89045adaf15f5cdc443093d096d1fd6143e9ab8d78f872f667306d WatchSource:0}: Error finding container d33d5b4d3e89045adaf15f5cdc443093d096d1fd6143e9ab8d78f872f667306d: Status 404 returned error can't find the container with id d33d5b4d3e89045adaf15f5cdc443093d096d1fd6143e9ab8d78f872f667306d
Jul 23 13:22:35.770349 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.770318    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8adb505-b268-4682-9f67-61f3795c82e2" path="/var/lib/kubelet/pods/a8adb505-b268-4682-9f67-61f3795c82e2/volumes"
Jul 23 13:22:35.951243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.951212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg" event={"ID":"c5875e6e-cf6b-495a-952f-6598b6c8fe2b","Type":"ContainerStarted","Data":"a436402eff9dc9663bc8d49c844de5305a765cdcb69d4789890889257070b406"}
Jul 23 13:22:35.951380 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.951267    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg" event={"ID":"c5875e6e-cf6b-495a-952f-6598b6c8fe2b","Type":"ContainerStarted","Data":"d33d5b4d3e89045adaf15f5cdc443093d096d1fd6143e9ab8d78f872f667306d"}
Jul 23 13:22:35.951380 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.951330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:22:35.970765 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:35.970718    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg" podStartSLOduration=0.598562301 podStartE2EDuration="970.700724ms" totalImagesPullingTime="372.138423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:22:35.970039091 +0000 UTC m=+926.707272414" watchObservedRunningTime="2026-07-23 13:22:35.970700724 +0000 UTC m=+926.707934047"
Jul 23 13:22:46.957721 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:22:46.957681    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84c5ffc4c4-82mpg"
Jul 23 13:27:09.728756 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:27:09.728730    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:27:09.729567 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:27:09.729547    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:31:11.771423 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.771349    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"]
Jul 23 13:31:11.774551 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.774534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.777410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.777386    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-56651086-kserve-self-signed-certs\""
Jul 23 13:31:11.789790 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.789766    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"]
Jul 23 13:31:11.833993 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.833960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tmp-dir\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.834124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.834003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-model-cache\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.834124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.834085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/b3755283-ee3d-40ae-a7ee-625af6dc1b54-kube-api-access-gsg94\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.834199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.834133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-dshm\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.834199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.834167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-home\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.834280 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.834218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tls-certs\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935308 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tmp-dir\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935308 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-model-cache\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935519 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/b3755283-ee3d-40ae-a7ee-625af6dc1b54-kube-api-access-gsg94\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935519 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-dshm\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935519 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-home\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935519 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tls-certs\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935704 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935680    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-model-cache\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935808 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tmp-dir\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.935905 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.935885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-home\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.937707 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.937680    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-dshm\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.937885 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.937850    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tls-certs\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:11.943370 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:11.943349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/b3755283-ee3d-40ae-a7ee-625af6dc1b54-kube-api-access-gsg94\") pod \"e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") " pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:12.084636 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:12.084563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:12.221712 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:12.221684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"]
Jul 23 13:31:12.224507 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:31:12.224484    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3755283_ee3d_40ae_a7ee_625af6dc1b54.slice/crio-045e851fe9f1f48bca270f262edc10f5a40de6fbf281aea2cf55e6ef642d36a5 WatchSource:0}: Error finding container 045e851fe9f1f48bca270f262edc10f5a40de6fbf281aea2cf55e6ef642d36a5: Status 404 returned error can't find the container with id 045e851fe9f1f48bca270f262edc10f5a40de6fbf281aea2cf55e6ef642d36a5
Jul 23 13:31:12.258367 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:12.258342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg" event={"ID":"b3755283-ee3d-40ae-a7ee-625af6dc1b54","Type":"ContainerStarted","Data":"045e851fe9f1f48bca270f262edc10f5a40de6fbf281aea2cf55e6ef642d36a5"}
Jul 23 13:31:13.264263 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:13.264231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg" event={"ID":"b3755283-ee3d-40ae-a7ee-625af6dc1b54","Type":"ContainerStarted","Data":"704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc"}
Jul 23 13:31:13.284038 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:13.283992    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg" podStartSLOduration=2.283976716 podStartE2EDuration="2.283976716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:31:13.283883885 +0000 UTC m=+1444.021117203" watchObservedRunningTime="2026-07-23 13:31:13.283976716 +0000 UTC m=+1444.021210036"
Jul 23 13:31:22.084781 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:22.084745    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:22.085212 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:22.084812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:22.097137 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:22.097112    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:22.315188 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:22.315137    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:31:48.855394 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:31:48.855362    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"]
Jul 23 13:32:03.875731 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:03.875691    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg" podUID="b3755283-ee3d-40ae-a7ee-625af6dc1b54" containerName="main" containerID="cri-o://704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc" gracePeriod=45
Jul 23 13:32:04.127593 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.127540    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:32:04.193956 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.193930    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-dshm\") pod \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") "
Jul 23 13:32:04.194123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.193969    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-model-cache\") pod \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") "
Jul 23 13:32:04.194123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.193989    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tmp-dir\") pod \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") "
Jul 23 13:32:04.194123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.194031    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tls-certs\") pod \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") "
Jul 23 13:32:04.194123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.194055    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/b3755283-ee3d-40ae-a7ee-625af6dc1b54-kube-api-access-gsg94\") pod \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") "
Jul 23 13:32:04.194123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.194082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-home\") pod \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\" (UID: \"b3755283-ee3d-40ae-a7ee-625af6dc1b54\") "
Jul 23 13:32:04.194373 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.194301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3755283-ee3d-40ae-a7ee-625af6dc1b54" (UID: "b3755283-ee3d-40ae-a7ee-625af6dc1b54"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.194373 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.194320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3755283-ee3d-40ae-a7ee-625af6dc1b54" (UID: "b3755283-ee3d-40ae-a7ee-625af6dc1b54"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.194458 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.194398    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-home" (OuterVolumeSpecName: "home") pod "b3755283-ee3d-40ae-a7ee-625af6dc1b54" (UID: "b3755283-ee3d-40ae-a7ee-625af6dc1b54"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.196209 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.196181    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3755283-ee3d-40ae-a7ee-625af6dc1b54" (UID: "b3755283-ee3d-40ae-a7ee-625af6dc1b54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:32:04.196209 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.196195    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3755283-ee3d-40ae-a7ee-625af6dc1b54-kube-api-access-gsg94" (OuterVolumeSpecName: "kube-api-access-gsg94") pod "b3755283-ee3d-40ae-a7ee-625af6dc1b54" (UID: "b3755283-ee3d-40ae-a7ee-625af6dc1b54"). InnerVolumeSpecName "kube-api-access-gsg94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:32:04.196348 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.196260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-dshm" (OuterVolumeSpecName: "dshm") pod "b3755283-ee3d-40ae-a7ee-625af6dc1b54" (UID: "b3755283-ee3d-40ae-a7ee-625af6dc1b54"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:32:04.294842 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.294795    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-dshm\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.294842 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.294837    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-model-cache\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.295042 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.294905    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tmp-dir\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.295042 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.294918    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3755283-ee3d-40ae-a7ee-625af6dc1b54-tls-certs\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.295042 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.294930    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsg94\" (UniqueName: \"kubernetes.io/projected/b3755283-ee3d-40ae-a7ee-625af6dc1b54-kube-api-access-gsg94\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.295042 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.294942    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3755283-ee3d-40ae-a7ee-625af6dc1b54-home\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:32:04.502548 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.502508    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3755283-ee3d-40ae-a7ee-625af6dc1b54" containerID="704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc" exitCode=0
Jul 23 13:32:04.502711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.502563    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"
Jul 23 13:32:04.502711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.502581    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg" event={"ID":"b3755283-ee3d-40ae-a7ee-625af6dc1b54","Type":"ContainerDied","Data":"704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc"}
Jul 23 13:32:04.502711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.502637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg" event={"ID":"b3755283-ee3d-40ae-a7ee-625af6dc1b54","Type":"ContainerDied","Data":"045e851fe9f1f48bca270f262edc10f5a40de6fbf281aea2cf55e6ef642d36a5"}
Jul 23 13:32:04.502711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.502660    2564 scope.go:117] "RemoveContainer" containerID="704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc"
Jul 23 13:32:04.511687 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.511662    2564 scope.go:117] "RemoveContainer" containerID="704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc"
Jul 23 13:32:04.512027 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:32:04.512008    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc\": container with ID starting with 704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc not found: ID does not exist" containerID="704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc"
Jul 23 13:32:04.512110 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.512038    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc"} err="failed to get container status \"704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc\": rpc error: code = NotFound desc = could not find container \"704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc\": container with ID starting with 704027795e2842fa160579e533b10cc0b05a6008a08890c080e9594308361ccc not found: ID does not exist"
Jul 23 13:32:04.523444 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.523421    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"]
Jul 23 13:32:04.525974 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:04.525953    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-56651086-kserve-7cb85f84f5-nr8gg"]
Jul 23 13:32:05.770058 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:05.770027    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3755283-ee3d-40ae-a7ee-625af6dc1b54" path="/var/lib/kubelet/pods/b3755283-ee3d-40ae-a7ee-625af6dc1b54/volumes"
Jul 23 13:32:09.761669 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:09.761637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:32:09.764662 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:32:09.764637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:35:37.747722 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.747642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"]
Jul 23 13:35:37.750069 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.748015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3755283-ee3d-40ae-a7ee-625af6dc1b54" containerName="main"
Jul 23 13:35:37.750069 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.748027    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3755283-ee3d-40ae-a7ee-625af6dc1b54" containerName="main"
Jul 23 13:35:37.750069 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.748086    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3755283-ee3d-40ae-a7ee-625af6dc1b54" containerName="main"
Jul 23 13:35:37.750964 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.750946    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.753291 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.753267    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:35:37.753412 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.753267    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e153fac9-serving-cert\""
Jul 23 13:35:37.779566 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.779535    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"]
Jul 23 13:35:37.874968 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.874926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-openshift-service-ca\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.875168 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.875048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-maas-api-tls\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.875168 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.875129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzttf\" (UniqueName: \"kubernetes.io/projected/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-kube-api-access-vzttf\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.976047 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.976013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-maas-api-tls\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.976233 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.976068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzttf\" (UniqueName: \"kubernetes.io/projected/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-kube-api-access-vzttf\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.976233 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.976184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-openshift-service-ca\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.976818 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.976799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-openshift-service-ca\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.978398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.978375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-maas-api-tls\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:37.989033 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:37.989011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzttf\" (UniqueName: \"kubernetes.io/projected/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-kube-api-access-vzttf\") pod \"maas-api-e2e-ait-e153fac9-64647d747c-vwcst\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:38.062068 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:38.061986    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:38.202208 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:38.202177    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"]
Jul 23 13:35:38.205529 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:35:38.205504    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e877ea2_35e6_4d1b_8a7b_09086fb1a724.slice/crio-ad0966d571eb57544d70db0ec4ad28e7eb033622f6f98921c5d7ea8c5eff5741 WatchSource:0}: Error finding container ad0966d571eb57544d70db0ec4ad28e7eb033622f6f98921c5d7ea8c5eff5741: Status 404 returned error can't find the container with id ad0966d571eb57544d70db0ec4ad28e7eb033622f6f98921c5d7ea8c5eff5741
Jul 23 13:35:38.207574 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:38.207397    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:35:38.474569 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:38.474535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst" event={"ID":"8e877ea2-35e6-4d1b-8a7b-09086fb1a724","Type":"ContainerStarted","Data":"ad0966d571eb57544d70db0ec4ad28e7eb033622f6f98921c5d7ea8c5eff5741"}
Jul 23 13:35:39.480163 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:39.480126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst" event={"ID":"8e877ea2-35e6-4d1b-8a7b-09086fb1a724","Type":"ContainerStarted","Data":"c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523"}
Jul 23 13:35:39.480577 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:39.480202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:35:39.499342 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:39.499284    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst" podStartSLOduration=1.794715383 podStartE2EDuration="2.499265676s" totalImagesPullingTime="704.550293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:35:39.498932951 +0000 UTC m=+1710.236166263" watchObservedRunningTime="2026-07-23 13:35:39.499265676 +0000 UTC m=+1710.236498995"
Jul 23 13:35:45.490156 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:35:45.490124    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:36:14.107839 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.107797    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"]
Jul 23 13:36:14.108402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.108001    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst" podUID="8e877ea2-35e6-4d1b-8a7b-09086fb1a724" containerName="maas-api" containerID="cri-o://c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523" gracePeriod=30
Jul 23 13:36:14.358594 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.358530    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:36:14.480648 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.480605    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzttf\" (UniqueName: \"kubernetes.io/projected/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-kube-api-access-vzttf\") pod \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") "
Jul 23 13:36:14.480934 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.480668    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-openshift-service-ca\") pod \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") "
Jul 23 13:36:14.480934 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.480698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-maas-api-tls\") pod \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\" (UID: \"8e877ea2-35e6-4d1b-8a7b-09086fb1a724\") "
Jul 23 13:36:14.481110 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.481083    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e877ea2-35e6-4d1b-8a7b-09086fb1a724" (UID: "8e877ea2-35e6-4d1b-8a7b-09086fb1a724"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:36:14.482914 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.482880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-kube-api-access-vzttf" (OuterVolumeSpecName: "kube-api-access-vzttf") pod "8e877ea2-35e6-4d1b-8a7b-09086fb1a724" (UID: "8e877ea2-35e6-4d1b-8a7b-09086fb1a724"). InnerVolumeSpecName "kube-api-access-vzttf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:36:14.483023 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.482910    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e877ea2-35e6-4d1b-8a7b-09086fb1a724" (UID: "8e877ea2-35e6-4d1b-8a7b-09086fb1a724"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:36:14.582260 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.582221    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzttf\" (UniqueName: \"kubernetes.io/projected/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-kube-api-access-vzttf\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:36:14.582260 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.582252    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:36:14.582260 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.582266    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e877ea2-35e6-4d1b-8a7b-09086fb1a724-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:36:14.648019 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.647940    2564 generic.go:356] "Generic (PLEG): container finished" podID="8e877ea2-35e6-4d1b-8a7b-09086fb1a724" containerID="c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523" exitCode=0
Jul 23 13:36:14.648019 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.648002    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"
Jul 23 13:36:14.648178 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.648024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst" event={"ID":"8e877ea2-35e6-4d1b-8a7b-09086fb1a724","Type":"ContainerDied","Data":"c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523"}
Jul 23 13:36:14.648178 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.648103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst" event={"ID":"8e877ea2-35e6-4d1b-8a7b-09086fb1a724","Type":"ContainerDied","Data":"ad0966d571eb57544d70db0ec4ad28e7eb033622f6f98921c5d7ea8c5eff5741"}
Jul 23 13:36:14.648178 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.648125    2564 scope.go:117] "RemoveContainer" containerID="c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523"
Jul 23 13:36:14.657123 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.657104    2564 scope.go:117] "RemoveContainer" containerID="c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523"
Jul 23 13:36:14.657353 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:36:14.657333    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523\": container with ID starting with c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523 not found: ID does not exist" containerID="c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523"
Jul 23 13:36:14.657402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.657362    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523"} err="failed to get container status \"c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523\": rpc error: code = NotFound desc = could not find container \"c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523\": container with ID starting with c32e81d0d4cb5821286461c785bee1f6b5bfa165ced7d96c5131d766ca47d523 not found: ID does not exist"
Jul 23 13:36:14.675735 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.675710    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"]
Jul 23 13:36:14.679524 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:14.679505    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e153fac9-64647d747c-vwcst"]
Jul 23 13:36:15.769162 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:15.769130    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e877ea2-35e6-4d1b-8a7b-09086fb1a724" path="/var/lib/kubelet/pods/8e877ea2-35e6-4d1b-8a7b-09086fb1a724/volumes"
Jul 23 13:36:23.245162 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.245127    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"]
Jul 23 13:36:23.245570 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.245555    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e877ea2-35e6-4d1b-8a7b-09086fb1a724" containerName="maas-api"
Jul 23 13:36:23.245615 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.245573    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e877ea2-35e6-4d1b-8a7b-09086fb1a724" containerName="maas-api"
Jul 23 13:36:23.245677 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.245668    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e877ea2-35e6-4d1b-8a7b-09086fb1a724" containerName="maas-api"
Jul 23 13:36:23.250233 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.250206    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.257504 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.257481    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6915d69d-serving-cert\""
Jul 23 13:36:23.257637 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.257560    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:36:23.282733 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.282700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"]
Jul 23 13:36:23.355348 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.355313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5prt\" (UniqueName: \"kubernetes.io/projected/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-kube-api-access-r5prt\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.355348 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.355350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-maas-api-tls\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.355536 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.355369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-openshift-service-ca\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.456367 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.456339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5prt\" (UniqueName: \"kubernetes.io/projected/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-kube-api-access-r5prt\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.456554 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.456374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-maas-api-tls\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.456554 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.456393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-openshift-service-ca\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.457052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.457028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-openshift-service-ca\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.459008 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.458977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-maas-api-tls\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.466690 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.466666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5prt\" (UniqueName: \"kubernetes.io/projected/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-kube-api-access-r5prt\") pod \"maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.561186 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.561108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:23.709306 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:23.709169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"]
Jul 23 13:36:23.712150 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:36:23.712115    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44cf76a_8fa6_4802_90e5_5fb47d37ae2b.slice/crio-4b9b6d2b4821c315e4d77b163db9046911c7f1ea4c3d30cfdc7938a4c2da9594 WatchSource:0}: Error finding container 4b9b6d2b4821c315e4d77b163db9046911c7f1ea4c3d30cfdc7938a4c2da9594: Status 404 returned error can't find the container with id 4b9b6d2b4821c315e4d77b163db9046911c7f1ea4c3d30cfdc7938a4c2da9594
Jul 23 13:36:24.696841 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:24.696803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7" event={"ID":"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b","Type":"ContainerStarted","Data":"06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda"}
Jul 23 13:36:24.697243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:24.696876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7" event={"ID":"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b","Type":"ContainerStarted","Data":"4b9b6d2b4821c315e4d77b163db9046911c7f1ea4c3d30cfdc7938a4c2da9594"}
Jul 23 13:36:24.697243 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:24.696915    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:24.733639 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:24.733587    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7" podStartSLOduration=1.295011995 podStartE2EDuration="1.733572205s" totalImagesPullingTime="438.56021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:36:24.732920088 +0000 UTC m=+1755.470153411" watchObservedRunningTime="2026-07-23 13:36:24.733572205 +0000 UTC m=+1755.470805554"
Jul 23 13:36:30.707062 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:30.707030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:58.819224 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:58.819184    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"]
Jul 23 13:36:58.819636 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:58.819435    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7" podUID="d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" containerName="maas-api" containerID="cri-o://06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda" gracePeriod=30
Jul 23 13:36:59.064173 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.064147    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:59.182449 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.182423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5prt\" (UniqueName: \"kubernetes.io/projected/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-kube-api-access-r5prt\") pod \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") "
Jul 23 13:36:59.182449 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.182455    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-openshift-service-ca\") pod \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") "
Jul 23 13:36:59.182665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.182578    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-maas-api-tls\") pod \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\" (UID: \"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b\") "
Jul 23 13:36:59.182838 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.182816    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" (UID: "d44cf76a-8fa6-4802-90e5-5fb47d37ae2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:36:59.184561 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.184527    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-kube-api-access-r5prt" (OuterVolumeSpecName: "kube-api-access-r5prt") pod "d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" (UID: "d44cf76a-8fa6-4802-90e5-5fb47d37ae2b"). InnerVolumeSpecName "kube-api-access-r5prt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:36:59.184665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.184606    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" (UID: "d44cf76a-8fa6-4802-90e5-5fb47d37ae2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:36:59.283376 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.283343    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:36:59.283376 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.283370    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5prt\" (UniqueName: \"kubernetes.io/projected/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-kube-api-access-r5prt\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:36:59.283376 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.283380    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:36:59.853569 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.853535    2564 generic.go:356] "Generic (PLEG): container finished" podID="d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" containerID="06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda" exitCode=0
Jul 23 13:36:59.854002 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.853576    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"
Jul 23 13:36:59.854002 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.853582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7" event={"ID":"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b","Type":"ContainerDied","Data":"06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda"}
Jul 23 13:36:59.854002 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.853629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7" event={"ID":"d44cf76a-8fa6-4802-90e5-5fb47d37ae2b","Type":"ContainerDied","Data":"4b9b6d2b4821c315e4d77b163db9046911c7f1ea4c3d30cfdc7938a4c2da9594"}
Jul 23 13:36:59.854002 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.853653    2564 scope.go:117] "RemoveContainer" containerID="06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda"
Jul 23 13:36:59.861939 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.861919    2564 scope.go:117] "RemoveContainer" containerID="06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda"
Jul 23 13:36:59.862180 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:36:59.862161    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda\": container with ID starting with 06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda not found: ID does not exist" containerID="06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda"
Jul 23 13:36:59.862238 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.862189    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda"} err="failed to get container status \"06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda\": rpc error: code = NotFound desc = could not find container \"06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda\": container with ID starting with 06fa95b4f379f9f334c5a346841de2c4ea221725bbf90844d51c3a5b684c2cda not found: ID does not exist"
Jul 23 13:36:59.876742 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.876721    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"]
Jul 23 13:36:59.881880 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:36:59.881848    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6915d69d-5479957ff7-dqsd7"]
Jul 23 13:37:01.773051 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:01.770930    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" path="/var/lib/kubelet/pods/d44cf76a-8fa6-4802-90e5-5fb47d37ae2b/volumes"
Jul 23 13:37:07.330641 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.330553    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"]
Jul 23 13:37:07.331152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.331036    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" containerName="maas-api"
Jul 23 13:37:07.331152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.331052    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" containerName="maas-api"
Jul 23 13:37:07.331152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.331112    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d44cf76a-8fa6-4802-90e5-5fb47d37ae2b" containerName="maas-api"
Jul 23 13:37:07.335528 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.335506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.338968 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.338947    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:37:07.339237 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.339216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-94afaac2-serving-cert\""
Jul 23 13:37:07.352789 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.352762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"]
Jul 23 13:37:07.454147 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.454114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.454313 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.454160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5193b5e3-d755-4a56-b59f-c02091685165-openshift-service-ca\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.454313 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.454184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4hs\" (UniqueName: \"kubernetes.io/projected/5193b5e3-d755-4a56-b59f-c02091685165-kube-api-access-bh4hs\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.555579 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.555544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5193b5e3-d755-4a56-b59f-c02091685165-openshift-service-ca\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.555748 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.555595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4hs\" (UniqueName: \"kubernetes.io/projected/5193b5e3-d755-4a56-b59f-c02091685165-kube-api-access-bh4hs\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.555748 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.555702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.555836 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:37:07.555821    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-serving-cert: secret "maas-api-e2e-ait-94afaac2-serving-cert" not found
Jul 23 13:37:07.555936 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:37:07.555926    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls podName:5193b5e3-d755-4a56-b59f-c02091685165 nodeName:}" failed. No retries permitted until 2026-07-23 13:37:08.055903872 +0000 UTC m=+1798.793137173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls") pod "maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" (UID: "5193b5e3-d755-4a56-b59f-c02091685165") : secret "maas-api-e2e-ait-94afaac2-serving-cert" not found
Jul 23 13:37:07.556174 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.556155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5193b5e3-d755-4a56-b59f-c02091685165-openshift-service-ca\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:07.580315 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:07.580289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4hs\" (UniqueName: \"kubernetes.io/projected/5193b5e3-d755-4a56-b59f-c02091685165-kube-api-access-bh4hs\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:08.061058 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:08.061027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:08.063365 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:08.063339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls\") pod \"maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:08.248118 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:08.248039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:08.395380 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:08.395273    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"]
Jul 23 13:37:08.399255 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:37:08.399221    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5193b5e3_d755_4a56_b59f_c02091685165.slice/crio-5070976a40bdce4197cda42212d03a3fe8d1f18e8982ee372082df12dac669ae WatchSource:0}: Error finding container 5070976a40bdce4197cda42212d03a3fe8d1f18e8982ee372082df12dac669ae: Status 404 returned error can't find the container with id 5070976a40bdce4197cda42212d03a3fe8d1f18e8982ee372082df12dac669ae
Jul 23 13:37:08.896681 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:08.896625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" event={"ID":"5193b5e3-d755-4a56-b59f-c02091685165","Type":"ContainerStarted","Data":"5070976a40bdce4197cda42212d03a3fe8d1f18e8982ee372082df12dac669ae"}
Jul 23 13:37:09.794628 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:09.794605    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:37:09.797609 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:09.797586    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:37:09.903532 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:09.903499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" event={"ID":"5193b5e3-d755-4a56-b59f-c02091685165","Type":"ContainerStarted","Data":"8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa"}
Jul 23 13:37:09.903690 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:09.903674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:15.914580 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:15.914530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:15.947351 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:15.947303    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" podStartSLOduration=7.596365346 podStartE2EDuration="8.947288973s" totalImagesPullingTime="1.350923627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:37:09.93117629 +0000 UTC m=+1800.668409609" watchObservedRunningTime="2026-07-23 13:37:15.947288973 +0000 UTC m=+1806.684522292"
Jul 23 13:37:43.773741 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:43.773703    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"]
Jul 23 13:37:43.774279 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:43.773905    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" podUID="5193b5e3-d755-4a56-b59f-c02091685165" containerName="maas-api" containerID="cri-o://8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa" gracePeriod=30
Jul 23 13:37:44.024092 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.024032    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:44.063919 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.063885    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh4hs\" (UniqueName: \"kubernetes.io/projected/5193b5e3-d755-4a56-b59f-c02091685165-kube-api-access-bh4hs\") pod \"5193b5e3-d755-4a56-b59f-c02091685165\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") "
Jul 23 13:37:44.064065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.063945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5193b5e3-d755-4a56-b59f-c02091685165-openshift-service-ca\") pod \"5193b5e3-d755-4a56-b59f-c02091685165\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") "
Jul 23 13:37:44.064065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.063988    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls\") pod \"5193b5e3-d755-4a56-b59f-c02091685165\" (UID: \"5193b5e3-d755-4a56-b59f-c02091685165\") "
Jul 23 13:37:44.064290 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.064266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5193b5e3-d755-4a56-b59f-c02091685165-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5193b5e3-d755-4a56-b59f-c02091685165" (UID: "5193b5e3-d755-4a56-b59f-c02091685165"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:37:44.064819 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.064791    2564 generic.go:356] "Generic (PLEG): container finished" podID="5193b5e3-d755-4a56-b59f-c02091685165" containerID="8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa" exitCode=0
Jul 23 13:37:44.064950 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.064851    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"
Jul 23 13:37:44.064950 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.064900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" event={"ID":"5193b5e3-d755-4a56-b59f-c02091685165","Type":"ContainerDied","Data":"8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa"}
Jul 23 13:37:44.065031 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.064967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr" event={"ID":"5193b5e3-d755-4a56-b59f-c02091685165","Type":"ContainerDied","Data":"5070976a40bdce4197cda42212d03a3fe8d1f18e8982ee372082df12dac669ae"}
Jul 23 13:37:44.065031 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.065002    2564 scope.go:117] "RemoveContainer" containerID="8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa"
Jul 23 13:37:44.066242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.066218    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5193b5e3-d755-4a56-b59f-c02091685165" (UID: "5193b5e3-d755-4a56-b59f-c02091685165"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:37:44.066339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.066321    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5193b5e3-d755-4a56-b59f-c02091685165-kube-api-access-bh4hs" (OuterVolumeSpecName: "kube-api-access-bh4hs") pod "5193b5e3-d755-4a56-b59f-c02091685165" (UID: "5193b5e3-d755-4a56-b59f-c02091685165"). InnerVolumeSpecName "kube-api-access-bh4hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:37:44.083289 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.083270    2564 scope.go:117] "RemoveContainer" containerID="8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa"
Jul 23 13:37:44.083555 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:37:44.083539    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa\": container with ID starting with 8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa not found: ID does not exist" containerID="8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa"
Jul 23 13:37:44.083606 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.083563    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa"} err="failed to get container status \"8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa\": rpc error: code = NotFound desc = could not find container \"8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa\": container with ID starting with 8168d8053ff608fbf9d9d79754af161a983812030679a9e62fa4c158e14b4faa not found: ID does not exist"
Jul 23 13:37:44.165232 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.165196    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh4hs\" (UniqueName: \"kubernetes.io/projected/5193b5e3-d755-4a56-b59f-c02091685165-kube-api-access-bh4hs\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:37:44.165232 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.165227    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5193b5e3-d755-4a56-b59f-c02091685165-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:37:44.165232 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.165238    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5193b5e3-d755-4a56-b59f-c02091685165-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:37:44.389961 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.389931    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"]
Jul 23 13:37:44.393265 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:44.393239    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-94afaac2-766d4d69dc-cg5hr"]
Jul 23 13:37:45.769913 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:45.769879    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5193b5e3-d755-4a56-b59f-c02091685165" path="/var/lib/kubelet/pods/5193b5e3-d755-4a56-b59f-c02091685165/volumes"
Jul 23 13:37:52.483295 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.483257    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"]
Jul 23 13:37:52.483903 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.483880    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5193b5e3-d755-4a56-b59f-c02091685165" containerName="maas-api"
Jul 23 13:37:52.483992 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.483906    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5193b5e3-d755-4a56-b59f-c02091685165" containerName="maas-api"
Jul 23 13:37:52.484048 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.484031    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5193b5e3-d755-4a56-b59f-c02091685165" containerName="maas-api"
Jul 23 13:37:52.488697 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.488670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.490942 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.490914    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d97728e3-serving-cert\""
Jul 23 13:37:52.490942 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.490929    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:37:52.497169 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.497123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"]
Jul 23 13:37:52.539853 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.539812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de63ec-a696-4720-8690-1400983b067e-maas-api-tls\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.540034 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.539882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de63ec-a696-4720-8690-1400983b067e-openshift-service-ca\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.540034 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.539908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hnq\" (UniqueName: \"kubernetes.io/projected/b0de63ec-a696-4720-8690-1400983b067e-kube-api-access-g2hnq\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.641234 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.641193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de63ec-a696-4720-8690-1400983b067e-maas-api-tls\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.641409 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.641249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de63ec-a696-4720-8690-1400983b067e-openshift-service-ca\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.641409 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.641268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hnq\" (UniqueName: \"kubernetes.io/projected/b0de63ec-a696-4720-8690-1400983b067e-kube-api-access-g2hnq\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.642022 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.641993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de63ec-a696-4720-8690-1400983b067e-openshift-service-ca\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.643729 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.643703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de63ec-a696-4720-8690-1400983b067e-maas-api-tls\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.682324 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.682292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hnq\" (UniqueName: \"kubernetes.io/projected/b0de63ec-a696-4720-8690-1400983b067e-kube-api-access-g2hnq\") pod \"maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.802957 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.802839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:37:52.940871 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:52.940775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"]
Jul 23 13:37:52.943739 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:37:52.943713    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0de63ec_a696_4720_8690_1400983b067e.slice/crio-73be6bb33c6e6df83545e160212b6d09975e2bc42438a1ced61a2a5db9ba98ef WatchSource:0}: Error finding container 73be6bb33c6e6df83545e160212b6d09975e2bc42438a1ced61a2a5db9ba98ef: Status 404 returned error can't find the container with id 73be6bb33c6e6df83545e160212b6d09975e2bc42438a1ced61a2a5db9ba98ef
Jul 23 13:37:53.106210 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:53.106130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5" event={"ID":"b0de63ec-a696-4720-8690-1400983b067e","Type":"ContainerStarted","Data":"73be6bb33c6e6df83545e160212b6d09975e2bc42438a1ced61a2a5db9ba98ef"}
Jul 23 13:37:54.112396 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:54.112359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5" event={"ID":"b0de63ec-a696-4720-8690-1400983b067e","Type":"ContainerStarted","Data":"926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777"}
Jul 23 13:37:54.112801 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:37:54.112537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:38:00.123213 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:00.123184    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:38:00.143039 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:00.142991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5" podStartSLOduration=7.659360039 podStartE2EDuration="8.142973521s" totalImagesPullingTime="483.613482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:37:54.137839484 +0000 UTC m=+1844.875072804" watchObservedRunningTime="2026-07-23 13:38:00.142973521 +0000 UTC m=+1850.880206843"
Jul 23 13:38:27.951962 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:27.951926    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"]
Jul 23 13:38:27.952515 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:27.952164    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5" podUID="b0de63ec-a696-4720-8690-1400983b067e" containerName="maas-api" containerID="cri-o://926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777" gracePeriod=30
Jul 23 13:38:28.206945 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.206886    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:38:28.271874 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.271824    2564 generic.go:356] "Generic (PLEG): container finished" podID="b0de63ec-a696-4720-8690-1400983b067e" containerID="926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777" exitCode=0
Jul 23 13:38:28.272028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.271890    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"
Jul 23 13:38:28.272028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.271893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5" event={"ID":"b0de63ec-a696-4720-8690-1400983b067e","Type":"ContainerDied","Data":"926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777"}
Jul 23 13:38:28.272028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.271943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5" event={"ID":"b0de63ec-a696-4720-8690-1400983b067e","Type":"ContainerDied","Data":"73be6bb33c6e6df83545e160212b6d09975e2bc42438a1ced61a2a5db9ba98ef"}
Jul 23 13:38:28.272028 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.271977    2564 scope.go:117] "RemoveContainer" containerID="926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777"
Jul 23 13:38:28.280179 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.280163    2564 scope.go:117] "RemoveContainer" containerID="926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777"
Jul 23 13:38:28.280441 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:38:28.280419    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777\": container with ID starting with 926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777 not found: ID does not exist" containerID="926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777"
Jul 23 13:38:28.280530 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.280446    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777"} err="failed to get container status \"926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777\": rpc error: code = NotFound desc = could not find container \"926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777\": container with ID starting with 926d012f323d85551abb540c3643d8074c03ffebb5b79b1fd1f2e7fb355d5777 not found: ID does not exist"
Jul 23 13:38:28.355004 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.354973    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2hnq\" (UniqueName: \"kubernetes.io/projected/b0de63ec-a696-4720-8690-1400983b067e-kube-api-access-g2hnq\") pod \"b0de63ec-a696-4720-8690-1400983b067e\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") "
Jul 23 13:38:28.355165 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.355076    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de63ec-a696-4720-8690-1400983b067e-maas-api-tls\") pod \"b0de63ec-a696-4720-8690-1400983b067e\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") "
Jul 23 13:38:28.355165 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.355101    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de63ec-a696-4720-8690-1400983b067e-openshift-service-ca\") pod \"b0de63ec-a696-4720-8690-1400983b067e\" (UID: \"b0de63ec-a696-4720-8690-1400983b067e\") "
Jul 23 13:38:28.355478 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.355450    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0de63ec-a696-4720-8690-1400983b067e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0de63ec-a696-4720-8690-1400983b067e" (UID: "b0de63ec-a696-4720-8690-1400983b067e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:38:28.357033 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.357011    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0de63ec-a696-4720-8690-1400983b067e-kube-api-access-g2hnq" (OuterVolumeSpecName: "kube-api-access-g2hnq") pod "b0de63ec-a696-4720-8690-1400983b067e" (UID: "b0de63ec-a696-4720-8690-1400983b067e"). InnerVolumeSpecName "kube-api-access-g2hnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:38:28.357135 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.357114    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0de63ec-a696-4720-8690-1400983b067e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0de63ec-a696-4720-8690-1400983b067e" (UID: "b0de63ec-a696-4720-8690-1400983b067e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:38:28.455764 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.455734    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de63ec-a696-4720-8690-1400983b067e-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:38:28.455764 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.455760    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de63ec-a696-4720-8690-1400983b067e-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:38:28.455764 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.455772    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2hnq\" (UniqueName: \"kubernetes.io/projected/b0de63ec-a696-4720-8690-1400983b067e-kube-api-access-g2hnq\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:38:28.592968 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.592938    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"]
Jul 23 13:38:28.599017 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:28.598991    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d97728e3-856fcbb7f6-htgz5"]
Jul 23 13:38:29.770335 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:38:29.770302    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0de63ec-a696-4720-8690-1400983b067e" path="/var/lib/kubelet/pods/b0de63ec-a696-4720-8690-1400983b067e/volumes"
Jul 23 13:40:22.062349 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.062272    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"]
Jul 23 13:40:22.062813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.062676    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0de63ec-a696-4720-8690-1400983b067e" containerName="maas-api"
Jul 23 13:40:22.062813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.062690    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0de63ec-a696-4720-8690-1400983b067e" containerName="maas-api"
Jul 23 13:40:22.062813 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.062773    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0de63ec-a696-4720-8690-1400983b067e" containerName="maas-api"
Jul 23 13:40:22.066157 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.066138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.069537 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.069516    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:40:22.069661 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.069569    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-85d6e18b-serving-cert\""
Jul 23 13:40:22.079290 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.079263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"]
Jul 23 13:40:22.133063 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.133033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n57c\" (UniqueName: \"kubernetes.io/projected/2514b5df-52a0-48e7-aa68-9177a77536cd-kube-api-access-2n57c\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.133229 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.133080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2514b5df-52a0-48e7-aa68-9177a77536cd-openshift-service-ca\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.133229 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.133196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2514b5df-52a0-48e7-aa68-9177a77536cd-maas-api-tls\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.233757 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.233719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n57c\" (UniqueName: \"kubernetes.io/projected/2514b5df-52a0-48e7-aa68-9177a77536cd-kube-api-access-2n57c\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.233988 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.233771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2514b5df-52a0-48e7-aa68-9177a77536cd-openshift-service-ca\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.233988 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.233822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2514b5df-52a0-48e7-aa68-9177a77536cd-maas-api-tls\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.234416 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.234393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2514b5df-52a0-48e7-aa68-9177a77536cd-openshift-service-ca\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.236403 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.236376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2514b5df-52a0-48e7-aa68-9177a77536cd-maas-api-tls\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.242509 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.242486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n57c\" (UniqueName: \"kubernetes.io/projected/2514b5df-52a0-48e7-aa68-9177a77536cd-kube-api-access-2n57c\") pod \"maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.376857 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.376773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:22.530520 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.530487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"]
Jul 23 13:40:22.532885 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:40:22.532836    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2514b5df_52a0_48e7_aa68_9177a77536cd.slice/crio-4b3d6d3acd739f95e8106175ecaad54bfb0275b004ed57f04aa40b75ef83a124 WatchSource:0}: Error finding container 4b3d6d3acd739f95e8106175ecaad54bfb0275b004ed57f04aa40b75ef83a124: Status 404 returned error can't find the container with id 4b3d6d3acd739f95e8106175ecaad54bfb0275b004ed57f04aa40b75ef83a124
Jul 23 13:40:22.798955 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:22.798920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w" event={"ID":"2514b5df-52a0-48e7-aa68-9177a77536cd","Type":"ContainerStarted","Data":"4b3d6d3acd739f95e8106175ecaad54bfb0275b004ed57f04aa40b75ef83a124"}
Jul 23 13:40:23.805650 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:23.805609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w" event={"ID":"2514b5df-52a0-48e7-aa68-9177a77536cd","Type":"ContainerStarted","Data":"69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04"}
Jul 23 13:40:23.806032 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:23.805772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:23.823627 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:23.823584    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w" podStartSLOduration=1.4224679820000001 podStartE2EDuration="1.823570076s" totalImagesPullingTime="401.102094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:40:23.821898945 +0000 UTC m=+1994.559132266" watchObservedRunningTime="2026-07-23 13:40:23.823570076 +0000 UTC m=+1994.560803395"
Jul 23 13:40:29.815769 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:29.815739    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:44.165667 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.165630    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"]
Jul 23 13:40:44.168204 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.165900    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w" podUID="2514b5df-52a0-48e7-aa68-9177a77536cd" containerName="maas-api" containerID="cri-o://69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04" gracePeriod=30
Jul 23 13:40:44.417461 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.417399    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:44.525133 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.525095    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n57c\" (UniqueName: \"kubernetes.io/projected/2514b5df-52a0-48e7-aa68-9177a77536cd-kube-api-access-2n57c\") pod \"2514b5df-52a0-48e7-aa68-9177a77536cd\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") "
Jul 23 13:40:44.525316 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.525199    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2514b5df-52a0-48e7-aa68-9177a77536cd-maas-api-tls\") pod \"2514b5df-52a0-48e7-aa68-9177a77536cd\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") "
Jul 23 13:40:44.525316 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.525252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2514b5df-52a0-48e7-aa68-9177a77536cd-openshift-service-ca\") pod \"2514b5df-52a0-48e7-aa68-9177a77536cd\" (UID: \"2514b5df-52a0-48e7-aa68-9177a77536cd\") "
Jul 23 13:40:44.525656 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.525628    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2514b5df-52a0-48e7-aa68-9177a77536cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2514b5df-52a0-48e7-aa68-9177a77536cd" (UID: "2514b5df-52a0-48e7-aa68-9177a77536cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:40:44.527181 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.527155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2514b5df-52a0-48e7-aa68-9177a77536cd-kube-api-access-2n57c" (OuterVolumeSpecName: "kube-api-access-2n57c") pod "2514b5df-52a0-48e7-aa68-9177a77536cd" (UID: "2514b5df-52a0-48e7-aa68-9177a77536cd"). InnerVolumeSpecName "kube-api-access-2n57c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:40:44.527291 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.527250    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2514b5df-52a0-48e7-aa68-9177a77536cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2514b5df-52a0-48e7-aa68-9177a77536cd" (UID: "2514b5df-52a0-48e7-aa68-9177a77536cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:40:44.626339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.626304    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2514b5df-52a0-48e7-aa68-9177a77536cd-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:40:44.626339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.626333    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n57c\" (UniqueName: \"kubernetes.io/projected/2514b5df-52a0-48e7-aa68-9177a77536cd-kube-api-access-2n57c\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:40:44.626339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.626342    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2514b5df-52a0-48e7-aa68-9177a77536cd-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:40:44.901417 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.901338    2564 generic.go:356] "Generic (PLEG): container finished" podID="2514b5df-52a0-48e7-aa68-9177a77536cd" containerID="69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04" exitCode=0
Jul 23 13:40:44.901417 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.901383    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"
Jul 23 13:40:44.901587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.901423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w" event={"ID":"2514b5df-52a0-48e7-aa68-9177a77536cd","Type":"ContainerDied","Data":"69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04"}
Jul 23 13:40:44.901587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.901476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w" event={"ID":"2514b5df-52a0-48e7-aa68-9177a77536cd","Type":"ContainerDied","Data":"4b3d6d3acd739f95e8106175ecaad54bfb0275b004ed57f04aa40b75ef83a124"}
Jul 23 13:40:44.901587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.901499    2564 scope.go:117] "RemoveContainer" containerID="69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04"
Jul 23 13:40:44.910605 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.910591    2564 scope.go:117] "RemoveContainer" containerID="69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04"
Jul 23 13:40:44.910822 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:40:44.910806    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04\": container with ID starting with 69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04 not found: ID does not exist" containerID="69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04"
Jul 23 13:40:44.910889 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.910828    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04"} err="failed to get container status \"69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04\": rpc error: code = NotFound desc = could not find container \"69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04\": container with ID starting with 69df02707f316f4edfab1ae936eb74ce7bddef9092d998810e630b5455662b04 not found: ID does not exist"
Jul 23 13:40:44.923396 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.923372    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"]
Jul 23 13:40:44.929568 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:44.929548    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-85d6e18b-69d8c8c884-fj68w"]
Jul 23 13:40:45.769358 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:40:45.769325    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2514b5df-52a0-48e7-aa68-9177a77536cd" path="/var/lib/kubelet/pods/2514b5df-52a0-48e7-aa68-9177a77536cd/volumes"
Jul 23 13:41:18.315628 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.315594    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"]
Jul 23 13:41:18.316136 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.315988    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2514b5df-52a0-48e7-aa68-9177a77536cd" containerName="maas-api"
Jul 23 13:41:18.316136 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.316001    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2514b5df-52a0-48e7-aa68-9177a77536cd" containerName="maas-api"
Jul 23 13:41:18.316136 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.316068    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2514b5df-52a0-48e7-aa68-9177a77536cd" containerName="maas-api"
Jul 23 13:41:18.319144 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.319126    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.321358 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.321339    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-da798329-serving-cert\""
Jul 23 13:41:18.321465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.321340    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:41:18.333196 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.333172    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"]
Jul 23 13:41:18.404788 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.404748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jjf4\" (UniqueName: \"kubernetes.io/projected/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-kube-api-access-8jjf4\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.404991 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.404811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.404991 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.404906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-openshift-service-ca\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.505280 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.505245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.505466 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.505301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-openshift-service-ca\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.505466 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.505341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jjf4\" (UniqueName: \"kubernetes.io/projected/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-kube-api-access-8jjf4\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.505466 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:41:18.505383    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-da798329-serving-cert: secret "maas-api-e2e-mt-da798329-serving-cert" not found
Jul 23 13:41:18.505466 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:41:18.505466    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls podName:48dc81e6-e1f1-4e10-ad06-68d4439fa9e9 nodeName:}" failed. No retries permitted until 2026-07-23 13:41:19.005448943 +0000 UTC m=+2049.742682243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls") pod "maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" (UID: "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9") : secret "maas-api-e2e-mt-da798329-serving-cert" not found
Jul 23 13:41:18.505933 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.505915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-openshift-service-ca\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:18.517006 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:18.516986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jjf4\" (UniqueName: \"kubernetes.io/projected/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-kube-api-access-8jjf4\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:19.009402 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:19.009366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:19.011766 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:19.011742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls\") pod \"maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:19.229746 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:19.229703    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:19.574194 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:19.574168    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"]
Jul 23 13:41:19.577566 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:41:19.577522    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dc81e6_e1f1_4e10_ad06_68d4439fa9e9.slice/crio-07efb090b50554418e8a7685b689bc8c106ce16efd91cf08c19231b20a335c3a WatchSource:0}: Error finding container 07efb090b50554418e8a7685b689bc8c106ce16efd91cf08c19231b20a335c3a: Status 404 returned error can't find the container with id 07efb090b50554418e8a7685b689bc8c106ce16efd91cf08c19231b20a335c3a
Jul 23 13:41:19.579278 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:19.579259    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:41:20.059688 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:20.059650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" event={"ID":"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9","Type":"ContainerStarted","Data":"07efb090b50554418e8a7685b689bc8c106ce16efd91cf08c19231b20a335c3a"}
Jul 23 13:41:23.074391 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:23.074354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" event={"ID":"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9","Type":"ContainerStarted","Data":"62a9eddfcf8f42f472c9edeb0c64c9307aeea9279969d2e6f659288e94e95083"}
Jul 23 13:41:23.074772 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:23.074430    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:41:23.094602 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:23.094558    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" podStartSLOduration=2.159805032 podStartE2EDuration="5.094545241s" totalImagesPullingTime="2.934740209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:41:23.093282958 +0000 UTC m=+2053.830516277" watchObservedRunningTime="2026-07-23 13:41:23.094545241 +0000 UTC m=+2053.831778560"
Jul 23 13:41:29.085756 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:41:29.085683    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:42:09.821556 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:09.821527    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:42:09.826515 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:09.826491    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:42:22.105834 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.105792    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"]
Jul 23 13:42:22.106405 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.106056    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" podUID="48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" containerName="maas-api" containerID="cri-o://62a9eddfcf8f42f472c9edeb0c64c9307aeea9279969d2e6f659288e94e95083" gracePeriod=30
Jul 23 13:42:22.344768 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.344736    2564 generic.go:356] "Generic (PLEG): container finished" podID="48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" containerID="62a9eddfcf8f42f472c9edeb0c64c9307aeea9279969d2e6f659288e94e95083" exitCode=0
Jul 23 13:42:22.344894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.344806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" event={"ID":"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9","Type":"ContainerDied","Data":"62a9eddfcf8f42f472c9edeb0c64c9307aeea9279969d2e6f659288e94e95083"}
Jul 23 13:42:22.344894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.344873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n" event={"ID":"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9","Type":"ContainerDied","Data":"07efb090b50554418e8a7685b689bc8c106ce16efd91cf08c19231b20a335c3a"}
Jul 23 13:42:22.344974 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.344894    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07efb090b50554418e8a7685b689bc8c106ce16efd91cf08c19231b20a335c3a"
Jul 23 13:42:22.351067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.351047    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:42:22.437313 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.437287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jjf4\" (UniqueName: \"kubernetes.io/projected/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-kube-api-access-8jjf4\") pod \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") "
Jul 23 13:42:22.437473 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.437362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls\") pod \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") "
Jul 23 13:42:22.437473 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.437418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-openshift-service-ca\") pod \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\" (UID: \"48dc81e6-e1f1-4e10-ad06-68d4439fa9e9\") "
Jul 23 13:42:22.437793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.437766    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" (UID: "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:42:22.439325 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.439299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-kube-api-access-8jjf4" (OuterVolumeSpecName: "kube-api-access-8jjf4") pod "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" (UID: "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9"). InnerVolumeSpecName "kube-api-access-8jjf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:42:22.439416 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.439300    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" (UID: "48dc81e6-e1f1-4e10-ad06-68d4439fa9e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:42:22.538747 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.538717    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:42:22.538747 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.538744    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jjf4\" (UniqueName: \"kubernetes.io/projected/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-kube-api-access-8jjf4\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:42:22.538747 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:22.538754    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:42:23.349321 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:23.349289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"
Jul 23 13:42:23.370417 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:23.370394    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"]
Jul 23 13:42:23.375337 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:23.375317    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-da798329-6c67b64cf4-qdq4n"]
Jul 23 13:42:23.770198 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:42:23.770162    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" path="/var/lib/kubelet/pods/48dc81e6-e1f1-4e10-ad06-68d4439fa9e9/volumes"
Jul 23 13:44:18.314761 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.314729    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"]
Jul 23 13:44:18.315258 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.315149    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" containerName="maas-api"
Jul 23 13:44:18.315258 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.315162    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" containerName="maas-api"
Jul 23 13:44:18.315258 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.315231    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dc81e6-e1f1-4e10-ad06-68d4439fa9e9" containerName="maas-api"
Jul 23 13:44:18.318307 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.318281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.321152 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.321133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-98925a-serving-cert\""
Jul 23 13:44:18.321278 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.321165    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:44:18.335414 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.335378    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"]
Jul 23 13:44:18.438598 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.438554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91136c4d-1fb2-49a5-990b-84a53c1a0fda-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.438773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.438650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd8qh\" (UniqueName: \"kubernetes.io/projected/91136c4d-1fb2-49a5-990b-84a53c1a0fda-kube-api-access-rd8qh\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.438773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.438717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91136c4d-1fb2-49a5-990b-84a53c1a0fda-maas-api-tls\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.540093 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.540064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91136c4d-1fb2-49a5-990b-84a53c1a0fda-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.540276 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.540106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd8qh\" (UniqueName: \"kubernetes.io/projected/91136c4d-1fb2-49a5-990b-84a53c1a0fda-kube-api-access-rd8qh\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.540276 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.540145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91136c4d-1fb2-49a5-990b-84a53c1a0fda-maas-api-tls\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.540720 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.540697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91136c4d-1fb2-49a5-990b-84a53c1a0fda-openshift-service-ca\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.542528 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.542507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91136c4d-1fb2-49a5-990b-84a53c1a0fda-maas-api-tls\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.569029 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.568972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd8qh\" (UniqueName: \"kubernetes.io/projected/91136c4d-1fb2-49a5-990b-84a53c1a0fda-kube-api-access-rd8qh\") pod \"maas-api-e2e-inf-a-98925a-675cb85667-smcj9\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.629641 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.629605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:18.794061 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.794034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"]
Jul 23 13:44:18.796832 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:44:18.796806    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91136c4d_1fb2_49a5_990b_84a53c1a0fda.slice/crio-0339425ab5a5f28f82cf879c2de1c380c41257e079cd242c76e296140dac20d6 WatchSource:0}: Error finding container 0339425ab5a5f28f82cf879c2de1c380c41257e079cd242c76e296140dac20d6: Status 404 returned error can't find the container with id 0339425ab5a5f28f82cf879c2de1c380c41257e079cd242c76e296140dac20d6
Jul 23 13:44:18.888985 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:18.888904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9" event={"ID":"91136c4d-1fb2-49a5-990b-84a53c1a0fda","Type":"ContainerStarted","Data":"0339425ab5a5f28f82cf879c2de1c380c41257e079cd242c76e296140dac20d6"}
Jul 23 13:44:19.896180 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:19.896144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9" event={"ID":"91136c4d-1fb2-49a5-990b-84a53c1a0fda","Type":"ContainerStarted","Data":"4e7d52457b2917b13ab69e8c4fce590e87ee113d70c78761410adad2642f047b"}
Jul 23 13:44:19.896583 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:19.896206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:19.919266 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:19.919209    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9" podStartSLOduration=1.480102633 podStartE2EDuration="1.919193071s" totalImagesPullingTime="439.090438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:44:19.918166077 +0000 UTC m=+2230.655399396" watchObservedRunningTime="2026-07-23 13:44:19.919193071 +0000 UTC m=+2230.656426390"
Jul 23 13:44:25.906924 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:25.906894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:44:26.423440 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.423408    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"]
Jul 23 13:44:26.427142 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.427124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.432140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.432120    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-38ab5f-serving-cert\""
Jul 23 13:44:26.456246 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.456194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"]
Jul 23 13:44:26.510308 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.510282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b666e55-dd30-40e2-adcb-280bb8399e02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.510308 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.510311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnwzv\" (UniqueName: \"kubernetes.io/projected/7b666e55-dd30-40e2-adcb-280bb8399e02-kube-api-access-vnwzv\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.510513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.510354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.611894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.611843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b666e55-dd30-40e2-adcb-280bb8399e02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.611894 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.611895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnwzv\" (UniqueName: \"kubernetes.io/projected/7b666e55-dd30-40e2-adcb-280bb8399e02-kube-api-access-vnwzv\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.612092 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.611951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.612092 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:44:26.612068    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-serving-cert: secret "maas-api-e2e-inf-b-38ab5f-serving-cert" not found
Jul 23 13:44:26.612159 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:44:26.612133    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls podName:7b666e55-dd30-40e2-adcb-280bb8399e02 nodeName:}" failed. No retries permitted until 2026-07-23 13:44:27.112113362 +0000 UTC m=+2237.849346661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls") pod "maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" (UID: "7b666e55-dd30-40e2-adcb-280bb8399e02") : secret "maas-api-e2e-inf-b-38ab5f-serving-cert" not found
Jul 23 13:44:26.612514 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.612494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b666e55-dd30-40e2-adcb-280bb8399e02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:26.625873 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:26.625842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnwzv\" (UniqueName: \"kubernetes.io/projected/7b666e55-dd30-40e2-adcb-280bb8399e02-kube-api-access-vnwzv\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:27.117238 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.117199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:27.119683 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.119658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls\") pod \"maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:27.338358 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.338326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:27.478838 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.478807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"]
Jul 23 13:44:27.481849 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:44:27.481823    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b666e55_dd30_40e2_adcb_280bb8399e02.slice/crio-8fdeeb93c1b82b64678e04afffb021fc048fc909542c4cc7c707d414d7946d9c WatchSource:0}: Error finding container 8fdeeb93c1b82b64678e04afffb021fc048fc909542c4cc7c707d414d7946d9c: Status 404 returned error can't find the container with id 8fdeeb93c1b82b64678e04afffb021fc048fc909542c4cc7c707d414d7946d9c
Jul 23 13:44:27.936725 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.936691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" event={"ID":"7b666e55-dd30-40e2-adcb-280bb8399e02","Type":"ContainerStarted","Data":"196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34"}
Jul 23 13:44:27.936926 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.936742    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" event={"ID":"7b666e55-dd30-40e2-adcb-280bb8399e02","Type":"ContainerStarted","Data":"8fdeeb93c1b82b64678e04afffb021fc048fc909542c4cc7c707d414d7946d9c"}
Jul 23 13:44:27.936926 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.936820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:44:27.958498 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:27.958450    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" podStartSLOduration=1.625848107 podStartE2EDuration="1.958435671s" totalImagesPullingTime="332.587564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:44:27.957100204 +0000 UTC m=+2238.694333523" watchObservedRunningTime="2026-07-23 13:44:27.958435671 +0000 UTC m=+2238.695668990"
Jul 23 13:44:33.947183 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:44:33.947109    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:45:00.139622 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.139590    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"]
Jul 23 13:45:00.148365 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.148337    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"]
Jul 23 13:45:00.148519 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.148415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"
Jul 23 13:45:00.152079 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.152056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"]
Jul 23 13:45:00.152213 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.152143    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"
Jul 23 13:45:00.153008 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.152989    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:45:00.157682 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.157658    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"]
Jul 23 13:45:00.164087 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.164069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"
Jul 23 13:45:00.172937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.172919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"
Jul 23 13:45:00.314725 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.314689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"]
Jul 23 13:45:00.318193 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:45:00.318161    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145761c5_5923_47cb_b0a4_936ca01cbca0.slice/crio-15d80eaf3b0c0c46372d17cefe36b62e2e3c29abe8afaf5d4df190c3285a78fa WatchSource:0}: Error finding container 15d80eaf3b0c0c46372d17cefe36b62e2e3c29abe8afaf5d4df190c3285a78fa: Status 404 returned error can't find the container with id 15d80eaf3b0c0c46372d17cefe36b62e2e3c29abe8afaf5d4df190c3285a78fa
Jul 23 13:45:00.345460 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:00.345438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"]
Jul 23 13:45:00.347506 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:45:00.347478    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b636e20_c94d_44c2_8c43_2edf977ba89a.slice/crio-4743cccdebfbceae0cf43e5c60460410701da5c040f05ad39646cd4cdbe577a7 WatchSource:0}: Error finding container 4743cccdebfbceae0cf43e5c60460410701da5c040f05ad39646cd4cdbe577a7: Status 404 returned error can't find the container with id 4743cccdebfbceae0cf43e5c60460410701da5c040f05ad39646cd4cdbe577a7
Jul 23 13:45:01.088711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:01.088675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779" event={"ID":"2b636e20-c94d-44c2-8c43-2edf977ba89a","Type":"ContainerStarted","Data":"4743cccdebfbceae0cf43e5c60460410701da5c040f05ad39646cd4cdbe577a7"}
Jul 23 13:45:01.089785 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:01.089764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm" event={"ID":"145761c5-5923-47cb-b0a4-936ca01cbca0","Type":"ContainerStarted","Data":"15d80eaf3b0c0c46372d17cefe36b62e2e3c29abe8afaf5d4df190c3285a78fa"}
Jul 23 13:45:03.102576 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:03.102536    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779" event={"ID":"2b636e20-c94d-44c2-8c43-2edf977ba89a","Type":"ContainerStarted","Data":"2bcb57ec240e811b4078ec0a0fda2f35e0a1ef2285f08e0a94cc3f6f9666942d"}
Jul 23 13:45:03.103919 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:03.103889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm" event={"ID":"145761c5-5923-47cb-b0a4-936ca01cbca0","Type":"ContainerStarted","Data":"5d4ff610d154996d13caff83958620fd726c7135efdd8b0065229d8fc1253c02"}
Jul 23 13:45:03.119842 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:03.119800    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779" podStartSLOduration=0.874311457 podStartE2EDuration="3.119786043s" totalImagesPullingTime="2.245474586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:03.118414957 +0000 UTC m=+2273.855648292" watchObservedRunningTime="2026-07-23 13:45:03.119786043 +0000 UTC m=+2273.857019361"
Jul 23 13:45:03.133460 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:03.133421    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm" podStartSLOduration=0.863923834 podStartE2EDuration="3.133409333s" totalImagesPullingTime="2.269485499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:03.132557929 +0000 UTC m=+2273.869791249" watchObservedRunningTime="2026-07-23 13:45:03.133409333 +0000 UTC m=+2273.870642703"
Jul 23 13:45:04.110213 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:04.110119    2564 generic.go:356] "Generic (PLEG): container finished" podID="2b636e20-c94d-44c2-8c43-2edf977ba89a" containerID="2bcb57ec240e811b4078ec0a0fda2f35e0a1ef2285f08e0a94cc3f6f9666942d" exitCode=0
Jul 23 13:45:04.110624 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:04.110215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779" event={"ID":"2b636e20-c94d-44c2-8c43-2edf977ba89a","Type":"ContainerDied","Data":"2bcb57ec240e811b4078ec0a0fda2f35e0a1ef2285f08e0a94cc3f6f9666942d"}
Jul 23 13:45:04.111793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:04.111770    2564 generic.go:356] "Generic (PLEG): container finished" podID="145761c5-5923-47cb-b0a4-936ca01cbca0" containerID="5d4ff610d154996d13caff83958620fd726c7135efdd8b0065229d8fc1253c02" exitCode=0
Jul 23 13:45:04.111939 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:04.111838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm" event={"ID":"145761c5-5923-47cb-b0a4-936ca01cbca0","Type":"ContainerDied","Data":"5d4ff610d154996d13caff83958620fd726c7135efdd8b0065229d8fc1253c02"}
Jul 23 13:45:05.276064 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:05.276044    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"
Jul 23 13:45:05.293924 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:05.293903    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"
Jul 23 13:45:06.123810 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:06.123732    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"
Jul 23 13:45:06.123810 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:06.123762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm" event={"ID":"145761c5-5923-47cb-b0a4-936ca01cbca0","Type":"ContainerDied","Data":"15d80eaf3b0c0c46372d17cefe36b62e2e3c29abe8afaf5d4df190c3285a78fa"}
Jul 23 13:45:06.124046 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:06.123813    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15d80eaf3b0c0c46372d17cefe36b62e2e3c29abe8afaf5d4df190c3285a78fa"
Jul 23 13:45:06.125408 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:06.125383    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779"
Jul 23 13:45:06.125408 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:06.125396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-nz779" event={"ID":"2b636e20-c94d-44c2-8c43-2edf977ba89a","Type":"ContainerDied","Data":"4743cccdebfbceae0cf43e5c60460410701da5c040f05ad39646cd4cdbe577a7"}
Jul 23 13:45:06.125596 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:45:06.125435    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4743cccdebfbceae0cf43e5c60460410701da5c040f05ad39646cd4cdbe577a7"
Jul 23 13:46:01.869616 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.869573    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"]
Jul 23 13:46:01.871843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.870142    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b636e20-c94d-44c2-8c43-2edf977ba89a" containerName="cleanup"
Jul 23 13:46:01.871843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.870161    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b636e20-c94d-44c2-8c43-2edf977ba89a" containerName="cleanup"
Jul 23 13:46:01.871843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.870179    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145761c5-5923-47cb-b0a4-936ca01cbca0" containerName="cleanup"
Jul 23 13:46:01.871843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.870188    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="145761c5-5923-47cb-b0a4-936ca01cbca0" containerName="cleanup"
Jul 23 13:46:01.871843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.870295    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b636e20-c94d-44c2-8c43-2edf977ba89a" containerName="cleanup"
Jul 23 13:46:01.871843 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.870308    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="145761c5-5923-47cb-b0a4-936ca01cbca0" containerName="cleanup"
Jul 23 13:46:01.873687 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.873669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:01.875853 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.875828    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:46:01.881118 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.881092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"]
Jul 23 13:46:01.946203 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:01.946161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e48840e-2890-4a95-b7ec-f3052b1cd41d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv\" (UID: \"2e48840e-2890-4a95-b7ec-f3052b1cd41d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:02.047534 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:02.047493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e48840e-2890-4a95-b7ec-f3052b1cd41d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv\" (UID: \"2e48840e-2890-4a95-b7ec-f3052b1cd41d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:02.048162 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:02.048141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e48840e-2890-4a95-b7ec-f3052b1cd41d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv\" (UID: \"2e48840e-2890-4a95-b7ec-f3052b1cd41d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:02.193779 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:02.193714    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:02.327540 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:02.327514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"]
Jul 23 13:46:02.329557 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:46:02.329521    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e48840e_2890_4a95_b7ec_f3052b1cd41d.slice/crio-66febb1ed072d7db30cbfa5014a7db9c65750f91625e95b8e8782304269d7062 WatchSource:0}: Error finding container 66febb1ed072d7db30cbfa5014a7db9c65750f91625e95b8e8782304269d7062: Status 404 returned error can't find the container with id 66febb1ed072d7db30cbfa5014a7db9c65750f91625e95b8e8782304269d7062
Jul 23 13:46:02.394094 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:02.394063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv" event={"ID":"2e48840e-2890-4a95-b7ec-f3052b1cd41d","Type":"ContainerStarted","Data":"66febb1ed072d7db30cbfa5014a7db9c65750f91625e95b8e8782304269d7062"}
Jul 23 13:46:03.401255 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:03.401173    2564 generic.go:356] "Generic (PLEG): container finished" podID="2e48840e-2890-4a95-b7ec-f3052b1cd41d" containerID="2a7a64d3fcbc7a0b073544d02d7844736eafccaa05c00373bcfaa9fba6a45923" exitCode=0
Jul 23 13:46:03.401600 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:03.401257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv" event={"ID":"2e48840e-2890-4a95-b7ec-f3052b1cd41d","Type":"ContainerDied","Data":"2a7a64d3fcbc7a0b073544d02d7844736eafccaa05c00373bcfaa9fba6a45923"}
Jul 23 13:46:04.544888 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:04.544850    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:04.670047 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:04.670017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e48840e-2890-4a95-b7ec-f3052b1cd41d-maas-api-service-ca\") pod \"2e48840e-2890-4a95-b7ec-f3052b1cd41d\" (UID: \"2e48840e-2890-4a95-b7ec-f3052b1cd41d\") "
Jul 23 13:46:04.670382 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:04.670358    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e48840e-2890-4a95-b7ec-f3052b1cd41d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2e48840e-2890-4a95-b7ec-f3052b1cd41d" (UID: "2e48840e-2890-4a95-b7ec-f3052b1cd41d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:46:04.770881 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:04.770834    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e48840e-2890-4a95-b7ec-f3052b1cd41d-maas-api-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:05.412581 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:05.412550    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"
Jul 23 13:46:05.412761 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:05.412585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv" event={"ID":"2e48840e-2890-4a95-b7ec-f3052b1cd41d","Type":"ContainerDied","Data":"66febb1ed072d7db30cbfa5014a7db9c65750f91625e95b8e8782304269d7062"}
Jul 23 13:46:05.412761 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:05.412632    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66febb1ed072d7db30cbfa5014a7db9c65750f91625e95b8e8782304269d7062"
Jul 23 13:46:12.317502 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.317468    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"]
Jul 23 13:46:12.318005 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.317682    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9" podUID="91136c4d-1fb2-49a5-990b-84a53c1a0fda" containerName="maas-api" containerID="cri-o://4e7d52457b2917b13ab69e8c4fce590e87ee113d70c78761410adad2642f047b" gracePeriod=30
Jul 23 13:46:12.346018 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.345983    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"]
Jul 23 13:46:12.350664 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.350642    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-98925a-29746905-xvfhm"]
Jul 23 13:46:12.450210 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.450177    2564 generic.go:356] "Generic (PLEG): container finished" podID="91136c4d-1fb2-49a5-990b-84a53c1a0fda" containerID="4e7d52457b2917b13ab69e8c4fce590e87ee113d70c78761410adad2642f047b" exitCode=0
Jul 23 13:46:12.450210 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.450204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9" event={"ID":"91136c4d-1fb2-49a5-990b-84a53c1a0fda","Type":"ContainerDied","Data":"4e7d52457b2917b13ab69e8c4fce590e87ee113d70c78761410adad2642f047b"}
Jul 23 13:46:12.565774 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.565745    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:46:12.641564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.641488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91136c4d-1fb2-49a5-990b-84a53c1a0fda-maas-api-tls\") pod \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") "
Jul 23 13:46:12.641564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.641528    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd8qh\" (UniqueName: \"kubernetes.io/projected/91136c4d-1fb2-49a5-990b-84a53c1a0fda-kube-api-access-rd8qh\") pod \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") "
Jul 23 13:46:12.641564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.641547    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91136c4d-1fb2-49a5-990b-84a53c1a0fda-openshift-service-ca\") pod \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\" (UID: \"91136c4d-1fb2-49a5-990b-84a53c1a0fda\") "
Jul 23 13:46:12.642014 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.641985    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91136c4d-1fb2-49a5-990b-84a53c1a0fda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91136c4d-1fb2-49a5-990b-84a53c1a0fda" (UID: "91136c4d-1fb2-49a5-990b-84a53c1a0fda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:46:12.643674 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.643652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91136c4d-1fb2-49a5-990b-84a53c1a0fda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91136c4d-1fb2-49a5-990b-84a53c1a0fda" (UID: "91136c4d-1fb2-49a5-990b-84a53c1a0fda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:46:12.643928 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.643703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91136c4d-1fb2-49a5-990b-84a53c1a0fda-kube-api-access-rd8qh" (OuterVolumeSpecName: "kube-api-access-rd8qh") pod "91136c4d-1fb2-49a5-990b-84a53c1a0fda" (UID: "91136c4d-1fb2-49a5-990b-84a53c1a0fda"). InnerVolumeSpecName "kube-api-access-rd8qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:12.742326 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.742278    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd8qh\" (UniqueName: \"kubernetes.io/projected/91136c4d-1fb2-49a5-990b-84a53c1a0fda-kube-api-access-rd8qh\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:12.742326 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.742322    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91136c4d-1fb2-49a5-990b-84a53c1a0fda-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:12.742326 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:12.742332    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91136c4d-1fb2-49a5-990b-84a53c1a0fda-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:13.458240 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.458206    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"
Jul 23 13:46:13.458650 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.458213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9" event={"ID":"91136c4d-1fb2-49a5-990b-84a53c1a0fda","Type":"ContainerDied","Data":"0339425ab5a5f28f82cf879c2de1c380c41257e079cd242c76e296140dac20d6"}
Jul 23 13:46:13.458650 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.458374    2564 scope.go:117] "RemoveContainer" containerID="4e7d52457b2917b13ab69e8c4fce590e87ee113d70c78761410adad2642f047b"
Jul 23 13:46:13.481793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.481762    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"]
Jul 23 13:46:13.487115 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.487090    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-98925a-675cb85667-smcj9"]
Jul 23 13:46:13.769242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.769164    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="145761c5-5923-47cb-b0a4-936ca01cbca0" path="/var/lib/kubelet/pods/145761c5-5923-47cb-b0a4-936ca01cbca0/volumes"
Jul 23 13:46:13.769513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:13.769500    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91136c4d-1fb2-49a5-990b-84a53c1a0fda" path="/var/lib/kubelet/pods/91136c4d-1fb2-49a5-990b-84a53c1a0fda/volumes"
Jul 23 13:46:17.084465 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:17.084428    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"]
Jul 23 13:46:17.095133 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:17.095108    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98925a-9t7tv"]
Jul 23 13:46:17.769702 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:17.769670    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e48840e-2890-4a95-b7ec-f3052b1cd41d" path="/var/lib/kubelet/pods/2e48840e-2890-4a95-b7ec-f3052b1cd41d/volumes"
Jul 23 13:46:24.418930 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.418890    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"]
Jul 23 13:46:24.419504 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.419486    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91136c4d-1fb2-49a5-990b-84a53c1a0fda" containerName="maas-api"
Jul 23 13:46:24.419560 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.419509    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="91136c4d-1fb2-49a5-990b-84a53c1a0fda" containerName="maas-api"
Jul 23 13:46:24.419560 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.419537    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e48840e-2890-4a95-b7ec-f3052b1cd41d" containerName="revoke-keys"
Jul 23 13:46:24.419560 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.419546    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e48840e-2890-4a95-b7ec-f3052b1cd41d" containerName="revoke-keys"
Jul 23 13:46:24.419660 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.419629    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="91136c4d-1fb2-49a5-990b-84a53c1a0fda" containerName="maas-api"
Jul 23 13:46:24.419660 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.419646    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e48840e-2890-4a95-b7ec-f3052b1cd41d" containerName="revoke-keys"
Jul 23 13:46:24.423234 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.423216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:24.425641 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.425617    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:46:24.429041 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.429019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"]
Jul 23 13:46:24.550091 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.550056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28bc96c-f421-40e3-9a88-a411b5bb20ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh\" (UID: \"d28bc96c-f421-40e3-9a88-a411b5bb20ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:24.657612 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.652826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28bc96c-f421-40e3-9a88-a411b5bb20ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh\" (UID: \"d28bc96c-f421-40e3-9a88-a411b5bb20ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:24.657612 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.653706    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28bc96c-f421-40e3-9a88-a411b5bb20ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh\" (UID: \"d28bc96c-f421-40e3-9a88-a411b5bb20ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:24.735845 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.735760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:24.876247 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:24.876222    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"]
Jul 23 13:46:24.878943 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:46:24.878914    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28bc96c_f421_40e3_9a88_a411b5bb20ed.slice/crio-1c1cb2f7346f5e2ff534360b2e101e74c97e4aa391c0569fcf2de3a1af9ab436 WatchSource:0}: Error finding container 1c1cb2f7346f5e2ff534360b2e101e74c97e4aa391c0569fcf2de3a1af9ab436: Status 404 returned error can't find the container with id 1c1cb2f7346f5e2ff534360b2e101e74c97e4aa391c0569fcf2de3a1af9ab436
Jul 23 13:46:25.517837 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:25.517806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh" event={"ID":"d28bc96c-f421-40e3-9a88-a411b5bb20ed","Type":"ContainerStarted","Data":"4059d1c8a0307dd9ee9cec10ff40701a965197da4d9e66bc5485e6a41a16db1d"}
Jul 23 13:46:25.518321 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:25.517891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh" event={"ID":"d28bc96c-f421-40e3-9a88-a411b5bb20ed","Type":"ContainerStarted","Data":"1c1cb2f7346f5e2ff534360b2e101e74c97e4aa391c0569fcf2de3a1af9ab436"}
Jul 23 13:46:25.534255 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:25.534203    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh" podStartSLOduration=1.5341883429999998 podStartE2EDuration="1.534188343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:25.531886794 +0000 UTC m=+2356.269120106" watchObservedRunningTime="2026-07-23 13:46:25.534188343 +0000 UTC m=+2356.271421662"
Jul 23 13:46:26.523963 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:26.523925    2564 generic.go:356] "Generic (PLEG): container finished" podID="d28bc96c-f421-40e3-9a88-a411b5bb20ed" containerID="4059d1c8a0307dd9ee9cec10ff40701a965197da4d9e66bc5485e6a41a16db1d" exitCode=0
Jul 23 13:46:26.524343 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:26.524011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh" event={"ID":"d28bc96c-f421-40e3-9a88-a411b5bb20ed","Type":"ContainerDied","Data":"4059d1c8a0307dd9ee9cec10ff40701a965197da4d9e66bc5485e6a41a16db1d"}
Jul 23 13:46:27.656062 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:27.656038    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:27.679192 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:27.679168    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28bc96c-f421-40e3-9a88-a411b5bb20ed-maas-api-service-ca\") pod \"d28bc96c-f421-40e3-9a88-a411b5bb20ed\" (UID: \"d28bc96c-f421-40e3-9a88-a411b5bb20ed\") "
Jul 23 13:46:27.679510 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:27.679483    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d28bc96c-f421-40e3-9a88-a411b5bb20ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d28bc96c-f421-40e3-9a88-a411b5bb20ed" (UID: "d28bc96c-f421-40e3-9a88-a411b5bb20ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:46:27.780579 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:27.780518    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28bc96c-f421-40e3-9a88-a411b5bb20ed-maas-api-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:28.535109 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:28.535082    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"
Jul 23 13:46:28.535109 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:28.535088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh" event={"ID":"d28bc96c-f421-40e3-9a88-a411b5bb20ed","Type":"ContainerDied","Data":"1c1cb2f7346f5e2ff534360b2e101e74c97e4aa391c0569fcf2de3a1af9ab436"}
Jul 23 13:46:28.535327 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:28.535131    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c1cb2f7346f5e2ff534360b2e101e74c97e4aa391c0569fcf2de3a1af9ab436"
Jul 23 13:46:34.867745 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:34.867703    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"]
Jul 23 13:46:34.868387 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:34.867997    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" podUID="7b666e55-dd30-40e2-adcb-280bb8399e02" containerName="maas-api" containerID="cri-o://196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34" gracePeriod=30
Jul 23 13:46:35.119834 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.119767    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:46:35.144209 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.144186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls\") pod \"7b666e55-dd30-40e2-adcb-280bb8399e02\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") "
Jul 23 13:46:35.144366 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.144221    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnwzv\" (UniqueName: \"kubernetes.io/projected/7b666e55-dd30-40e2-adcb-280bb8399e02-kube-api-access-vnwzv\") pod \"7b666e55-dd30-40e2-adcb-280bb8399e02\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") "
Jul 23 13:46:35.144366 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.144250    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b666e55-dd30-40e2-adcb-280bb8399e02-openshift-service-ca\") pod \"7b666e55-dd30-40e2-adcb-280bb8399e02\" (UID: \"7b666e55-dd30-40e2-adcb-280bb8399e02\") "
Jul 23 13:46:35.144716 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.144674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b666e55-dd30-40e2-adcb-280bb8399e02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7b666e55-dd30-40e2-adcb-280bb8399e02" (UID: "7b666e55-dd30-40e2-adcb-280bb8399e02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:46:35.146483 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.146452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7b666e55-dd30-40e2-adcb-280bb8399e02" (UID: "7b666e55-dd30-40e2-adcb-280bb8399e02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:46:35.146579 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.146537    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b666e55-dd30-40e2-adcb-280bb8399e02-kube-api-access-vnwzv" (OuterVolumeSpecName: "kube-api-access-vnwzv") pod "7b666e55-dd30-40e2-adcb-280bb8399e02" (UID: "7b666e55-dd30-40e2-adcb-280bb8399e02"). InnerVolumeSpecName "kube-api-access-vnwzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:35.245773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.245738    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b666e55-dd30-40e2-adcb-280bb8399e02-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:35.245773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.245768    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnwzv\" (UniqueName: \"kubernetes.io/projected/7b666e55-dd30-40e2-adcb-280bb8399e02-kube-api-access-vnwzv\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:35.245773 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.245778    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b666e55-dd30-40e2-adcb-280bb8399e02-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:46:35.570800 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.570767    2564 generic.go:356] "Generic (PLEG): container finished" podID="7b666e55-dd30-40e2-adcb-280bb8399e02" containerID="196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34" exitCode=0
Jul 23 13:46:35.571018 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.570813    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"
Jul 23 13:46:35.571018 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.570845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" event={"ID":"7b666e55-dd30-40e2-adcb-280bb8399e02","Type":"ContainerDied","Data":"196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34"}
Jul 23 13:46:35.571018 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.570913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9" event={"ID":"7b666e55-dd30-40e2-adcb-280bb8399e02","Type":"ContainerDied","Data":"8fdeeb93c1b82b64678e04afffb021fc048fc909542c4cc7c707d414d7946d9c"}
Jul 23 13:46:35.571018 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.570944    2564 scope.go:117] "RemoveContainer" containerID="196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34"
Jul 23 13:46:35.582219 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.582201    2564 scope.go:117] "RemoveContainer" containerID="196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34"
Jul 23 13:46:35.582541 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:46:35.582519    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34\": container with ID starting with 196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34 not found: ID does not exist" containerID="196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34"
Jul 23 13:46:35.582613 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.582551    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34"} err="failed to get container status \"196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34\": rpc error: code = NotFound desc = could not find container \"196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34\": container with ID starting with 196b781f400aa50e1206157c63925bb83e5bf601b2458f87c729b7c168b5da34 not found: ID does not exist"
Jul 23 13:46:35.594137 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.594110    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"]
Jul 23 13:46:35.598771 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.598745    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-38ab5f-5dd96bf75-jvdq9"]
Jul 23 13:46:35.769962 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:35.769934    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b666e55-dd30-40e2-adcb-280bb8399e02" path="/var/lib/kubelet/pods/7b666e55-dd30-40e2-adcb-280bb8399e02/volumes"
Jul 23 13:46:39.523208 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:39.523170    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"]
Jul 23 13:46:39.528039 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:39.528015    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38ab5f-ntrxh"]
Jul 23 13:46:39.769636 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:39.769592    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28bc96c-f421-40e3-9a88-a411b5bb20ed" path="/var/lib/kubelet/pods/d28bc96c-f421-40e3-9a88-a411b5bb20ed/volumes"
Jul 23 13:46:50.283381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283344    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"]
Jul 23 13:46:50.283937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283700    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b666e55-dd30-40e2-adcb-280bb8399e02" containerName="maas-api"
Jul 23 13:46:50.283937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283712    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b666e55-dd30-40e2-adcb-280bb8399e02" containerName="maas-api"
Jul 23 13:46:50.283937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283756    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28bc96c-f421-40e3-9a88-a411b5bb20ed" containerName="revoke-keys"
Jul 23 13:46:50.283937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283766    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28bc96c-f421-40e3-9a88-a411b5bb20ed" containerName="revoke-keys"
Jul 23 13:46:50.283937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283843    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28bc96c-f421-40e3-9a88-a411b5bb20ed" containerName="revoke-keys"
Jul 23 13:46:50.283937 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.283852    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b666e55-dd30-40e2-adcb-280bb8399e02" containerName="maas-api"
Jul 23 13:46:50.286887 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.286843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.297925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.291476    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:46:50.297925 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.291907    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-636f5e-serving-cert\""
Jul 23 13:46:50.301511 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.301486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"]
Jul 23 13:46:50.372253 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.372218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e141ec24-e45a-486d-9feb-7ef2d7fe6207-openshift-service-ca\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.372253 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.372253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.372564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.372339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwtth\" (UniqueName: \"kubernetes.io/projected/e141ec24-e45a-486d-9feb-7ef2d7fe6207-kube-api-access-nwtth\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.473487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.473454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwtth\" (UniqueName: \"kubernetes.io/projected/e141ec24-e45a-486d-9feb-7ef2d7fe6207-kube-api-access-nwtth\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.473668 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.473514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e141ec24-e45a-486d-9feb-7ef2d7fe6207-openshift-service-ca\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.473668 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.473626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.473792 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:46:50.473776    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-serving-cert: secret "maas-api-e2e-api-a-636f5e-serving-cert" not found
Jul 23 13:46:50.473888 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:46:50.473850    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls podName:e141ec24-e45a-486d-9feb-7ef2d7fe6207 nodeName:}" failed. No retries permitted until 2026-07-23 13:46:50.973827197 +0000 UTC m=+2381.711060506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls") pod "maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" (UID: "e141ec24-e45a-486d-9feb-7ef2d7fe6207") : secret "maas-api-e2e-api-a-636f5e-serving-cert" not found
Jul 23 13:46:50.474218 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.474201    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e141ec24-e45a-486d-9feb-7ef2d7fe6207-openshift-service-ca\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.492788 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.492763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwtth\" (UniqueName: \"kubernetes.io/projected/e141ec24-e45a-486d-9feb-7ef2d7fe6207-kube-api-access-nwtth\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.978945 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.978915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:50.981310 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:50.981285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls\") pod \"maas-api-e2e-api-a-636f5e-5777f87875-zbtjx\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:51.206002 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:51.205964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:51.345856 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:51.345816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"]
Jul 23 13:46:51.349184 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:46:51.349150    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode141ec24_e45a_486d_9feb_7ef2d7fe6207.slice/crio-6b4f354007a74a65655a45dc753b6fa99e66daa9a7a88de3bb72f254c0792069 WatchSource:0}: Error finding container 6b4f354007a74a65655a45dc753b6fa99e66daa9a7a88de3bb72f254c0792069: Status 404 returned error can't find the container with id 6b4f354007a74a65655a45dc753b6fa99e66daa9a7a88de3bb72f254c0792069
Jul 23 13:46:51.351080 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:51.351061    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:46:51.650023 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:51.649937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" event={"ID":"e141ec24-e45a-486d-9feb-7ef2d7fe6207","Type":"ContainerStarted","Data":"6b4f354007a74a65655a45dc753b6fa99e66daa9a7a88de3bb72f254c0792069"}
Jul 23 13:46:52.656174 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:52.656137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" event={"ID":"e141ec24-e45a-486d-9feb-7ef2d7fe6207","Type":"ContainerStarted","Data":"150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89"}
Jul 23 13:46:52.656576 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:52.656264    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:52.673329 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:52.673288    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" podStartSLOduration=1.86702674 podStartE2EDuration="2.673271862s" totalImagesPullingTime="806.245122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:52.672322536 +0000 UTC m=+2383.409555871" watchObservedRunningTime="2026-07-23 13:46:52.673271862 +0000 UTC m=+2383.410505181"
Jul 23 13:46:58.513819 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.513783    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"]
Jul 23 13:46:58.518245 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.518194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.521952 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.521932    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a6a223-serving-cert\""
Jul 23 13:46:58.549662 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.549633    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"]
Jul 23 13:46:58.647071 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.647036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.647238 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.647084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.647238 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.647211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbxh\" (UniqueName: \"kubernetes.io/projected/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-kube-api-access-clbxh\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.666388 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.666367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:46:58.748633 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.748601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.748826 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.748664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.748826 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.748773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clbxh\" (UniqueName: \"kubernetes.io/projected/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-kube-api-access-clbxh\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.749477 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.749446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.751082 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.751061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.759793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.759769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbxh\" (UniqueName: \"kubernetes.io/projected/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-kube-api-access-clbxh\") pod \"maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.829487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.829409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:58.968707 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:58.968684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"]
Jul 23 13:46:58.970930 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:46:58.970903    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cfe473_92fc_4d5f_8fa6_238cf18ec3d2.slice/crio-6d47aabdf7e8596f2d13ec7d089dbee110fedd100c8d900aaf7507e93c1f0bfe WatchSource:0}: Error finding container 6d47aabdf7e8596f2d13ec7d089dbee110fedd100c8d900aaf7507e93c1f0bfe: Status 404 returned error can't find the container with id 6d47aabdf7e8596f2d13ec7d089dbee110fedd100c8d900aaf7507e93c1f0bfe
Jul 23 13:46:59.692746 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:59.692711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph" event={"ID":"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2","Type":"ContainerStarted","Data":"f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a"}
Jul 23 13:46:59.693337 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:59.692780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph" event={"ID":"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2","Type":"ContainerStarted","Data":"6d47aabdf7e8596f2d13ec7d089dbee110fedd100c8d900aaf7507e93c1f0bfe"}
Jul 23 13:46:59.693337 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:59.692814    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:46:59.738935 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:46:59.738883    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph" podStartSLOduration=1.411090766 podStartE2EDuration="1.738853039s" totalImagesPullingTime="327.762273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:59.737041019 +0000 UTC m=+2390.474274350" watchObservedRunningTime="2026-07-23 13:46:59.738853039 +0000 UTC m=+2390.476086357"
Jul 23 13:47:05.704811 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:05.704782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:47:09.850600 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:09.850570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:47:09.857221 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:09.857190    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:47:10.901675 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:10.901638    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"]
Jul 23 13:47:10.906494 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:10.906473    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:10.909108 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:10.909089    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:47:10.916740 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:10.916716    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"]
Jul 23 13:47:11.056446 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.056406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106bcda5-6b83-4b7d-9ffe-424346687400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-636f5e-64hdh\" (UID: \"106bcda5-6b83-4b7d-9ffe-424346687400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:11.157194 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.157129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106bcda5-6b83-4b7d-9ffe-424346687400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-636f5e-64hdh\" (UID: \"106bcda5-6b83-4b7d-9ffe-424346687400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:11.158050 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.157707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106bcda5-6b83-4b7d-9ffe-424346687400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-636f5e-64hdh\" (UID: \"106bcda5-6b83-4b7d-9ffe-424346687400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:11.217353 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.217316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:11.368528 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.368504    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"]
Jul 23 13:47:11.370677 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:47:11.370645    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106bcda5_6b83_4b7d_9ffe_424346687400.slice/crio-5231e2df9557f8773dc8fbe379c4a5f850d024215d98acc69d442a84c50bc8d3 WatchSource:0}: Error finding container 5231e2df9557f8773dc8fbe379c4a5f850d024215d98acc69d442a84c50bc8d3: Status 404 returned error can't find the container with id 5231e2df9557f8773dc8fbe379c4a5f850d024215d98acc69d442a84c50bc8d3
Jul 23 13:47:11.758369 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.758278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh" event={"ID":"106bcda5-6b83-4b7d-9ffe-424346687400","Type":"ContainerStarted","Data":"faf9da49a0cf16a89e441a6e4020594ac9ef09fabe391408bc7cc41f6e0104c6"}
Jul 23 13:47:11.758369 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.758331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh" event={"ID":"106bcda5-6b83-4b7d-9ffe-424346687400","Type":"ContainerStarted","Data":"5231e2df9557f8773dc8fbe379c4a5f850d024215d98acc69d442a84c50bc8d3"}
Jul 23 13:47:11.776576 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:11.776528    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh" podStartSLOduration=1.776513035 podStartE2EDuration="1.776513035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:11.775184249 +0000 UTC m=+2402.512417570" watchObservedRunningTime="2026-07-23 13:47:11.776513035 +0000 UTC m=+2402.513746361"
Jul 23 13:47:12.764410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:12.764377    2564 generic.go:356] "Generic (PLEG): container finished" podID="106bcda5-6b83-4b7d-9ffe-424346687400" containerID="faf9da49a0cf16a89e441a6e4020594ac9ef09fabe391408bc7cc41f6e0104c6" exitCode=0
Jul 23 13:47:12.764833 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:12.764431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh" event={"ID":"106bcda5-6b83-4b7d-9ffe-424346687400","Type":"ContainerDied","Data":"faf9da49a0cf16a89e441a6e4020594ac9ef09fabe391408bc7cc41f6e0104c6"}
Jul 23 13:47:13.904775 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:13.904749    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:14.082075 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:14.081994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106bcda5-6b83-4b7d-9ffe-424346687400-maas-api-service-ca\") pod \"106bcda5-6b83-4b7d-9ffe-424346687400\" (UID: \"106bcda5-6b83-4b7d-9ffe-424346687400\") "
Jul 23 13:47:14.082329 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:14.082305    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/106bcda5-6b83-4b7d-9ffe-424346687400-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "106bcda5-6b83-4b7d-9ffe-424346687400" (UID: "106bcda5-6b83-4b7d-9ffe-424346687400"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:14.183178 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:14.183147    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106bcda5-6b83-4b7d-9ffe-424346687400-maas-api-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:14.775242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:14.775208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh" event={"ID":"106bcda5-6b83-4b7d-9ffe-424346687400","Type":"ContainerDied","Data":"5231e2df9557f8773dc8fbe379c4a5f850d024215d98acc69d442a84c50bc8d3"}
Jul 23 13:47:14.775242 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:14.775233    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"
Jul 23 13:47:14.775452 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:14.775257    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5231e2df9557f8773dc8fbe379c4a5f850d024215d98acc69d442a84c50bc8d3"
Jul 23 13:47:26.869579 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:26.869541    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"]
Jul 23 13:47:26.869989 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:26.869754    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" podUID="e141ec24-e45a-486d-9feb-7ef2d7fe6207" containerName="maas-api" containerID="cri-o://150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89" gracePeriod=30
Jul 23 13:47:27.129177 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.129116    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:47:27.196342 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.196314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e141ec24-e45a-486d-9feb-7ef2d7fe6207-openshift-service-ca\") pod \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") "
Jul 23 13:47:27.196534 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.196355    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls\") pod \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") "
Jul 23 13:47:27.196534 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.196423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwtth\" (UniqueName: \"kubernetes.io/projected/e141ec24-e45a-486d-9feb-7ef2d7fe6207-kube-api-access-nwtth\") pod \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\" (UID: \"e141ec24-e45a-486d-9feb-7ef2d7fe6207\") "
Jul 23 13:47:27.196763 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.196737    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e141ec24-e45a-486d-9feb-7ef2d7fe6207-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e141ec24-e45a-486d-9feb-7ef2d7fe6207" (UID: "e141ec24-e45a-486d-9feb-7ef2d7fe6207"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:27.198513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.198480    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e141ec24-e45a-486d-9feb-7ef2d7fe6207" (UID: "e141ec24-e45a-486d-9feb-7ef2d7fe6207"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:47:27.198623 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.198602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e141ec24-e45a-486d-9feb-7ef2d7fe6207-kube-api-access-nwtth" (OuterVolumeSpecName: "kube-api-access-nwtth") pod "e141ec24-e45a-486d-9feb-7ef2d7fe6207" (UID: "e141ec24-e45a-486d-9feb-7ef2d7fe6207"). InnerVolumeSpecName "kube-api-access-nwtth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:47:27.297107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.297058    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwtth\" (UniqueName: \"kubernetes.io/projected/e141ec24-e45a-486d-9feb-7ef2d7fe6207-kube-api-access-nwtth\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:27.297107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.297107    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e141ec24-e45a-486d-9feb-7ef2d7fe6207-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:27.297345 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.297124    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e141ec24-e45a-486d-9feb-7ef2d7fe6207-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:27.836250 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.836218    2564 generic.go:356] "Generic (PLEG): container finished" podID="e141ec24-e45a-486d-9feb-7ef2d7fe6207" containerID="150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89" exitCode=0
Jul 23 13:47:27.836415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.836264    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"
Jul 23 13:47:27.836415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.836304    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" event={"ID":"e141ec24-e45a-486d-9feb-7ef2d7fe6207","Type":"ContainerDied","Data":"150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89"}
Jul 23 13:47:27.836415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.836358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx" event={"ID":"e141ec24-e45a-486d-9feb-7ef2d7fe6207","Type":"ContainerDied","Data":"6b4f354007a74a65655a45dc753b6fa99e66daa9a7a88de3bb72f254c0792069"}
Jul 23 13:47:27.836415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.836382    2564 scope.go:117] "RemoveContainer" containerID="150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89"
Jul 23 13:47:27.845072 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.845057    2564 scope.go:117] "RemoveContainer" containerID="150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89"
Jul 23 13:47:27.845329 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:47:27.845311    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89\": container with ID starting with 150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89 not found: ID does not exist" containerID="150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89"
Jul 23 13:47:27.845385 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.845338    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89"} err="failed to get container status \"150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89\": rpc error: code = NotFound desc = could not find container \"150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89\": container with ID starting with 150b1b2c859658310c6a71d6a5625e2568b6f059c10cdfa4d6438c4b9fd9ca89 not found: ID does not exist"
Jul 23 13:47:27.855385 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.855365    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"]
Jul 23 13:47:27.860587 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:27.860569    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-636f5e-5777f87875-zbtjx"]
Jul 23 13:47:29.769537 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:29.769505    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e141ec24-e45a-486d-9feb-7ef2d7fe6207" path="/var/lib/kubelet/pods/e141ec24-e45a-486d-9feb-7ef2d7fe6207/volumes"
Jul 23 13:47:30.990668 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:30.990635    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"]
Jul 23 13:47:30.995281 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:30.995257    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-636f5e-64hdh"]
Jul 23 13:47:31.769463 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:31.769422    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="106bcda5-6b83-4b7d-9ffe-424346687400" path="/var/lib/kubelet/pods/106bcda5-6b83-4b7d-9ffe-424346687400/volumes"
Jul 23 13:47:37.997736 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.997656    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"]
Jul 23 13:47:37.998140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.998072    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106bcda5-6b83-4b7d-9ffe-424346687400" containerName="revoke-keys"
Jul 23 13:47:37.998140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.998085    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="106bcda5-6b83-4b7d-9ffe-424346687400" containerName="revoke-keys"
Jul 23 13:47:37.998140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.998094    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e141ec24-e45a-486d-9feb-7ef2d7fe6207" containerName="maas-api"
Jul 23 13:47:37.998140 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.998100    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e141ec24-e45a-486d-9feb-7ef2d7fe6207" containerName="maas-api"
Jul 23 13:47:37.998273 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.998168    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e141ec24-e45a-486d-9feb-7ef2d7fe6207" containerName="maas-api"
Jul 23 13:47:37.998273 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:37.998177    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="106bcda5-6b83-4b7d-9ffe-424346687400" containerName="revoke-keys"
Jul 23 13:47:38.002584 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.002566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:38.004904 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.004880    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:47:38.010778 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.010752    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"]
Jul 23 13:47:38.095354 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.095321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e6d1a38-c1a4-41b9-8141-1e86764a8818-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9\" (UID: \"8e6d1a38-c1a4-41b9-8141-1e86764a8818\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:38.196080 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.196042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e6d1a38-c1a4-41b9-8141-1e86764a8818-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9\" (UID: \"8e6d1a38-c1a4-41b9-8141-1e86764a8818\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:38.196693 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.196671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e6d1a38-c1a4-41b9-8141-1e86764a8818-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9\" (UID: \"8e6d1a38-c1a4-41b9-8141-1e86764a8818\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:38.314738 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.314644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:38.448052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.448031    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"]
Jul 23 13:47:38.450588 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:47:38.450547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6d1a38_c1a4_41b9_8141_1e86764a8818.slice/crio-a6400138b3df8f1c2bafaf7bcdb368b8e8d5029f739c5c36bafd9437cc15a283 WatchSource:0}: Error finding container a6400138b3df8f1c2bafaf7bcdb368b8e8d5029f739c5c36bafd9437cc15a283: Status 404 returned error can't find the container with id a6400138b3df8f1c2bafaf7bcdb368b8e8d5029f739c5c36bafd9437cc15a283
Jul 23 13:47:38.891898 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.891851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9" event={"ID":"8e6d1a38-c1a4-41b9-8141-1e86764a8818","Type":"ContainerStarted","Data":"c34ff29113925f89015120897ef1ffc58e09a22578bac73b9af38975668b5dd2"}
Jul 23 13:47:38.892064 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.891934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9" event={"ID":"8e6d1a38-c1a4-41b9-8141-1e86764a8818","Type":"ContainerStarted","Data":"a6400138b3df8f1c2bafaf7bcdb368b8e8d5029f739c5c36bafd9437cc15a283"}
Jul 23 13:47:38.918092 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:38.918044    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9" podStartSLOduration=1.918028158 podStartE2EDuration="1.918028158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:38.917341214 +0000 UTC m=+2429.654574532" watchObservedRunningTime="2026-07-23 13:47:38.918028158 +0000 UTC m=+2429.655261477"
Jul 23 13:47:39.898784 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:39.898746    2564 generic.go:356] "Generic (PLEG): container finished" podID="8e6d1a38-c1a4-41b9-8141-1e86764a8818" containerID="c34ff29113925f89015120897ef1ffc58e09a22578bac73b9af38975668b5dd2" exitCode=0
Jul 23 13:47:39.899200 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:39.898830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9" event={"ID":"8e6d1a38-c1a4-41b9-8141-1e86764a8818","Type":"ContainerDied","Data":"c34ff29113925f89015120897ef1ffc58e09a22578bac73b9af38975668b5dd2"}
Jul 23 13:47:41.034808 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.034782    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:41.122728 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.122692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e6d1a38-c1a4-41b9-8141-1e86764a8818-maas-api-service-ca\") pod \"8e6d1a38-c1a4-41b9-8141-1e86764a8818\" (UID: \"8e6d1a38-c1a4-41b9-8141-1e86764a8818\") "
Jul 23 13:47:41.123102 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.123083    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e6d1a38-c1a4-41b9-8141-1e86764a8818-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e6d1a38-c1a4-41b9-8141-1e86764a8818" (UID: "8e6d1a38-c1a4-41b9-8141-1e86764a8818"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:41.223795 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.223765    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e6d1a38-c1a4-41b9-8141-1e86764a8818-maas-api-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:41.910315 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.910274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9" event={"ID":"8e6d1a38-c1a4-41b9-8141-1e86764a8818","Type":"ContainerDied","Data":"a6400138b3df8f1c2bafaf7bcdb368b8e8d5029f739c5c36bafd9437cc15a283"}
Jul 23 13:47:41.910518 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.910342    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6400138b3df8f1c2bafaf7bcdb368b8e8d5029f739c5c36bafd9437cc15a283"
Jul 23 13:47:41.910518 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:41.910296    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"
Jul 23 13:47:53.486482 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.486447    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"]
Jul 23 13:47:53.486879 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.486648    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph" podUID="06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" containerName="maas-api" containerID="cri-o://f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a" gracePeriod=30
Jul 23 13:47:53.738099 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.738041    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:47:53.832297 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.832260    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clbxh\" (UniqueName: \"kubernetes.io/projected/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-kube-api-access-clbxh\") pod \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") "
Jul 23 13:47:53.832479 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.832308    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-openshift-service-ca\") pod \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") "
Jul 23 13:47:53.832479 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.832431    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-maas-api-tls\") pod \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\" (UID: \"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2\") "
Jul 23 13:47:53.832702 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.832676    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" (UID: "06cfe473-92fc-4d5f-8fa6-238cf18ec3d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:53.832844 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.832803    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:53.835010 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.834987    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" (UID: "06cfe473-92fc-4d5f-8fa6-238cf18ec3d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:47:53.835106 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.834991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-kube-api-access-clbxh" (OuterVolumeSpecName: "kube-api-access-clbxh") pod "06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" (UID: "06cfe473-92fc-4d5f-8fa6-238cf18ec3d2"). InnerVolumeSpecName "kube-api-access-clbxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:47:53.933350 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.933322    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:53.933350 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.933344    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clbxh\" (UniqueName: \"kubernetes.io/projected/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2-kube-api-access-clbxh\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:47:53.969987 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.969959    2564 generic.go:356] "Generic (PLEG): container finished" podID="06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" containerID="f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a" exitCode=0
Jul 23 13:47:53.970099 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.970008    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"
Jul 23 13:47:53.970099 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.970021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph" event={"ID":"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2","Type":"ContainerDied","Data":"f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a"}
Jul 23 13:47:53.970099 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.970074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph" event={"ID":"06cfe473-92fc-4d5f-8fa6-238cf18ec3d2","Type":"ContainerDied","Data":"6d47aabdf7e8596f2d13ec7d089dbee110fedd100c8d900aaf7507e93c1f0bfe"}
Jul 23 13:47:53.970099 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.970097    2564 scope.go:117] "RemoveContainer" containerID="f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a"
Jul 23 13:47:53.979329 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.979311    2564 scope.go:117] "RemoveContainer" containerID="f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a"
Jul 23 13:47:53.979587 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:47:53.979571    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a\": container with ID starting with f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a not found: ID does not exist" containerID="f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a"
Jul 23 13:47:53.979634 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.979595    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a"} err="failed to get container status \"f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a\": rpc error: code = NotFound desc = could not find container \"f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a\": container with ID starting with f9c76e6442ef8fa0989d729c8df83daf08a0fcffbd78995ac9e5cc488c227a2a not found: ID does not exist"
Jul 23 13:47:53.997708 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.997648    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"]
Jul 23 13:47:53.999398 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:53.999376    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a6a223-76b96b6f46-8jtph"]
Jul 23 13:47:55.769568 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:55.769532    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" path="/var/lib/kubelet/pods/06cfe473-92fc-4d5f-8fa6-238cf18ec3d2/volumes"
Jul 23 13:47:58.078339 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:58.078295    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"]
Jul 23 13:47:58.080621 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:58.080600    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a6a223-tq4q9"]
Jul 23 13:47:59.770805 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:47:59.770775    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e6d1a38-c1a4-41b9-8141-1e86764a8818" path="/var/lib/kubelet/pods/8e6d1a38-c1a4-41b9-8141-1e86764a8818/volumes"
Jul 23 13:48:08.733444 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"]
Jul 23 13:48:08.734067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733817    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e6d1a38-c1a4-41b9-8141-1e86764a8818" containerName="revoke-keys"
Jul 23 13:48:08.734067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733830    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e6d1a38-c1a4-41b9-8141-1e86764a8818" containerName="revoke-keys"
Jul 23 13:48:08.734067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733843    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" containerName="maas-api"
Jul 23 13:48:08.734067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733848    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" containerName="maas-api"
Jul 23 13:48:08.734067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733930    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e6d1a38-c1a4-41b9-8141-1e86764a8818" containerName="revoke-keys"
Jul 23 13:48:08.734067 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.733939    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06cfe473-92fc-4d5f-8fa6-238cf18ec3d2" containerName="maas-api"
Jul 23 13:48:08.738241 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.738218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.740729 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.740709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:48:08.743905 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.743882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-5ddc60-serving-cert\""
Jul 23 13:48:08.753335 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.753304    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"]
Jul 23 13:48:08.867353 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.867313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.867546 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.867363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/182aec16-b775-419e-8d4d-8a62e936f033-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.867546 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.867393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9lh4\" (UniqueName: \"kubernetes.io/projected/182aec16-b775-419e-8d4d-8a62e936f033-kube-api-access-q9lh4\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.968179 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.968145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.968179 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.968181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/182aec16-b775-419e-8d4d-8a62e936f033-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.968375 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.968199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9lh4\" (UniqueName: \"kubernetes.io/projected/182aec16-b775-419e-8d4d-8a62e936f033-kube-api-access-q9lh4\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.968375 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:48:08.968293    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-serving-cert: secret "maas-api-e2e-shared-a-5ddc60-serving-cert" not found
Jul 23 13:48:08.968375 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:48:08.968365    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls podName:182aec16-b775-419e-8d4d-8a62e936f033 nodeName:}" failed. No retries permitted until 2026-07-23 13:48:09.468346064 +0000 UTC m=+2460.205579376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls") pod "maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" (UID: "182aec16-b775-419e-8d4d-8a62e936f033") : secret "maas-api-e2e-shared-a-5ddc60-serving-cert" not found
Jul 23 13:48:08.968978 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.968958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/182aec16-b775-419e-8d4d-8a62e936f033-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:08.977683 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:08.977659    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9lh4\" (UniqueName: \"kubernetes.io/projected/182aec16-b775-419e-8d4d-8a62e936f033-kube-api-access-q9lh4\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:09.471205 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:09.471137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:09.473645 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:09.473621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls\") pod \"maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:09.650548 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:09.650515    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wrwv4\""
Jul 23 13:48:09.658705 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:09.658674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:09.805299 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:09.805271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"]
Jul 23 13:48:09.807214 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:48:09.807186    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182aec16_b775_419e_8d4d_8a62e936f033.slice/crio-a11c8c3d08366a23ecd70562ad760defa35b34a137ece35b3388680ddc7fb41c WatchSource:0}: Error finding container a11c8c3d08366a23ecd70562ad760defa35b34a137ece35b3388680ddc7fb41c: Status 404 returned error can't find the container with id a11c8c3d08366a23ecd70562ad760defa35b34a137ece35b3388680ddc7fb41c
Jul 23 13:48:09.966793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:09.966763    2564 scope.go:117] "RemoveContainer" containerID="62a9eddfcf8f42f472c9edeb0c64c9307aeea9279969d2e6f659288e94e95083"
Jul 23 13:48:10.050199 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:10.050118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" event={"ID":"182aec16-b775-419e-8d4d-8a62e936f033","Type":"ContainerStarted","Data":"a11c8c3d08366a23ecd70562ad760defa35b34a137ece35b3388680ddc7fb41c"}
Jul 23 13:48:11.057193 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:11.057158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" event={"ID":"182aec16-b775-419e-8d4d-8a62e936f033","Type":"ContainerStarted","Data":"1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8"}
Jul 23 13:48:11.057605 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:11.057278    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:11.074832 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:11.074779    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" podStartSLOduration=2.713116509 podStartE2EDuration="3.074763921s" totalImagesPullingTime="361.647412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:11.07456838 +0000 UTC m=+2461.811801700" watchObservedRunningTime="2026-07-23 13:48:11.074763921 +0000 UTC m=+2461.811997239"
Jul 23 13:48:16.812913 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.812877    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"]
Jul 23 13:48:16.816387 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.816367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.820833 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.820813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-690897-serving-cert\""
Jul 23 13:48:16.826799 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.826776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.826899 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.826808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vp6\" (UniqueName: \"kubernetes.io/projected/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-kube-api-access-m7vp6\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.827082 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.827042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.833379 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.833356    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"]
Jul 23 13:48:16.927487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.927448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.927691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.927518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.927691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.927549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vp6\" (UniqueName: \"kubernetes.io/projected/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-kube-api-access-m7vp6\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.927691 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:48:16.927660    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-serving-cert: secret "maas-api-e2e-shared-b-690897-serving-cert" not found
Jul 23 13:48:16.927889 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:48:16.927737    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls podName:ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad nodeName:}" failed. No retries permitted until 2026-07-23 13:48:17.427720518 +0000 UTC m=+2468.164953815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls") pod "maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" (UID: "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad") : secret "maas-api-e2e-shared-b-690897-serving-cert" not found
Jul 23 13:48:16.928161 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.928142    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:16.939789 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:16.939766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vp6\" (UniqueName: \"kubernetes.io/projected/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-kube-api-access-m7vp6\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:17.069270 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:17.069187    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:48:17.432232 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:17.432197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:17.434606 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:17.434578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls\") pod \"maas-api-e2e-shared-b-690897-54b445cc49-2lg5m\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:17.726499 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:17.726403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:17.876714 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:17.876682    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"]
Jul 23 13:48:17.880270 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:48:17.880244    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7a3019_4d6f_4949_9d4c_8a8fd27f8fad.slice/crio-15833fd573b84bdb45482a2647576ecca80a6b2c1ea56163ac53acaf58689a6a WatchSource:0}: Error finding container 15833fd573b84bdb45482a2647576ecca80a6b2c1ea56163ac53acaf58689a6a: Status 404 returned error can't find the container with id 15833fd573b84bdb45482a2647576ecca80a6b2c1ea56163ac53acaf58689a6a
Jul 23 13:48:18.097121 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:18.097031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" event={"ID":"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad","Type":"ContainerStarted","Data":"15833fd573b84bdb45482a2647576ecca80a6b2c1ea56163ac53acaf58689a6a"}
Jul 23 13:48:19.106737 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:19.106703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" event={"ID":"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad","Type":"ContainerStarted","Data":"fb975e05356f9d62be6b937a2aadf1af1aa12a99e77cb8f428b79b503077fad6"}
Jul 23 13:48:19.107130 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:19.106811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:48:19.126197 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:19.126157    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" podStartSLOduration=2.77908466 podStartE2EDuration="3.126141388s" totalImagesPullingTime="347.056728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:48:19.124677044 +0000 UTC m=+2469.861910361" watchObservedRunningTime="2026-07-23 13:48:19.126141388 +0000 UTC m=+2469.863374707"
Jul 23 13:48:25.117110 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:48:25.117080    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:51:10.012698 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:10.012668    2564 scope.go:117] "RemoveContainer" containerID="5d4ff610d154996d13caff83958620fd726c7135efdd8b0065229d8fc1253c02"
Jul 23 13:51:29.356640 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.356601    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"]
Jul 23 13:51:29.360461 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.360438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.363046 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.363019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"openshift-service-ca.crt\""
Jul 23 13:51:29.363592 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.363573    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"sub-test-model-5ddc60-kserve-self-signed-certs\""
Jul 23 13:51:29.363793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.363781    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"default-dockercfg-qp87l\""
Jul 23 13:51:29.363902 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.363883    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5ddc60\"/\"kube-root-ca.crt\""
Jul 23 13:51:29.375478 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.375458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"]
Jul 23 13:51:29.481968 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.481942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-tmp-dir\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.482132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.481983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqxr\" (UniqueName: \"kubernetes.io/projected/3e8fc420-42d2-4128-b67c-341a95e357f4-kube-api-access-dtqxr\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.482132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.482005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-dshm\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.482132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.482057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-model-cache\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.482132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.482101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-home\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.482132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.482131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8fc420-42d2-4128-b67c-341a95e357f4-tls-certs\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583116 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-tmp-dir\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583116 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqxr\" (UniqueName: \"kubernetes.io/projected/3e8fc420-42d2-4128-b67c-341a95e357f4-kube-api-access-dtqxr\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583378 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-dshm\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583378 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-model-cache\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583378 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-home\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583378 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8fc420-42d2-4128-b67c-341a95e357f4-tls-certs\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583618 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-tmp-dir\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583745 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-model-cache\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.583745 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.583669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-home\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.585478 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.585456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-dshm\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.585659 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.585642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8fc420-42d2-4128-b67c-341a95e357f4-tls-certs\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.596461 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.596440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqxr\" (UniqueName: \"kubernetes.io/projected/3e8fc420-42d2-4128-b67c-341a95e357f4-kube-api-access-dtqxr\") pod \"sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") " pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.670115 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.670089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:29.821464 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:29.821441    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"]
Jul 23 13:51:29.823193 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:51:29.823171    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e8fc420_42d2_4128_b67c_341a95e357f4.slice/crio-c63c4e91d091116fc2117476aa06153e22177a172be45340df1b3840843baa9d WatchSource:0}: Error finding container c63c4e91d091116fc2117476aa06153e22177a172be45340df1b3840843baa9d: Status 404 returned error can't find the container with id c63c4e91d091116fc2117476aa06153e22177a172be45340df1b3840843baa9d
Jul 23 13:51:30.053926 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:30.053800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp" event={"ID":"3e8fc420-42d2-4128-b67c-341a95e357f4","Type":"ContainerStarted","Data":"e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04"}
Jul 23 13:51:30.053926 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:30.053842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp" event={"ID":"3e8fc420-42d2-4128-b67c-341a95e357f4","Type":"ContainerStarted","Data":"c63c4e91d091116fc2117476aa06153e22177a172be45340df1b3840843baa9d"}
Jul 23 13:51:30.073575 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:30.073529    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp" podStartSLOduration=1.073514335 podStartE2EDuration="1.073514335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:51:30.072821638 +0000 UTC m=+2660.810054970" watchObservedRunningTime="2026-07-23 13:51:30.073514335 +0000 UTC m=+2660.810747655"
Jul 23 13:51:39.670700 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:39.670668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:39.671200 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:39.670948    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:39.683078 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:39.683040    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:51:40.117677 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:51:40.117596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:52:09.880013 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:09.879934    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:52:09.887724 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:09.887695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:52:10.031778 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:10.031750    2564 scope.go:117] "RemoveContainer" containerID="2a7a64d3fcbc7a0b073544d02d7844736eafccaa05c00373bcfaa9fba6a45923"
Jul 23 13:52:37.044946 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:37.044903    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"]
Jul 23 13:52:52.065781 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.065742    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp" podUID="3e8fc420-42d2-4128-b67c-341a95e357f4" containerName="main" containerID="cri-o://e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04" gracePeriod=45
Jul 23 13:52:52.330261 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.330202    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:52:52.412210 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-home\") pod \"3e8fc420-42d2-4128-b67c-341a95e357f4\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") "
Jul 23 13:52:52.412410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412227    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-tmp-dir\") pod \"3e8fc420-42d2-4128-b67c-341a95e357f4\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") "
Jul 23 13:52:52.412410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-model-cache\") pod \"3e8fc420-42d2-4128-b67c-341a95e357f4\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") "
Jul 23 13:52:52.412410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtqxr\" (UniqueName: \"kubernetes.io/projected/3e8fc420-42d2-4128-b67c-341a95e357f4-kube-api-access-dtqxr\") pod \"3e8fc420-42d2-4128-b67c-341a95e357f4\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") "
Jul 23 13:52:52.412410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412344    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-dshm\") pod \"3e8fc420-42d2-4128-b67c-341a95e357f4\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") "
Jul 23 13:52:52.412410 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412373    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8fc420-42d2-4128-b67c-341a95e357f4-tls-certs\") pod \"3e8fc420-42d2-4128-b67c-341a95e357f4\" (UID: \"3e8fc420-42d2-4128-b67c-341a95e357f4\") "
Jul 23 13:52:52.412642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412460    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e8fc420-42d2-4128-b67c-341a95e357f4" (UID: "3e8fc420-42d2-4128-b67c-341a95e357f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:52.412642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412484    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-home" (OuterVolumeSpecName: "home") pod "3e8fc420-42d2-4128-b67c-341a95e357f4" (UID: "3e8fc420-42d2-4128-b67c-341a95e357f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:52.412642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412538    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e8fc420-42d2-4128-b67c-341a95e357f4" (UID: "3e8fc420-42d2-4128-b67c-341a95e357f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:52.412642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412625    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-home\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:52:52.412642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412638    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-tmp-dir\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:52:52.412822 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.412646    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-model-cache\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:52:52.414496 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.414472    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e8fc420-42d2-4128-b67c-341a95e357f4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e8fc420-42d2-4128-b67c-341a95e357f4" (UID: "3e8fc420-42d2-4128-b67c-341a95e357f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:52:52.414565 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.414505    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-dshm" (OuterVolumeSpecName: "dshm") pod "3e8fc420-42d2-4128-b67c-341a95e357f4" (UID: "3e8fc420-42d2-4128-b67c-341a95e357f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:52:52.414604 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.414574    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8fc420-42d2-4128-b67c-341a95e357f4-kube-api-access-dtqxr" (OuterVolumeSpecName: "kube-api-access-dtqxr") pod "3e8fc420-42d2-4128-b67c-341a95e357f4" (UID: "3e8fc420-42d2-4128-b67c-341a95e357f4"). InnerVolumeSpecName "kube-api-access-dtqxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:52:52.461902 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.461854    2564 generic.go:356] "Generic (PLEG): container finished" podID="3e8fc420-42d2-4128-b67c-341a95e357f4" containerID="e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04" exitCode=0
Jul 23 13:52:52.462063 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.461911    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"
Jul 23 13:52:52.462063 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.461905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp" event={"ID":"3e8fc420-42d2-4128-b67c-341a95e357f4","Type":"ContainerDied","Data":"e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04"}
Jul 23 13:52:52.462063 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.462025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp" event={"ID":"3e8fc420-42d2-4128-b67c-341a95e357f4","Type":"ContainerDied","Data":"c63c4e91d091116fc2117476aa06153e22177a172be45340df1b3840843baa9d"}
Jul 23 13:52:52.462063 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.462046    2564 scope.go:117] "RemoveContainer" containerID="e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04"
Jul 23 13:52:52.470942 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.470922    2564 scope.go:117] "RemoveContainer" containerID="e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04"
Jul 23 13:52:52.471225 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:52:52.471206    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04\": container with ID starting with e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04 not found: ID does not exist" containerID="e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04"
Jul 23 13:52:52.471299 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.471233    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04"} err="failed to get container status \"e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04\": rpc error: code = NotFound desc = could not find container \"e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04\": container with ID starting with e43fd22f21dc88f9a39c84e5b46da388a7ffbca806ee1a68684c5d11fc80cf04 not found: ID does not exist"
Jul 23 13:52:52.484079 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.484056    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"]
Jul 23 13:52:52.488900 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.488881    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5ddc60/sub-test-model-5ddc60-kserve-5b4cc5956c-gsrfp"]
Jul 23 13:52:52.513487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.513464    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtqxr\" (UniqueName: \"kubernetes.io/projected/3e8fc420-42d2-4128-b67c-341a95e357f4-kube-api-access-dtqxr\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:52:52.513487 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.513487    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8fc420-42d2-4128-b67c-341a95e357f4-dshm\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:52:52.513636 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:52.513497    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8fc420-42d2-4128-b67c-341a95e357f4-tls-certs\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:52:53.770237 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:52:53.770207    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8fc420-42d2-4128-b67c-341a95e357f4" path="/var/lib/kubelet/pods/3e8fc420-42d2-4128-b67c-341a95e357f4/volumes"
Jul 23 13:53:10.051632 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:10.051595    2564 scope.go:117] "RemoveContainer" containerID="4059d1c8a0307dd9ee9cec10ff40701a965197da4d9e66bc5485e6a41a16db1d"
Jul 23 13:53:14.540711 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.540670    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"]
Jul 23 13:53:14.541261 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.541241    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8fc420-42d2-4128-b67c-341a95e357f4" containerName="main"
Jul 23 13:53:14.541336 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.541264    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8fc420-42d2-4128-b67c-341a95e357f4" containerName="main"
Jul 23 13:53:14.541407 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.541394    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8fc420-42d2-4128-b67c-341a95e357f4" containerName="main"
Jul 23 13:53:14.545879 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.545847    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.549145 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.549113    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"openshift-service-ca.crt\""
Jul 23 13:53:14.549145 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.549127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"rate-test-model-690897-kserve-self-signed-certs\""
Jul 23 13:53:14.549145 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.549114    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"default-dockercfg-96l58\""
Jul 23 13:53:14.549347 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.549158    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-690897\"/\"kube-root-ca.crt\""
Jul 23 13:53:14.555392 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.555373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"]
Jul 23 13:53:14.700822 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.700783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-tmp-dir\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.700822 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.700832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-model-cache\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.701065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.700912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24746d4e-bc23-4682-8508-a48143830cad-tls-certs\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.701065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.700934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-dshm\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.701065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.701039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-home\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.701178 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.701081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgh67\" (UniqueName: \"kubernetes.io/projected/24746d4e-bc23-4682-8508-a48143830cad-kube-api-access-bgh67\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.802544 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.802460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24746d4e-bc23-4682-8508-a48143830cad-tls-certs\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.802544 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.802503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-dshm\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.802544 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.802538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-home\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.802902 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.802561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgh67\" (UniqueName: \"kubernetes.io/projected/24746d4e-bc23-4682-8508-a48143830cad-kube-api-access-bgh67\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.802902 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.802683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-tmp-dir\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.802902 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.802733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-model-cache\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.803090 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.803035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-home\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.803131 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.803096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-tmp-dir\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.803186 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.803165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-model-cache\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.804890 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.804853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-dshm\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.805231 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.805212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24746d4e-bc23-4682-8508-a48143830cad-tls-certs\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.810333 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.810316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgh67\" (UniqueName: \"kubernetes.io/projected/24746d4e-bc23-4682-8508-a48143830cad-kube-api-access-bgh67\") pod \"rate-test-model-690897-kserve-7c55dc85bc-f4q5g\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") " pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.854991 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.854961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:14.995815 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:14.995778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"]
Jul 23 13:53:14.999721 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:53:14.999691    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24746d4e_bc23_4682_8508_a48143830cad.slice/crio-af74bc52873c8c66823f9b662a543aa42465121099ef3c05bf9b41af2de0b18c WatchSource:0}: Error finding container af74bc52873c8c66823f9b662a543aa42465121099ef3c05bf9b41af2de0b18c: Status 404 returned error can't find the container with id af74bc52873c8c66823f9b662a543aa42465121099ef3c05bf9b41af2de0b18c
Jul 23 13:53:15.583421 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:15.583386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" event={"ID":"24746d4e-bc23-4682-8508-a48143830cad","Type":"ContainerStarted","Data":"901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17"}
Jul 23 13:53:15.583924 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:15.583431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" event={"ID":"24746d4e-bc23-4682-8508-a48143830cad","Type":"ContainerStarted","Data":"af74bc52873c8c66823f9b662a543aa42465121099ef3c05bf9b41af2de0b18c"}
Jul 23 13:53:15.605226 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:15.605176    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" podStartSLOduration=1.605163052 podStartE2EDuration="1.605163052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:53:15.604878066 +0000 UTC m=+2766.342111387" watchObservedRunningTime="2026-07-23 13:53:15.605163052 +0000 UTC m=+2766.342396371"
Jul 23 13:53:24.855454 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:24.855401    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:24.855454 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:24.855468    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:24.868546 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:24.868517    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:53:25.644302 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:53:25.644263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:54:00.396216 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:00.396172    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"]
Jul 23 13:54:10.073536 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:10.073503    2564 scope.go:117] "RemoveContainer" containerID="faf9da49a0cf16a89e441a6e4020594ac9ef09fabe391408bc7cc41f6e0104c6"
Jul 23 13:54:10.081791 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:10.081771    2564 scope.go:117] "RemoveContainer" containerID="c34ff29113925f89015120897ef1ffc58e09a22578bac73b9af38975668b5dd2"
Jul 23 13:54:15.419542 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.419477    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" podUID="24746d4e-bc23-4682-8508-a48143830cad" containerName="main" containerID="cri-o://901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17" gracePeriod=45
Jul 23 13:54:15.675381 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.675323    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:54:15.844024 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.843994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-tmp-dir\") pod \"24746d4e-bc23-4682-8508-a48143830cad\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") "
Jul 23 13:54:15.844202 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-dshm\") pod \"24746d4e-bc23-4682-8508-a48143830cad\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") "
Jul 23 13:54:15.844202 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgh67\" (UniqueName: \"kubernetes.io/projected/24746d4e-bc23-4682-8508-a48143830cad-kube-api-access-bgh67\") pod \"24746d4e-bc23-4682-8508-a48143830cad\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") "
Jul 23 13:54:15.844202 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844139    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-home\") pod \"24746d4e-bc23-4682-8508-a48143830cad\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") "
Jul 23 13:54:15.844202 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24746d4e-bc23-4682-8508-a48143830cad-tls-certs\") pod \"24746d4e-bc23-4682-8508-a48143830cad\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") "
Jul 23 13:54:15.844415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844203    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-model-cache\") pod \"24746d4e-bc23-4682-8508-a48143830cad\" (UID: \"24746d4e-bc23-4682-8508-a48143830cad\") "
Jul 23 13:54:15.844415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24746d4e-bc23-4682-8508-a48143830cad" (UID: "24746d4e-bc23-4682-8508-a48143830cad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:15.844415 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844397    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-home" (OuterVolumeSpecName: "home") pod "24746d4e-bc23-4682-8508-a48143830cad" (UID: "24746d4e-bc23-4682-8508-a48143830cad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:15.844574 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844496    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-model-cache" (OuterVolumeSpecName: "model-cache") pod "24746d4e-bc23-4682-8508-a48143830cad" (UID: "24746d4e-bc23-4682-8508-a48143830cad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:15.844574 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844547    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-tmp-dir\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:15.844574 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.844567    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-home\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:15.846321 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.846297    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-dshm" (OuterVolumeSpecName: "dshm") pod "24746d4e-bc23-4682-8508-a48143830cad" (UID: "24746d4e-bc23-4682-8508-a48143830cad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:54:15.846403 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.846300    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24746d4e-bc23-4682-8508-a48143830cad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24746d4e-bc23-4682-8508-a48143830cad" (UID: "24746d4e-bc23-4682-8508-a48143830cad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:54:15.846444 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.846405    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24746d4e-bc23-4682-8508-a48143830cad-kube-api-access-bgh67" (OuterVolumeSpecName: "kube-api-access-bgh67") pod "24746d4e-bc23-4682-8508-a48143830cad" (UID: "24746d4e-bc23-4682-8508-a48143830cad"). InnerVolumeSpecName "kube-api-access-bgh67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:15.877131 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.877096    2564 generic.go:356] "Generic (PLEG): container finished" podID="24746d4e-bc23-4682-8508-a48143830cad" containerID="901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17" exitCode=0
Jul 23 13:54:15.877302 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.877143    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"
Jul 23 13:54:15.877302 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.877184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" event={"ID":"24746d4e-bc23-4682-8508-a48143830cad","Type":"ContainerDied","Data":"901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17"}
Jul 23 13:54:15.877302 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.877238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" event={"ID":"24746d4e-bc23-4682-8508-a48143830cad","Type":"ContainerDied","Data":"af74bc52873c8c66823f9b662a543aa42465121099ef3c05bf9b41af2de0b18c"}
Jul 23 13:54:15.877302 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.877260    2564 scope.go:117] "RemoveContainer" containerID="901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17"
Jul 23 13:54:15.886701 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.886683    2564 scope.go:117] "RemoveContainer" containerID="901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17"
Jul 23 13:54:15.886950 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:54:15.886927    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17\": container with ID starting with 901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17 not found: ID does not exist" containerID="901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17"
Jul 23 13:54:15.887052 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.886953    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17"} err="failed to get container status \"901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17\": rpc error: code = NotFound desc = could not find container \"901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17\": container with ID starting with 901a58a1823068fc33d62579444fa7b1acd5285c9fec3b722e9bb76d12318f17 not found: ID does not exist"
Jul 23 13:54:15.899560 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.899536    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"]
Jul 23 13:54:15.903832 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.903809    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g"]
Jul 23 13:54:15.945384 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.945310    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-dshm\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:15.945384 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.945335    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgh67\" (UniqueName: \"kubernetes.io/projected/24746d4e-bc23-4682-8508-a48143830cad-kube-api-access-bgh67\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:15.945384 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.945347    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24746d4e-bc23-4682-8508-a48143830cad-tls-certs\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:15.945384 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:15.945358    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24746d4e-bc23-4682-8508-a48143830cad-model-cache\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:17.769962 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:17.769929    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24746d4e-bc23-4682-8508-a48143830cad" path="/var/lib/kubelet/pods/24746d4e-bc23-4682-8508-a48143830cad/volumes"
Jul 23 13:54:19.152908 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.152872    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"]
Jul 23 13:54:19.153303 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.153289    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24746d4e-bc23-4682-8508-a48143830cad" containerName="main"
Jul 23 13:54:19.153347 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.153305    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24746d4e-bc23-4682-8508-a48143830cad" containerName="main"
Jul 23 13:54:19.153395 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.153385    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24746d4e-bc23-4682-8508-a48143830cad" containerName="main"
Jul 23 13:54:19.157698 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.157679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:19.160074 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.160059    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:54:19.163851 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.163828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"]
Jul 23 13:54:19.273727 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.273693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e314dab4-3296-4c66-b873-197e4d00b8b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r\" (UID: \"e314dab4-3296-4c66-b873-197e4d00b8b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:19.374186 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.374149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e314dab4-3296-4c66-b873-197e4d00b8b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r\" (UID: \"e314dab4-3296-4c66-b873-197e4d00b8b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:19.374761 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.374741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e314dab4-3296-4c66-b873-197e4d00b8b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r\" (UID: \"e314dab4-3296-4c66-b873-197e4d00b8b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:19.469919 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.469888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:19.606665 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.606622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"]
Jul 23 13:54:19.612204 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:54:19.612168    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode314dab4_3296_4c66_b873_197e4d00b8b1.slice/crio-b5f2cfbad478ce821ddde33efedcf799ba7ab22eed0a96fc290a7f61f54d197f WatchSource:0}: Error finding container b5f2cfbad478ce821ddde33efedcf799ba7ab22eed0a96fc290a7f61f54d197f: Status 404 returned error can't find the container with id b5f2cfbad478ce821ddde33efedcf799ba7ab22eed0a96fc290a7f61f54d197f
Jul 23 13:54:19.898832 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:19.898790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r" event={"ID":"e314dab4-3296-4c66-b873-197e4d00b8b1","Type":"ContainerStarted","Data":"b5f2cfbad478ce821ddde33efedcf799ba7ab22eed0a96fc290a7f61f54d197f"}
Jul 23 13:54:20.634274 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:20.634175    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-690897/rate-test-model-690897-kserve-7c55dc85bc-f4q5g" podUID="24746d4e-bc23-4682-8508-a48143830cad" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 23 13:54:20.904797 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:20.904709    2564 generic.go:356] "Generic (PLEG): container finished" podID="e314dab4-3296-4c66-b873-197e4d00b8b1" containerID="9d2c1bf9e527b108eb78070808be0857af3bb1543e9eaad3750cd10ead0a816a" exitCode=0
Jul 23 13:54:20.904965 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:20.904788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r" event={"ID":"e314dab4-3296-4c66-b873-197e4d00b8b1","Type":"ContainerDied","Data":"9d2c1bf9e527b108eb78070808be0857af3bb1543e9eaad3750cd10ead0a816a"}
Jul 23 13:54:22.047778 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.047755    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:22.197886 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.197783    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e314dab4-3296-4c66-b873-197e4d00b8b1-maas-api-service-ca\") pod \"e314dab4-3296-4c66-b873-197e4d00b8b1\" (UID: \"e314dab4-3296-4c66-b873-197e4d00b8b1\") "
Jul 23 13:54:22.198137 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.198114    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e314dab4-3296-4c66-b873-197e4d00b8b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e314dab4-3296-4c66-b873-197e4d00b8b1" (UID: "e314dab4-3296-4c66-b873-197e4d00b8b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:54:22.299331 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.299298    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e314dab4-3296-4c66-b873-197e4d00b8b1-maas-api-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:22.915414 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.915376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r" event={"ID":"e314dab4-3296-4c66-b873-197e4d00b8b1","Type":"ContainerDied","Data":"b5f2cfbad478ce821ddde33efedcf799ba7ab22eed0a96fc290a7f61f54d197f"}
Jul 23 13:54:22.915414 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.915400    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"
Jul 23 13:54:22.915617 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:22.915431    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5f2cfbad478ce821ddde33efedcf799ba7ab22eed0a96fc290a7f61f54d197f"
Jul 23 13:54:29.616064 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.616033    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"]
Jul 23 13:54:29.616520 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.616264    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" podUID="182aec16-b775-419e-8d4d-8a62e936f033" containerName="maas-api" containerID="cri-o://1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8" gracePeriod=30
Jul 23 13:54:29.876026 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.875971    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:54:29.949146 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.949114    2564 generic.go:356] "Generic (PLEG): container finished" podID="182aec16-b775-419e-8d4d-8a62e936f033" containerID="1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8" exitCode=0
Jul 23 13:54:29.949282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.949152    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"
Jul 23 13:54:29.949282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.949221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" event={"ID":"182aec16-b775-419e-8d4d-8a62e936f033","Type":"ContainerDied","Data":"1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8"}
Jul 23 13:54:29.949282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.949257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr" event={"ID":"182aec16-b775-419e-8d4d-8a62e936f033","Type":"ContainerDied","Data":"a11c8c3d08366a23ecd70562ad760defa35b34a137ece35b3388680ddc7fb41c"}
Jul 23 13:54:29.949282 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.949278    2564 scope.go:117] "RemoveContainer" containerID="1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8"
Jul 23 13:54:29.954049 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.954029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/182aec16-b775-419e-8d4d-8a62e936f033-openshift-service-ca\") pod \"182aec16-b775-419e-8d4d-8a62e936f033\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") "
Jul 23 13:54:29.954160 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.954062    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9lh4\" (UniqueName: \"kubernetes.io/projected/182aec16-b775-419e-8d4d-8a62e936f033-kube-api-access-q9lh4\") pod \"182aec16-b775-419e-8d4d-8a62e936f033\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") "
Jul 23 13:54:29.954160 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.954106    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls\") pod \"182aec16-b775-419e-8d4d-8a62e936f033\" (UID: \"182aec16-b775-419e-8d4d-8a62e936f033\") "
Jul 23 13:54:29.954450 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.954423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/182aec16-b775-419e-8d4d-8a62e936f033-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "182aec16-b775-419e-8d4d-8a62e936f033" (UID: "182aec16-b775-419e-8d4d-8a62e936f033"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:54:29.956074 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.956048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "182aec16-b775-419e-8d4d-8a62e936f033" (UID: "182aec16-b775-419e-8d4d-8a62e936f033"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:54:29.956222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.956205    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/182aec16-b775-419e-8d4d-8a62e936f033-kube-api-access-q9lh4" (OuterVolumeSpecName: "kube-api-access-q9lh4") pod "182aec16-b775-419e-8d4d-8a62e936f033" (UID: "182aec16-b775-419e-8d4d-8a62e936f033"). InnerVolumeSpecName "kube-api-access-q9lh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:29.958240 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.958216    2564 scope.go:117] "RemoveContainer" containerID="1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8"
Jul 23 13:54:29.958547 ip-10-0-132-73 kubenswrapper[2564]: E0723 13:54:29.958525    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8\": container with ID starting with 1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8 not found: ID does not exist" containerID="1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8"
Jul 23 13:54:29.958612 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:29.958554    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8"} err="failed to get container status \"1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8\": rpc error: code = NotFound desc = could not find container \"1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8\": container with ID starting with 1de164a42857713d6c944205b28cf8798d87f52079f1d0659f09c30014bdc2d8 not found: ID does not exist"
Jul 23 13:54:30.054639 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:30.054606    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/182aec16-b775-419e-8d4d-8a62e936f033-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:30.054639 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:30.054636    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9lh4\" (UniqueName: \"kubernetes.io/projected/182aec16-b775-419e-8d4d-8a62e936f033-kube-api-access-q9lh4\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:30.054817 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:30.054650    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/182aec16-b775-419e-8d4d-8a62e936f033-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:30.272126 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:30.272096    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"]
Jul 23 13:54:30.276354 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:30.276331    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5ddc60-86d8886849-7nclr"]
Jul 23 13:54:31.770422 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:31.770390    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="182aec16-b775-419e-8d4d-8a62e936f033" path="/var/lib/kubelet/pods/182aec16-b775-419e-8d4d-8a62e936f033/volumes"
Jul 23 13:54:34.288516 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:34.288484    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"]
Jul 23 13:54:34.292514 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:34.292491    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5ddc60-2lp6r"]
Jul 23 13:54:35.770132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:35.770102    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e314dab4-3296-4c66-b873-197e4d00b8b1" path="/var/lib/kubelet/pods/e314dab4-3296-4c66-b873-197e4d00b8b1/volumes"
Jul 23 13:54:41.370955 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.370917    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"]
Jul 23 13:54:41.371564 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.371540    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e314dab4-3296-4c66-b873-197e4d00b8b1" containerName="revoke-keys"
Jul 23 13:54:41.371646 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.371567    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e314dab4-3296-4c66-b873-197e4d00b8b1" containerName="revoke-keys"
Jul 23 13:54:41.371646 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.371610    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="182aec16-b775-419e-8d4d-8a62e936f033" containerName="maas-api"
Jul 23 13:54:41.371646 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.371619    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="182aec16-b775-419e-8d4d-8a62e936f033" containerName="maas-api"
Jul 23 13:54:41.371803 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.371718    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e314dab4-3296-4c66-b873-197e4d00b8b1" containerName="revoke-keys"
Jul 23 13:54:41.371803 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.371735    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="182aec16-b775-419e-8d4d-8a62e936f033" containerName="maas-api"
Jul 23 13:54:41.376453 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.376427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:41.378808 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.378788    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vp6nn\""
Jul 23 13:54:41.383609 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.383583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"]
Jul 23 13:54:41.437906 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.437853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94687531-b902-40bd-8029-396a3e67b94a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-690897-zgwh2\" (UID: \"94687531-b902-40bd-8029-396a3e67b94a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:41.539271 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.539236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94687531-b902-40bd-8029-396a3e67b94a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-690897-zgwh2\" (UID: \"94687531-b902-40bd-8029-396a3e67b94a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:41.539904 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.539884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94687531-b902-40bd-8029-396a3e67b94a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-690897-zgwh2\" (UID: \"94687531-b902-40bd-8029-396a3e67b94a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:41.688503 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.688466    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:41.828469 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:41.828442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"]
Jul 23 13:54:41.830276 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:54:41.830236    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94687531_b902_40bd_8029_396a3e67b94a.slice/crio-218b5d97cf46655a69806cad5e168b71896d260b632aa4f3ec6a76d7994c6855 WatchSource:0}: Error finding container 218b5d97cf46655a69806cad5e168b71896d260b632aa4f3ec6a76d7994c6855: Status 404 returned error can't find the container with id 218b5d97cf46655a69806cad5e168b71896d260b632aa4f3ec6a76d7994c6855
Jul 23 13:54:42.008418 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:42.008387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2" event={"ID":"94687531-b902-40bd-8029-396a3e67b94a","Type":"ContainerStarted","Data":"218b5d97cf46655a69806cad5e168b71896d260b632aa4f3ec6a76d7994c6855"}
Jul 23 13:54:43.021387 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:43.021350    2564 generic.go:356] "Generic (PLEG): container finished" podID="94687531-b902-40bd-8029-396a3e67b94a" containerID="d7f690a938ada084bee481527180c72e2df079d680b6f0e16c03404ddfdd3d70" exitCode=0
Jul 23 13:54:43.021821 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:43.021440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2" event={"ID":"94687531-b902-40bd-8029-396a3e67b94a","Type":"ContainerDied","Data":"d7f690a938ada084bee481527180c72e2df079d680b6f0e16c03404ddfdd3d70"}
Jul 23 13:54:44.156944 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:44.156918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:44.264729 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:44.264693    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94687531-b902-40bd-8029-396a3e67b94a-maas-api-service-ca\") pod \"94687531-b902-40bd-8029-396a3e67b94a\" (UID: \"94687531-b902-40bd-8029-396a3e67b94a\") "
Jul 23 13:54:44.265085 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:44.265063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94687531-b902-40bd-8029-396a3e67b94a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94687531-b902-40bd-8029-396a3e67b94a" (UID: "94687531-b902-40bd-8029-396a3e67b94a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:54:44.365628 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:44.365541    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94687531-b902-40bd-8029-396a3e67b94a-maas-api-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:45.032469 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:45.032441    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"
Jul 23 13:54:45.032469 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:45.032447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2" event={"ID":"94687531-b902-40bd-8029-396a3e67b94a","Type":"ContainerDied","Data":"218b5d97cf46655a69806cad5e168b71896d260b632aa4f3ec6a76d7994c6855"}
Jul 23 13:54:45.032688 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:45.032490    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="218b5d97cf46655a69806cad5e168b71896d260b632aa4f3ec6a76d7994c6855"
Jul 23 13:54:51.820072 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:51.820040    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"]
Jul 23 13:54:51.820459 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:51.820256    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" podUID="ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" containerName="maas-api" containerID="cri-o://fb975e05356f9d62be6b937a2aadf1af1aa12a99e77cb8f428b79b503077fad6" gracePeriod=30
Jul 23 13:54:52.066369 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.066342    2564 generic.go:356] "Generic (PLEG): container finished" podID="ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" containerID="fb975e05356f9d62be6b937a2aadf1af1aa12a99e77cb8f428b79b503077fad6" exitCode=0
Jul 23 13:54:52.066502 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.066406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" event={"ID":"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad","Type":"ContainerDied","Data":"fb975e05356f9d62be6b937a2aadf1af1aa12a99e77cb8f428b79b503077fad6"}
Jul 23 13:54:52.066502 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.066457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m" event={"ID":"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad","Type":"ContainerDied","Data":"15833fd573b84bdb45482a2647576ecca80a6b2c1ea56163ac53acaf58689a6a"}
Jul 23 13:54:52.066502 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.066475    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15833fd573b84bdb45482a2647576ecca80a6b2c1ea56163ac53acaf58689a6a"
Jul 23 13:54:52.067228 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.067207    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:54:52.136616 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.136544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7vp6\" (UniqueName: \"kubernetes.io/projected/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-kube-api-access-m7vp6\") pod \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") "
Jul 23 13:54:52.136616 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.136580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-openshift-service-ca\") pod \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") "
Jul 23 13:54:52.136790 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.136636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls\") pod \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\" (UID: \"ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad\") "
Jul 23 13:54:52.136986 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.136959    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" (UID: "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:54:52.138642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.138610    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" (UID: "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:54:52.138642 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.138628    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-kube-api-access-m7vp6" (OuterVolumeSpecName: "kube-api-access-m7vp6") pod "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" (UID: "ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad"). InnerVolumeSpecName "kube-api-access-m7vp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:54:52.237597 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.237559    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7vp6\" (UniqueName: \"kubernetes.io/projected/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-kube-api-access-m7vp6\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:52.237597 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.237584    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-openshift-service-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:52.237597 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:52.237599    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad-maas-api-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
Jul 23 13:54:53.071182 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:53.071152    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"
Jul 23 13:54:53.092084 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:53.092056    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"]
Jul 23 13:54:53.095966 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:53.095943    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-690897-54b445cc49-2lg5m"]
Jul 23 13:54:53.769293 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:53.769251    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" path="/var/lib/kubelet/pods/ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad/volumes"
Jul 23 13:54:56.458286 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:56.458252    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"]
Jul 23 13:54:56.463150 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:56.463126    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-690897-zgwh2"]
Jul 23 13:54:57.769793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:54:57.769761    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94687531-b902-40bd-8029-396a3e67b94a" path="/var/lib/kubelet/pods/94687531-b902-40bd-8029-396a3e67b94a/volumes"
Jul 23 13:55:09.561586 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:09.561504    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nhkkj_b6bfab74-6fdd-4149-8eb8-d35d3b11c0df/manager/0.log"
Jul 23 13:55:09.685691 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:09.685661    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84c5ffc4c4-82mpg_c5875e6e-cf6b-495a-952f-6598b6c8fe2b/manager/0.log"
Jul 23 13:55:10.103878 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:10.103826    2564 scope.go:117] "RemoveContainer" containerID="fb975e05356f9d62be6b937a2aadf1af1aa12a99e77cb8f428b79b503077fad6"
Jul 23 13:55:10.243568 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:10.243543    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-rsl2b_5796ad6d-2219-44cb-9b70-dec85d3a0f88/copy-manifests/0.log"
Jul 23 13:55:10.255942 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:10.255920    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-rsl2b_5796ad6d-2219-44cb-9b70-dec85d3a0f88/manager/0.log"
Jul 23 13:55:10.742700 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:10.742669    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-ffc4758df-mk7fg_13c86ffb-716a-45f1-9370-5f88818f203f/maas-api/0.log"
Jul 23 13:55:10.996714 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:10.996628    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746905-nz779_2b636e20-c94d-44c2-8c43-2edf977ba89a/cleanup/0.log"
Jul 23 13:55:11.114222 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:11.114187    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9ft86_f5ef7262-5871-48a3-b72a-a827bf1bc926/postgres/0.log"
Jul 23 13:55:13.619001 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:13.618970    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7tgbb_30e4eec3-a060-434c-9a9c-2b445a24c694/manager/0.log"
Jul 23 13:55:15.335748 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:15.335708    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mbqjh_0278fb3d-0e02-4662-9ffa-6e20c7f6499a/payload-pre-processing/0.log"
Jul 23 13:55:15.460849 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:15.460817    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4w6p5_35268edc-9f0e-4c61-8def-55e1609d828c/payload-processing/0.log"
Jul 23 13:55:15.580535 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:15.580508    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6997dd8868-5k8xv_30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1/router/0.log"
Jul 23 13:55:15.937153 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:15.937112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5lqm9_1909a2d8-f252-4505-a0fe-603571a1e2d6/main/0.log"
Jul 23 13:55:16.530740 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:16.530714    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-2rjn8_fc7af28f-ff83-4836-8b12-ecd7d815f30b/main/0.log"
Jul 23 13:55:25.436786 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:25.436753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xzsbl_3b1320da-c6b8-408a-b1a2-19d69a83827e/global-pull-secret-syncer/0.log"
Jul 23 13:55:25.562616 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:25.562589    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qlfxh_a174b199-278f-49d9-b8e5-d712bccd443d/konnectivity-agent/0.log"
Jul 23 13:55:25.630588 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:25.630557    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-73.ec2.internal_b09537983e90b5d8296ae811288f4fa5/haproxy/0.log"
Jul 23 13:55:30.137163 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:30.137119    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7tgbb_30e4eec3-a060-434c-9a9c-2b445a24c694/manager/0.log"
Jul 23 13:55:32.379241 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:32.379212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-s6klq_86887492-740c-4701-933e-9c22f54ea2c2/cluster-monitoring-operator/0.log"
Jul 23 13:55:32.808326 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:32.808299    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6d9h_3f2b2ea9-02d5-4ece-b335-d34afa2eff8d/node-exporter/0.log"
Jul 23 13:55:32.833459 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:32.833439    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6d9h_3f2b2ea9-02d5-4ece-b335-d34afa2eff8d/kube-rbac-proxy/0.log"
Jul 23 13:55:32.863030 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:32.863005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6d9h_3f2b2ea9-02d5-4ece-b335-d34afa2eff8d/init-textfile/0.log"
Jul 23 13:55:34.799164 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:34.799136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-4hjgg_056168a5-4598-46b4-9073-6f5545103899/networking-console-plugin/0.log"
Jul 23 13:55:35.385849 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.385821    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/1.log"
Jul 23 13:55:35.390756 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.390735    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n77m8_3a6a6f39-bd9e-4f3c-8498-3eecb2b113ca/console-operator/2.log"
Jul 23 13:55:35.808999 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.808965    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"]
Jul 23 13:55:35.809368 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.809338    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" containerName="maas-api"
Jul 23 13:55:35.809368 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.809348    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" containerName="maas-api"
Jul 23 13:55:35.809368 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.809356    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94687531-b902-40bd-8029-396a3e67b94a" containerName="revoke-keys"
Jul 23 13:55:35.809368 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.809362    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94687531-b902-40bd-8029-396a3e67b94a" containerName="revoke-keys"
Jul 23 13:55:35.809503 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.809422    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea7a3019-4d6f-4949-9d4c-8a8fd27f8fad" containerName="maas-api"
Jul 23 13:55:35.809503 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.809434    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94687531-b902-40bd-8029-396a3e67b94a" containerName="revoke-keys"
Jul 23 13:55:35.812336 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.812320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:35.814634 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.814612    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gps8k\"/\"kube-root-ca.crt\""
Jul 23 13:55:35.815245 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.815227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gps8k\"/\"openshift-service-ca.crt\""
Jul 23 13:55:35.815316 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.815227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gps8k\"/\"default-dockercfg-6wd9n\""
Jul 23 13:55:35.825593 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.825573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"]
Jul 23 13:55:35.899599 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.899564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-sys\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:35.899780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.899657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-lib-modules\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:35.899780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.899689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-podres\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:35.899780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.899722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxpv7\" (UniqueName: \"kubernetes.io/projected/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-kube-api-access-mxpv7\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:35.899780 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:35.899754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-proc\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.000672 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-sys\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.000848 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-lib-modules\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.000848 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-podres\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.000848 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxpv7\" (UniqueName: \"kubernetes.io/projected/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-kube-api-access-mxpv7\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.000848 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-sys\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.000848 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-proc\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.001065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-lib-modules\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.001065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-podres\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.001065 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.000929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-proc\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.009102 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.009079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxpv7\" (UniqueName: \"kubernetes.io/projected/7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3-kube-api-access-mxpv7\") pod \"perf-node-gather-daemonset-9wxcf\" (UID: \"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3\") " pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.122338 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.122250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:36.254849 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.254794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"]
Jul 23 13:55:36.257064 ip-10-0-132-73 kubenswrapper[2564]: W0723 13:55:36.257038    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ce4b1e7_58b4_4e82_8fd4_9af9fb4d9ab3.slice/crio-56c2e42f88fd9a988923cbc22e256c64dfa6b995bcf16a22eec8610fc6600fb0 WatchSource:0}: Error finding container 56c2e42f88fd9a988923cbc22e256c64dfa6b995bcf16a22eec8610fc6600fb0: Status 404 returned error can't find the container with id 56c2e42f88fd9a988923cbc22e256c64dfa6b995bcf16a22eec8610fc6600fb0
Jul 23 13:55:36.284325 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.284298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf" event={"ID":"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3","Type":"ContainerStarted","Data":"56c2e42f88fd9a988923cbc22e256c64dfa6b995bcf16a22eec8610fc6600fb0"}
Jul 23 13:55:36.720107 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:36.720079    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-vn2ds_bbea7dc9-25d3-47ee-913b-aaee7899a192/volume-data-source-validator/0.log"
Jul 23 13:55:37.290627 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:37.290590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf" event={"ID":"7ce4b1e7-58b4-4e82-8fd4-9af9fb4d9ab3","Type":"ContainerStarted","Data":"b69e2fc31cbbb9f10c0b83da9f8307cfa9ce62f58b09a792aa2aca0341bea171"}
Jul 23 13:55:37.291124 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:37.290716    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:37.309070 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:37.309023    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf" podStartSLOduration=2.309008754 podStartE2EDuration="2.309008754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:55:37.306998907 +0000 UTC m=+2908.044232223" watchObservedRunningTime="2026-07-23 13:55:37.309008754 +0000 UTC m=+2908.046242072"
Jul 23 13:55:37.819319 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:37.819291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8m6l_de2b7efa-7af3-4906-a5cc-7b5a0e1da935/dns/0.log"
Jul 23 13:55:37.843202 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:37.843177    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8m6l_de2b7efa-7af3-4906-a5cc-7b5a0e1da935/kube-rbac-proxy/0.log"
Jul 23 13:55:37.933707 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:37.933681    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mfjz8_85c3bafa-fdcd-4ebc-a8a5-829241bf2256/dns-node-resolver/0.log"
Jul 23 13:55:38.583504 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:38.583475    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vjk79_0fb22276-523d-40bb-a08d-797dee02ef5b/node-ca/0.log"
Jul 23 13:55:39.929798 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:39.929766    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mbqjh_0278fb3d-0e02-4662-9ffa-6e20c7f6499a/payload-pre-processing/0.log"
Jul 23 13:55:39.964115 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:39.964090    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4w6p5_35268edc-9f0e-4c61-8def-55e1609d828c/payload-processing/0.log"
Jul 23 13:55:39.989508 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:39.989484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6997dd8868-5k8xv_30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1/router/0.log"
Jul 23 13:55:40.708263 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:40.708220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5s2mz_db4c1c22-a985-480c-8e0c-c50b8580ddea/serve-healthcheck-canary/0.log"
Jul 23 13:55:41.219742 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:41.219714    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-z5s7f_49c7dd86-9953-44df-8b97-18c3e13f3396/insights-operator/0.log"
Jul 23 13:55:41.221387 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:41.221367    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-z5s7f_49c7dd86-9953-44df-8b97-18c3e13f3396/insights-operator/1.log"
Jul 23 13:55:41.396879 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:41.396836    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szvzt_56eb01a4-e992-42b3-9569-9233dd796221/kube-rbac-proxy/0.log"
Jul 23 13:55:41.419526 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:41.419500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szvzt_56eb01a4-e992-42b3-9569-9233dd796221/exporter/0.log"
Jul 23 13:55:41.443347 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:41.443326    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szvzt_56eb01a4-e992-42b3-9569-9233dd796221/extractor/0.log"
Jul 23 13:55:43.305413 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:43.305385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gps8k/perf-node-gather-daemonset-9wxcf"
Jul 23 13:55:43.734008 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:43.733978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nhkkj_b6bfab74-6fdd-4149-8eb8-d35d3b11c0df/manager/0.log"
Jul 23 13:55:43.850949 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:43.850916    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84c5ffc4c4-82mpg_c5875e6e-cf6b-495a-952f-6598b6c8fe2b/manager/0.log"
Jul 23 13:55:44.105942 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:44.105847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-rsl2b_5796ad6d-2219-44cb-9b70-dec85d3a0f88/manager/0.log"
Jul 23 13:55:44.127542 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:44.127517    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779cfbfdf-rsl2b_5796ad6d-2219-44cb-9b70-dec85d3a0f88/copy-manifests/0.log"
Jul 23 13:55:45.679088 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:45.679058    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-789dbd6fbb-c9d5z_675179c4-d719-4187-b3de-95ccbc13cacc/manager/0.log"
Jul 23 13:55:46.587965 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:46.587939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mbqjh_0278fb3d-0e02-4662-9ffa-6e20c7f6499a/payload-pre-processing/0.log"
Jul 23 13:55:46.610793 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:46.610766    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4w6p5_35268edc-9f0e-4c61-8def-55e1609d828c/payload-processing/0.log"
Jul 23 13:55:46.629513 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:46.629490    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6997dd8868-5k8xv_30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1/router/0.log"
Jul 23 13:55:48.174490 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:48.174461    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mbqjh_0278fb3d-0e02-4662-9ffa-6e20c7f6499a/payload-pre-processing/0.log"
Jul 23 13:55:48.195533 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:48.195503    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4w6p5_35268edc-9f0e-4c61-8def-55e1609d828c/payload-processing/0.log"
Jul 23 13:55:48.208748 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:48.208725    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6997dd8868-5k8xv_30bab3ae-5e53-40c4-b81d-2bf5f14ad9b1/router/0.log"
Jul 23 13:55:50.952136 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:50.952093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-gpdss_6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a/migrator/0.log"
Jul 23 13:55:50.971776 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:50.971755    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-gpdss_6e3f8f0c-afb2-49a7-b5f9-6f46c821c17a/graceful-termination/0.log"
Jul 23 13:55:51.329104 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:51.329027    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7wbhx_152c4a8b-63d7-4b29-aaf1-68c108337779/kube-storage-version-migrator-operator/1.log"
Jul 23 13:55:51.330232 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:51.330208    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-7wbhx_152c4a8b-63d7-4b29-aaf1-68c108337779/kube-storage-version-migrator-operator/0.log"
Jul 23 13:55:52.571405 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.571373    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/kube-multus-additional-cni-plugins/0.log"
Jul 23 13:55:52.593850 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.593822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/egress-router-binary-copy/0.log"
Jul 23 13:55:52.613017 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.613000    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/cni-plugins/0.log"
Jul 23 13:55:52.633097 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.633079    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/bond-cni-plugin/0.log"
Jul 23 13:55:52.653260 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.653243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/routeoverride-cni/0.log"
Jul 23 13:55:52.672620 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.672604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/whereabouts-cni-bincopy/0.log"
Jul 23 13:55:52.693573 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.693553    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7n2m_3d86db36-c12c-4fcc-bb73-98670e8c48d8/whereabouts-cni/0.log"
Jul 23 13:55:52.963132 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.963103    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m6kfn_45386175-ba18-43a4-bcc6-e7a34f265e08/kube-multus/0.log"
Jul 23 13:55:52.982960 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:52.982936    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8dz4q_d17da8d2-de85-43fb-ae9d-ba765c9a330b/network-metrics-daemon/0.log"
Jul 23 13:55:53.001545 ip-10-0-132-73 kubenswrapper[2564]: I0723 13:55:53.001522    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8dz4q_d17da8d2-de85-43fb-ae9d-ba765c9a330b/kube-rbac-proxy/0.log"