Jul 06 19:23:43.916426 ip-10-0-140-61 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:23:43.916436 ip-10-0-140-61 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:23:43.916443 ip-10-0-140-61 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:23:43.916666 ip-10-0-140-61 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:23:53.932155 ip-10-0-140-61 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:23:53.932172 ip-10-0-140-61 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ed8a177623334b4b91c19c1e48d694bf --
Jul 06 19:25:59.683165 ip-10-0-140-61 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:26:00.184967 ip-10-0-140-61 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:26:00.184967 ip-10-0-140-61 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:26:00.184967 ip-10-0-140-61 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:26:00.184967 ip-10-0-140-61 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:26:00.184967 ip-10-0-140-61 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:26:00.186222 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.185051    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:26:00.192122 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192103    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:26:00.192122 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192121    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:26:00.192122 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192124    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192128    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192131    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192134    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192137    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192139    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192142    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192145    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192147    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192150    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192152    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192155    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192158    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192160    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192169    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192172    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192175    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192177    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192180    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:26:00.192217 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192182    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192186    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192189    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192191    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192194    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192197    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192199    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192202    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192205    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192207    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192210    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192212    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192214    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192218    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192222    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192227    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192230    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192233    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192236    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192238    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:26:00.192658 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192241    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192245    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192248    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192251    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192254    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192257    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192259    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192262    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192265    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192267    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192270    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192272    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192275    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192278    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192282    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192285    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192288    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192291    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192294    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:26:00.193155 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192296    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192299    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192301    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192304    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192307    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192310    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192313    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192317    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192320    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192323    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192326    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192329    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192332    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192335    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192337    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192340    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192342    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192345    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192347    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:26:00.193622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192350    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192352    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192354    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192357    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192359    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192363    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192366    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192368    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192371    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192375    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192377    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192380    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192383    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192385    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192388    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192390    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192393    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192395    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192397    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.192400    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:26:00.194094 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193133    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193140    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193143    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193145    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193147    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193152    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193154    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193157    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193160    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193163    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193165    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193168    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193171    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193173    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193176    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193178    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193181    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193183    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193186    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193188    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:26:00.194583 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193191    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193195    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193197    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193200    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193203    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193206    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193208    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193211    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193213    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193216    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193218    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193221    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193223    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193226    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193228    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193231    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193233    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193235    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193238    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:26:00.195091 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193241    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193244    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193246    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193248    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193251    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193253    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193256    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193258    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193262    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193265    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193267    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193269    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193272    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193285    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193288    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193291    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193293    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193296    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193299    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193301    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:26:00.195558 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193304    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193306    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193308    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193311    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193313    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193316    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193319    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193321    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193325    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193329    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193332    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193335    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193339    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193342    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193345    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193348    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193350    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193353    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193356    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:26:00.196062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193358    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193361    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193364    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193368    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193371    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193374    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193378    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193382    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193385    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193387    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193390    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193392    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193395    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193398    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193400    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193403    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193405    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193408    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193410    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:26:00.196529 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193413    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193415    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193799    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193804    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193807    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193825    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193829    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193832    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193835    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193838    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193840    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193843    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193845    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193848    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193851    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193853    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193856    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193859    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193861    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:26:00.197003 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193864    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193869    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193872    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193876    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193880    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193883    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193886    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193889    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193891    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193894    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193897    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193899    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193902    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193905    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193907    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193910    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193913    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193916    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193919    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:26:00.197483 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193921    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193924    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193926    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193929    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193932    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193935    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193938    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193940    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193942    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193945    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193947    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193950    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193952    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193954    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193957    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193960    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193962    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193966    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193968    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193970    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193973    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:26:00.198023 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193975    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193977    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193980    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193982    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193984    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193987    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193989    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193992    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193994    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193997    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.193999    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194002    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194005    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194007    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194010    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194012    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194017    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194020    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194022    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194024    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:26:00.198531 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194026    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194029    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194031    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194034    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194036    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194039    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194041    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194045    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194047    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194050    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194052    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194054    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194057    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194061    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194063    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194066    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194068    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194071    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194073    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:26:00.199029 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194077    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194080    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194083    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194173    2552 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194184    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194192    2552 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194198    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194206    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194211    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194216    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194220    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194224    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194226    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194230    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194233    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194236    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194239    2552 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194242    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194245    2552 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194248    2552 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194251    2552 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194256    2552 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194258    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194261    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:26:00.199532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194265    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194268    2552 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194276    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194279    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194282    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194286    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194289    2552 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194292    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194295    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194297    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194300    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194304    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194307    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194310    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194313    2552 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194315    2552 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194319    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194323    2552 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194326    2552 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194329    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194333    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194336    2552 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194340    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194342    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194345    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:26:00.200120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194348    2552 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194351    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194354    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194357    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194360    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194363    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194365    2552 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194368    2552 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194372    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194376    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194379    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194382    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194386    2552 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194389    2552 flags.go:64] FLAG: --help="false"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194391    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-140-61.ec2.internal"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194395    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194397    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194400    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194403    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194407    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194410    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194412    2552 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194415    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:26:00.200740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194418    2552 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194421    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194424    2552 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194427    2552 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194430    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194433    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194436    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194438    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194441    2552 flags.go:64] FLAG: --lock-file=""
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194444    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194447    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194450    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194456    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194458    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194461    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194464    2552 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194467    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194470    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194474    2552 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194476    2552 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194481    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194484    2552 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194488    2552 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194491    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194493    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:26:00.201362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194496    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194499    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194502    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194505    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194507    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194514    2552 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194517    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194520    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194523    2552 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194528    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194533    2552 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194536    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194539    2552 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194542    2552 flags.go:64] FLAG: --port="10250"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194545    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194549    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b0ed00eb3dbb0d6"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194552    2552 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194554    2552 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194557    2552 flags.go:64] FLAG: --register-node="true"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194560    2552 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194564    2552 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194567    2552 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194569    2552 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194572    2552 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194576    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:26:00.202013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194580    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194583    2552 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194586    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194589    2552 flags.go:64] FLAG: --runonce="false"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194592    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194595    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194598    2552 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194601    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194604    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194607    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194610    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194613    2552 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194616    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194618    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194621    2552 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194624    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194628    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194631    2552 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194634    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194640    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194643    2552 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194646    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194650    2552 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194653    2552 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194655    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:26:00.202610 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194658    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194661    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194664    2552 flags.go:64] FLAG: --v="2"
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194668    2552 flags.go:64] FLAG: --version="false"
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194672    2552 flags.go:64] FLAG: --vmodule=""
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194676    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.194679    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194797    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194801    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194804    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194808    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194827    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194830    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194833    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194837    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194840    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194843    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194845    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194848    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194851    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194854    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:26:00.203224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194857    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194859    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194863    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194866    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194869    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194872    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194874    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194877    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194879    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194882    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194884    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194887    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194889    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194892    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194895    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194897    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194899    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194902    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194906    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194910    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:26:00.203715 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194913    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194915    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194918    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194921    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194925    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194928    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194931    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194934    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194936    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194939    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194942    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194944    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194947    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194950    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194954    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194957    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194960    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194964    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194967    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:26:00.204259 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194970    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194973    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194975    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194978    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194980    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194983    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194985    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194988    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194990    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194992    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194995    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.194998    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195000    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195003    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195005    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195008    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195010    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195013    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195015    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195018    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:26:00.204722 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195020    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195023    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195027    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195030    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195033    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195035    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195038    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195042    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195045    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195048    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195051    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195054    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195056    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195059    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195061    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195064    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195066    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195069    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195071    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195073    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:26:00.205224 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195076    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195078    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195081    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195083    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195086    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.195088    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.195794    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.203012    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.203027    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.203928    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.203937    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.203995    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204002    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204006    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:26:00.205705 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204011    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204014    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204017    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204020    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204023    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204026    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204029    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204032    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204034    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204037    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204040    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204042    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204046    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204048    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204051    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204053    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204056    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204059    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204061    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204063    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:26:00.206144 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204066    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204068    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204071    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204073    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204076    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204078    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204082    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204085    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204088    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204091    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204094    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204098    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204102    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204106    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204110    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204115    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204118    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204120    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204123    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204126    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:26:00.206622 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204128    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204131    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204133    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204136    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204139    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204141    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204144    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204146    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204148    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204151    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204154    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204156    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204158    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204161    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204163    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204166    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204168    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204171    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204174    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204178    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:26:00.207112 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204182    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204186    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204189    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204192    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204194    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204197    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204200    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204202    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204205    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204208    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204210    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204212    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204215    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204217    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204219    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204222    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204225    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204228    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204230    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:26:00.207590 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204233    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204235    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204238    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204240    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204243    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204245    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204248    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204250    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204253    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204255    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204257    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204262    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204265    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204269    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204273    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204275    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:26:00.208062 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204278    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.204283    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204405    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204409    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204413    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204415    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204418    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204420    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204423    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204426    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204428    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204432    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204435    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204438    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:26:00.208444 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204440    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204443    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204445    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204448    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204450    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204453    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204456    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204459    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204462    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204465    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204468    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204471    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204474    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204476    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204479    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204482    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204485    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204488    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204490    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:26:00.208784 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204494    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204497    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204499    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204502    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204504    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204506    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204509    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204512    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204514    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204517    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204519    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204522    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204524    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204527    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204529    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204532    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204534    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204537    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204539    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204541    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:26:00.209371 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204544    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204546    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204549    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204551    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204553    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204556    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204558    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204561    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204563    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204566    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204569    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204571    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204574    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204576    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204579    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204581    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204584    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204586    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204588    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204591    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:26:00.209875 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204593    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204595    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204598    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204600    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204603    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204606    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204608    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204611    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204613    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204633    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204637    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204640    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204643    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204646    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204649    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204653    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204656    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204659    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204662    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:26:00.210352 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204665    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204668    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204671    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204673    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204677    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204680    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204682    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204685    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:00.204687    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.204691    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.204806    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.207166    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.208685    2552 server.go:1019] "Starting client certificate rotation"
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.208780    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:26:00.210807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.208839    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:26:00.211452 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.211438    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:26:00.216438 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.216409    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:26:00.230464 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.230444    2552 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:26:00.232829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.232793    2552 log.go:25] "Validated CRI v1 image API"
Jul 06 19:26:00.233702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.233682    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:26:00.236300 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.236278    2552 fs.go:135] Filesystem UUIDs: map[712f983c-6303-4b4d-8a03-823bced55cf9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 862fe644-5fce-499a-a55f-b128f76c4268:/dev/nvme0n1p3]
Jul 06 19:26:00.236360 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.236300    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:26:00.241862 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.241725    2552 manager.go:216] Machine: {Timestamp:2026-07-06 19:26:00.24034225 +0000 UTC m=+0.396498788 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099280 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e49f992caad4bff0de00a9e5bafab SystemUUID:ec2e49f9-92ca-ad4b-ff0d-e00a9e5bafab BootID:ed8a1776-2333-4b4b-91c1-9c1e48d694bf Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:21:fa:67:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:21:fa:67:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:68:45:78:a2:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:26:00.241862 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.241855    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:26:00.241992 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.241953    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:26:00.242828 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.242794    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:26:00.246479 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.246444    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:26:00.246658 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.246484    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:26:00.247416 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.247403    2552 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:26:00.247470 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.247422    2552 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:26:00.247470 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.247439    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:26:00.248359 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.248345    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:26:00.249941 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.249928    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:26:00.254205 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254190    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:26:00.254413 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254400    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:26:00.254478 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254442    2552 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:26:00.254478 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254459    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:26:00.254478 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254474    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:26:00.254597 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254488    2552 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:26:00.254597 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254504    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:26:00.254921 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254907    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:26:00.254998 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.254931    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:26:00.257476 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.257456    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:26:00.259627 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.259614    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:26:00.259687 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.259645    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:26:00.261702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261691    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:26:00.261740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261707    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:26:00.261740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261713    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:26:00.261740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261719    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:26:00.261740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261728    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:26:00.261740 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261734    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:26:00.261908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261744    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:26:00.261908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261750    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:26:00.261908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261757    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:26:00.261908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261763    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:26:00.261908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261772    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:26:00.261908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.261777    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:26:00.262773 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.262751    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:26:00.262932 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.262916    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:26:00.266837 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.266797    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:26:00.266837 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.266804    2552 server.go:1268] "Started kubelet"
Jul 06 19:26:00.266983 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.266875    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:26:00.266983 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.266975    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:26:00.267453 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.267427    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:26:00.267453 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.267427    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:26:00.267668 ip-10-0-140-61 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:26:00.268215 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.268193    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:26:00.268888 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.268864    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:26:00.269510 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.269496    2552 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:26:00.269896 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.269879    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mb8rr"
Jul 06 19:26:00.274391 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.274375    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:26:00.276145 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.275117    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18bfc9e46639652d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-06 19:26:00.266769709 +0000 UTC m=+0.422926253,LastTimestamp:2026-07-06 19:26:00.266769709 +0000 UTC m=+0.422926253,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}"
Jul 06 19:26:00.276637 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.276621    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:26:00.276637 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.276632    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:26:00.276765 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.276747    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:00.277355 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.277329    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:26:00.277445 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.277331    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:26:00.277445 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.277415    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:26:00.277547 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.277536    2552 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:26:00.277547 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.277546    2552 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:26:00.277985 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.277969    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mb8rr"
Jul 06 19:26:00.279052 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279032    2552 factory.go:55] Registering systemd factory
Jul 06 19:26:00.279136 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279059    2552 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:26:00.279336 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279278    2552 factory.go:153] Registering CRI-O factory
Jul 06 19:26:00.279336 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279293    2552 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:26:00.279535 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279508    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:26:00.279581 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279534    2552 factory.go:103] Registering Raw factory
Jul 06 19:26:00.279581 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.279550    2552 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:26:00.280347 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.280333    2552 manager.go:349] Starting recovery of all containers
Jul 06 19:26:00.282114 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.282085    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:26:00.282252 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.282135    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:26:00.291336 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.291309    2552 manager.go:354] Recovery completed
Jul 06 19:26:00.295963 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.295942    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:00.297980 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.297962    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:00.298070 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.297999    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:00.298070 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.298015    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:00.298561 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.298546    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:26:00.298561 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.298560    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:26:00.298641 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.298565    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:00.298641 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.298577    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:26:00.299226 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.299211    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:00.299292 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.299241    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:00.299292 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.299254    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:00.299903 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.299889    2552 policy_none.go:49] "None policy: Start"
Jul 06 19:26:00.299946 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.299909    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:26:00.299946 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.299923    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:26:00.301073 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.301062    2552 policy_none.go:47] "Start"
Jul 06 19:26:00.350662 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.350449    2552 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:26:00.350789 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.350689    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:26:00.350789 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.350704    2552 server.go:87] "Starting device plugin registration server"
Jul 06 19:26:00.351027 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.351011    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:26:00.351097 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.351048    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:26:00.351176 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.351151    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:26:00.351280 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.351262    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:26:00.351280 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.351277    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:26:00.353302 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.353271    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:26:00.353405 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.353329    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:00.452164 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.452078    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:00.453449 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.453105    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:00.453449 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.453137    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:00.453449 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.453148    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:00.453449 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.453175    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-61.ec2.internal"
Jul 06 19:26:00.462498 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.462474    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-61.ec2.internal"
Jul 06 19:26:00.462556 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.462503    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-61.ec2.internal\": node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:00.469633 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.469600    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:26:00.470986 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.470967    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:26:00.471119 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.471004    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:26:00.471119 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.471028    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:26:00.471119 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.471064    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:26:00.473855 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:00.473838    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:26:00.475111 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:00.475096    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:01.800626 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.800590    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"]
Jul 06 19:26:01.800800 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.800687    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:01.802593 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.802578    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:01.802662 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.802608    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:01.802662 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.802619    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:01.804157 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.804145    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:01.804275 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:01.804255    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:01.804333 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.804270    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.804333 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.804321    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:01.804980 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.804963    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:01.805083 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.804990    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:01.805083 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.805014    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:01.805083 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.804993    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:01.805083 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.805029    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:01.805083 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.805044    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:01.806352 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.806333    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.806454 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.806361    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:26:01.807119 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.807103    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:26:01.807202 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.807134    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:26:01.807202 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.807147    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:26:01.808190 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.808175    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03ac6699bc87ac3abedcb3149dcf3083-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"03ac6699bc87ac3abedcb3149dcf3083\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.808229 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.808198    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/661ec5fbdc6dcb8f55ad5865580cfec0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"661ec5fbdc6dcb8f55ad5865580cfec0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.808229 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.808214    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/661ec5fbdc6dcb8f55ad5865580cfec0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"661ec5fbdc6dcb8f55ad5865580cfec0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.829775 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:01.829749    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-61.ec2.internal\" not found" node="ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.834238 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:01.834218    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-61.ec2.internal\" not found" node="ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.904531 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:01.904500    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:01.908877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.908856    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/661ec5fbdc6dcb8f55ad5865580cfec0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"661ec5fbdc6dcb8f55ad5865580cfec0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.908967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.908892    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03ac6699bc87ac3abedcb3149dcf3083-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"03ac6699bc87ac3abedcb3149dcf3083\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.908967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.908916    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/661ec5fbdc6dcb8f55ad5865580cfec0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"661ec5fbdc6dcb8f55ad5865580cfec0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.909062 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.908980    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/661ec5fbdc6dcb8f55ad5865580cfec0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"661ec5fbdc6dcb8f55ad5865580cfec0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.909062 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.908983    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/661ec5fbdc6dcb8f55ad5865580cfec0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"661ec5fbdc6dcb8f55ad5865580cfec0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:01.909062 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:01.908991    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03ac6699bc87ac3abedcb3149dcf3083-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"03ac6699bc87ac3abedcb3149dcf3083\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:02.005202 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.005124    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.105680 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.105638    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.134091 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.134063    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:02.139130 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.138837    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:02.206424 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.206382    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.306872 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.306786    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.407337 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.407300    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.436760 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.436736    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:26:02.437241 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.436888    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:26:02.507482 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.507449    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.509406 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.509383    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:21:01 +0000 UTC" deadline="2027-12-29 05:31:38.996009748 +0000 UTC"
Jul 06 19:26:02.509406 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.509407    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12970h5m36.486606118s"
Jul 06 19:26:02.608372 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.608319    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.654525 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.654497    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:26:02.695867 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:02.695830    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661ec5fbdc6dcb8f55ad5865580cfec0.slice/crio-93cbe5722463e50dc22471af747455e5cae6aafd6f967cddd3cda470a1e9122b WatchSource:0}: Error finding container 93cbe5722463e50dc22471af747455e5cae6aafd6f967cddd3cda470a1e9122b: Status 404 returned error can't find the container with id 93cbe5722463e50dc22471af747455e5cae6aafd6f967cddd3cda470a1e9122b
Jul 06 19:26:02.696205 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:02.696188    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ac6699bc87ac3abedcb3149dcf3083.slice/crio-c07be9a0f9b0e5d90cc57c4800e5083bd99ba28920600e02bdad6472d0c57c67 WatchSource:0}: Error finding container c07be9a0f9b0e5d90cc57c4800e5083bd99ba28920600e02bdad6472d0c57c67: Status 404 returned error can't find the container with id c07be9a0f9b0e5d90cc57c4800e5083bd99ba28920600e02bdad6472d0c57c67
Jul 06 19:26:02.701713 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.701686    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:26:02.703872 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.703831    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"03ac6699bc87ac3abedcb3149dcf3083","Type":"ContainerStarted","Data":"c07be9a0f9b0e5d90cc57c4800e5083bd99ba28920600e02bdad6472d0c57c67"}
Jul 06 19:26:02.705287 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.705216    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"661ec5fbdc6dcb8f55ad5865580cfec0","Type":"ContainerStarted","Data":"93cbe5722463e50dc22471af747455e5cae6aafd6f967cddd3cda470a1e9122b"}
Jul 06 19:26:02.708456 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:02.708439    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 06 19:26:02.758860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.757601    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:26:02.806876 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.806844    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:02.819157 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.819127    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:26:02.820137 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.820123    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 06 19:26:02.836283 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.836201    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:26:02.952829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:02.952797    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:26:03.484295 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.484263    2552 apiserver.go:52] "Watching apiserver"
Jul 06 19:26:03.492845 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.492812    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:26:03.493406 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.493364    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hkzgz","openshift-multus/multus-t2vsm","openshift-network-diagnostics/network-check-target-z9kcf","kube-system/konnectivity-agent-kf4nx","openshift-cluster-node-tuning-operator/tuned-zbzft","openshift-dns/node-resolver-9ttfp","openshift-image-registry/node-ca-vfk8t","openshift-multus/network-metrics-daemon-2msqc","openshift-network-operator/iptables-alerter-df7sv","openshift-ovn-kubernetes/ovnkube-node-pggbq","kube-system/global-pull-secret-syncer-x489d","kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"]
Jul 06 19:26:03.495414 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.495357    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.496900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.496756    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.499175 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.499030    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:03.499175 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.499095    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:03.499947 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.499883    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:26:03.499947 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.499889    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.500823 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.500791    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:26:03.501059 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.501044    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.501744 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.501724    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.501923 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.501905    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jghw7\""
Jul 06 19:26:03.502334 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.502124    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.502334 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.502141    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.502473 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.502342    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hw9n\""
Jul 06 19:26:03.502566 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.502550    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.503554 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.503535    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.507055    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.507450    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.508265    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.508386    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.508494    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.508534    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.508581    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.508981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.508627    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.509276 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.509103    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sgjxf\""
Jul 06 19:26:03.509276 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.509115    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnr5b\""
Jul 06 19:26:03.509379 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.509296    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.509454 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.509434    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvzlc\""
Jul 06 19:26:03.510294 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.510275    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.512525 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.511504    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.521147 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521121    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.521263 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.521241    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:03.521574 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-var-lib-kubelet\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.521574 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521538    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-host\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.521863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521841    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00582840-7ec6-4b04-88c0-59fb58170616-tmp\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.521950 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521883    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5527804e-4910-4875-af3b-a58fd9ae2f87-iptables-alerter-script\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.521950 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9780e3f9-889b-4b83-8570-f5bff19af292-hosts-file\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.521950 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521920    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02c0ed33-d2dd-4667-82be-a1db58dc12a3-host\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521958    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4a2be21-40ce-4866-84ce-ede14e71a937-konnectivity-ca\") pod \"konnectivity-agent-kf4nx\" (UID: \"f4a2be21-40ce-4866-84ce-ede14e71a937\") " pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.521989    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-modprobe-d\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522004    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysctl-conf\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522030    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hpz\" (UniqueName: \"kubernetes.io/projected/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-kube-api-access-z7hpz\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522046    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522060    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-sys-fs\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522074    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkr9k\" (UniqueName: \"kubernetes.io/projected/e3ddad1f-3945-43f0-b247-95b1f71adbb6-kube-api-access-zkr9k\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522090    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522115    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4a2be21-40ce-4866-84ce-ede14e71a937-agent-certs\") pod \"konnectivity-agent-kf4nx\" (UID: \"f4a2be21-40ce-4866-84ce-ede14e71a937\") " pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522132    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-run\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-lib-modules\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.522199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522216    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-socket-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522231    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-registration-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522246    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-device-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522262    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522292    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysconfig\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522314    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdfrm\" (UniqueName: \"kubernetes.io/projected/00582840-7ec6-4b04-88c0-59fb58170616-kube-api-access-mdfrm\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522333    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5527804e-4910-4875-af3b-a58fd9ae2f87-host-slash\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522351    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9780e3f9-889b-4b83-8570-f5bff19af292-tmp-dir\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522381    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpzl\" (UniqueName: \"kubernetes.io/projected/9780e3f9-889b-4b83-8570-f5bff19af292-kube-api-access-wnpzl\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522414    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522438    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522462    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522487    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sqvt\" (UniqueName: \"kubernetes.io/projected/5527804e-4910-4875-af3b-a58fd9ae2f87-kube-api-access-2sqvt\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522508    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-os-release\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522522    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mxr\" (UniqueName: \"kubernetes.io/projected/02c0ed33-d2dd-4667-82be-a1db58dc12a3-kube-api-access-59mxr\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.522767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522543    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-kubernetes\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522568    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-systemd\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522624    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-sys\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-system-cni-dir\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522674    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cnibin\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522702    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysctl-d\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522725    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00582840-7ec6-4b04-88c0-59fb58170616-etc-tuned\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.522748    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02c0ed33-d2dd-4667-82be-a1db58dc12a3-serviceca\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.523367    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:03.523526 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.523432    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:03.535544 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.535519    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:26:03.535654 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.535559    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.535654 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.535611    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.535848 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.535827    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:26:03.535957 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.535831    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:26:03.535957 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.535894    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbtgk\""
Jul 06 19:26:03.536074 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.536037    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.536124 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.536113    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:26:03.536772 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.536752    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.536856 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.536833    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:26:03.537019 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.537003    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:26:03.537079 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.537051    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:26:03.537393 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.537377    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:26:03.538021 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.538003    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:26:03.538288 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.538271    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:26:03.538501 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.538486    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7gjz4\""
Jul 06 19:26:03.538703 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.538688    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ndfl6\""
Jul 06 19:26:03.539027 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.538892    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:26:03.539123 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.539103    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bf7x\""
Jul 06 19:26:03.550782 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.550750    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:26:03.566092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.566065    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rs9lm"
Jul 06 19:26:03.581251 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.581223    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rs9lm"
Jul 06 19:26:03.607947 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.607902    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:26:03.623836 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.623804    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-kubelet\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.623836 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.623834    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-systemd\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.623851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-cnibin\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.623868    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.623914    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.623985    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkr9k\" (UniqueName: \"kubernetes.io/projected/e3ddad1f-3945-43f0-b247-95b1f71adbb6-kube-api-access-zkr9k\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624008    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2e438bf-056d-4181-b799-983a7c7c1770-ovn-node-metrics-cert\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624032    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-ovnkube-script-lib\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624047    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-conf-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624048    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624062    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4a2be21-40ce-4866-84ce-ede14e71a937-agent-certs\") pod \"konnectivity-agent-kf4nx\" (UID: \"f4a2be21-40ce-4866-84ce-ede14e71a937\") " pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624096    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-run\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624146    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-lib-modules\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624192    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-run\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624236    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624193    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624270    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-socket-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-registration-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624317    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-lib-modules\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624330    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9780e3f9-889b-4b83-8570-f5bff19af292-tmp-dir\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624357    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624367    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-registration-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624420    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624468    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624482    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-socket-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624500    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-ovn\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.624551 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624530    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624595    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9780e3f9-889b-4b83-8570-f5bff19af292-tmp-dir\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624604    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-log-socket\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624633    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624659    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-k8s-cni-cncf-io\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624690    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-netns\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624714    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr2j2\" (UniqueName: \"kubernetes.io/projected/abc04eba-5cd2-4909-a877-16816a9fb151-kube-api-access-rr2j2\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624772    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sqvt\" (UniqueName: \"kubernetes.io/projected/5527804e-4910-4875-af3b-a58fd9ae2f87-kube-api-access-2sqvt\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624799    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-os-release\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624825    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-cni-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624874    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-cni-multus\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624901    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mxr\" (UniqueName: \"kubernetes.io/projected/02c0ed33-d2dd-4667-82be-a1db58dc12a3-kube-api-access-59mxr\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624925    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-kubernetes\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624969    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-sys\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624980    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.624997    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-system-cni-dir\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625022    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cnibin\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.625394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625028    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625126    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625177    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-sys\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625194    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-system-cni-dir\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625205    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-cnibin\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625248    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-os-release\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625421    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-kubernetes\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625083    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-os-release\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625599    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4krw\" (UniqueName: \"kubernetes.io/projected/777caea5-d7d8-4977-89ea-a5b4849ae6c3-kube-api-access-r4krw\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625627    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00582840-7ec6-4b04-88c0-59fb58170616-etc-tuned\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-cni-bin\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625670    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-dbus\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-cni-bin\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625715    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-daemon-config\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625740    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-var-lib-kubelet\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625762    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5527804e-4910-4875-af3b-a58fd9ae2f87-iptables-alerter-script\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625786    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9780e3f9-889b-4b83-8570-f5bff19af292-hosts-file\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.626263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625808    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-run-netns\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-run-ovn-kubernetes\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625858    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-etc-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625885    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4a2be21-40ce-4866-84ce-ede14e71a937-konnectivity-ca\") pod \"konnectivity-agent-kf4nx\" (UID: \"f4a2be21-40ce-4866-84ce-ede14e71a937\") " pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625913    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hpz\" (UniqueName: \"kubernetes.io/projected/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-kube-api-access-z7hpz\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-systemd-units\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.625979    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-cni-netd\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626004    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-sys-fs\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626028    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9780e3f9-889b-4b83-8570-f5bff19af292-hosts-file\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626032    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626067    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-hostroot\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626090    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-etc-kubernetes\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626116    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-device-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626143    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626168    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-env-overrides\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626194    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-kubelet\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626220    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysconfig\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.626808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626245    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdfrm\" (UniqueName: \"kubernetes.io/projected/00582840-7ec6-4b04-88c0-59fb58170616-kube-api-access-mdfrm\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626269    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5527804e-4910-4875-af3b-a58fd9ae2f87-host-slash\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626293    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpzl\" (UniqueName: \"kubernetes.io/projected/9780e3f9-889b-4b83-8570-f5bff19af292-kube-api-access-wnpzl\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626316    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-node-log\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626340    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqkh\" (UniqueName: \"kubernetes.io/projected/b2e438bf-056d-4181-b799-983a7c7c1770-kube-api-access-mlqkh\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626364    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/777caea5-d7d8-4977-89ea-a5b4849ae6c3-cni-binary-copy\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626388    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-systemd\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626440    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-var-lib-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626466    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-kubelet-config\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626475    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626491    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-socket-dir-parent\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626790    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysconfig\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.626981    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4a2be21-40ce-4866-84ce-ede14e71a937-konnectivity-ca\") pod \"konnectivity-agent-kf4nx\" (UID: \"f4a2be21-40ce-4866-84ce-ede14e71a937\") " pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627010    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5527804e-4910-4875-af3b-a58fd9ae2f87-host-slash\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627030    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-device-dir\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627185    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3ddad1f-3945-43f0-b247-95b1f71adbb6-sys-fs\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627215    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysctl-d\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627241    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627548    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-systemd\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627588    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-multus-certs\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627618    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02c0ed33-d2dd-4667-82be-a1db58dc12a3-serviceca\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627643    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-host\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627668    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00582840-7ec6-4b04-88c0-59fb58170616-tmp\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-slash\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627697    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5527804e-4910-4875-af3b-a58fd9ae2f87-iptables-alerter-script\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627716    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.627765 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627755    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-ovnkube-config\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627779    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-system-cni-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627803    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02c0ed33-d2dd-4667-82be-a1db58dc12a3-host\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627836    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-modprobe-d\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.627862    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysctl-conf\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628043    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysctl-conf\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628050    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-host\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628054    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-sysctl-d\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628557 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628100    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02c0ed33-d2dd-4667-82be-a1db58dc12a3-host\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.628557 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628114    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-var-lib-kubelet\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628557 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628201    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00582840-7ec6-4b04-88c0-59fb58170616-etc-modprobe-d\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.628557 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.628426    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02c0ed33-d2dd-4667-82be-a1db58dc12a3-serviceca\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.629058 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.629034    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00582840-7ec6-4b04-88c0-59fb58170616-etc-tuned\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.629367 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.629326    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4a2be21-40ce-4866-84ce-ede14e71a937-agent-certs\") pod \"konnectivity-agent-kf4nx\" (UID: \"f4a2be21-40ce-4866-84ce-ede14e71a937\") " pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.630727 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.630698    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00582840-7ec6-4b04-88c0-59fb58170616-tmp\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.662830 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.662794    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:03.662830 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.662832    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:03.663129 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.662849    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:03.663129 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.662925    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:26:04.162902819 +0000 UTC m=+3.089940729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:03.666466 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.666351    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mxr\" (UniqueName: \"kubernetes.io/projected/02c0ed33-d2dd-4667-82be-a1db58dc12a3-kube-api-access-59mxr\") pod \"node-ca-vfk8t\" (UID: \"02c0ed33-d2dd-4667-82be-a1db58dc12a3\") " pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.666466 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.666376    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpzl\" (UniqueName: \"kubernetes.io/projected/9780e3f9-889b-4b83-8570-f5bff19af292-kube-api-access-wnpzl\") pod \"node-resolver-9ttfp\" (UID: \"9780e3f9-889b-4b83-8570-f5bff19af292\") " pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.666466 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.666406    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sqvt\" (UniqueName: \"kubernetes.io/projected/5527804e-4910-4875-af3b-a58fd9ae2f87-kube-api-access-2sqvt\") pod \"iptables-alerter-df7sv\" (UID: \"5527804e-4910-4875-af3b-a58fd9ae2f87\") " pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.667116 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.667091    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkr9k\" (UniqueName: \"kubernetes.io/projected/e3ddad1f-3945-43f0-b247-95b1f71adbb6-kube-api-access-zkr9k\") pod \"aws-ebs-csi-driver-node-hb8p9\" (UID: \"e3ddad1f-3945-43f0-b247-95b1f71adbb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.668016 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.667992    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdfrm\" (UniqueName: \"kubernetes.io/projected/00582840-7ec6-4b04-88c0-59fb58170616-kube-api-access-mdfrm\") pod \"tuned-zbzft\" (UID: \"00582840-7ec6-4b04-88c0-59fb58170616\") " pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.668767 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.668738    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hpz\" (UniqueName: \"kubernetes.io/projected/d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea-kube-api-access-z7hpz\") pod \"multus-additional-cni-plugins-hkzgz\" (UID: \"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea\") " pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.726852 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.726810    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:26:03.729064 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729026    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-cni-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729073    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-cni-multus\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729104    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-os-release\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729130    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4krw\" (UniqueName: \"kubernetes.io/projected/777caea5-d7d8-4977-89ea-a5b4849ae6c3-kube-api-access-r4krw\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729155    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-cni-bin\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729165    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-cni-multus\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729179    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-dbus\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.729212 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729202    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-cni-bin\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729245    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-cni-bin\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729269    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-cni-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729367    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-cni-bin\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729386    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-dbus\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729430    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-os-release\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729431    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-daemon-config\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729480    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-run-netns\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729499    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-run-ovn-kubernetes\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729514    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-etc-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729532    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-systemd-units\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729547    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-cni-netd\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729565    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-hostroot\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729583    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-etc-kubernetes\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729608    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-env-overrides\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729622    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-kubelet\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729643    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-node-log\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729663    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqkh\" (UniqueName: \"kubernetes.io/projected/b2e438bf-056d-4181-b799-983a7c7c1770-kube-api-access-mlqkh\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729677    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/777caea5-d7d8-4977-89ea-a5b4849ae6c3-cni-binary-copy\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729695    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-var-lib-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729710    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-kubelet-config\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729732    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-socket-dir-parent\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729751    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.729790 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729779    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-multus-certs\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729806    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-slash\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729829    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729863    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-ovnkube-config\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729893    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-system-cni-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729921    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-kubelet\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729921    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-daemon-config\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729963    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-systemd\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.729994    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-cnibin\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730010    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-var-lib-kubelet\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730024    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730047    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-node-log\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730052    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2e438bf-056d-4181-b799-983a7c7c1770-ovn-node-metrics-cert\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730233    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-env-overrides\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730292    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-run-ovn-kubernetes\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730304    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-cni-netd\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730331    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-hostroot\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730348    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-etc-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.730497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730368    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-etc-kubernetes\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730401    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-systemd-units\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730452    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-kubelet-config\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730490    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-var-lib-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730540    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-system-cni-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730629    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-socket-dir-parent\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730667    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-kubelet\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730694    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/777caea5-d7d8-4977-89ea-a5b4849ae6c3-cni-binary-copy\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730702    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-systemd\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730730    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-ovnkube-script-lib\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730751    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-run-netns\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730759    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-conf-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730807    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-cnibin\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730816    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-ovn\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730839    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-multus-conf-dir\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730843    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-log-socket\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.730868    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731025    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-k8s-cni-cncf-io\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.731337 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731048    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-ovnkube-config\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731065    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-netns\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731093    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr2j2\" (UniqueName: \"kubernetes.io/projected/abc04eba-5cd2-4909-a877-16816a9fb151-kube-api-access-rr2j2\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731102    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-openvswitch\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.731163    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.731212    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:26:04.231198603 +0000 UTC m=+3.158236500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731313    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-run-ovn\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731310    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2e438bf-056d-4181-b799-983a7c7c1770-ovnkube-script-lib\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731352    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-multus-certs\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731382    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-log-socket\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731387    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731407    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-netns\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731433    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/777caea5-d7d8-4977-89ea-a5b4849ae6c3-host-run-k8s-cni-cncf-io\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.731508    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2e438bf-056d-4181-b799-983a7c7c1770-host-slash\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.731532    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:03.732282 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:03.731636    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:04.231615712 +0000 UTC m=+3.158653624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:03.732948 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.732906    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2e438bf-056d-4181-b799-983a7c7c1770-ovn-node-metrics-cert\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.753521 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.753443    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4krw\" (UniqueName: \"kubernetes.io/projected/777caea5-d7d8-4977-89ea-a5b4849ae6c3-kube-api-access-r4krw\") pod \"multus-t2vsm\" (UID: \"777caea5-d7d8-4977-89ea-a5b4849ae6c3\") " pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.753786 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.753765    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqkh\" (UniqueName: \"kubernetes.io/projected/b2e438bf-056d-4181-b799-983a7c7c1770-kube-api-access-mlqkh\") pod \"ovnkube-node-pggbq\" (UID: \"b2e438bf-056d-4181-b799-983a7c7c1770\") " pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:03.758766 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.758688    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr2j2\" (UniqueName: \"kubernetes.io/projected/abc04eba-5cd2-4909-a877-16816a9fb151-kube-api-access-rr2j2\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:03.809794 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.809761    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfk8t"
Jul 06 19:26:03.826714 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.826679    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9"
Jul 06 19:26:03.837362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.837324    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:03.842580 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.842552    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbzft"
Jul 06 19:26:03.851200 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.851179    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9ttfp"
Jul 06 19:26:03.859440 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.859420    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-df7sv"
Jul 06 19:26:03.875822 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.875781    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkzgz"
Jul 06 19:26:03.882863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.882831    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2vsm"
Jul 06 19:26:03.890389 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:03.890183    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.233766    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.233830    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.233858    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.233945    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.233973    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.233984    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.233989    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.234009    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.234049    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:26:05.234029226 +0000 UTC m=+4.161067136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.234069    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:26:05.23405946 +0000 UTC m=+4.161097361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:04.234382 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:04.234084    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:05.234075857 +0000 UTC m=+4.161113772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:04.587549 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.587460    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:21:03 +0000 UTC" deadline="2028-02-23 09:56:12.822165303 +0000 UTC"
Jul 06 19:26:04.587549 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.587498    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14318h30m8.234672653s"
Jul 06 19:26:04.639513 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.639481    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ddad1f_3945_43f0_b247_95b1f71adbb6.slice/crio-60140ccf493696ffd7a1d2822d36b724db08850158c9ab3e01e1c89ff9027236 WatchSource:0}: Error finding container 60140ccf493696ffd7a1d2822d36b724db08850158c9ab3e01e1c89ff9027236: Status 404 returned error can't find the container with id 60140ccf493696ffd7a1d2822d36b724db08850158c9ab3e01e1c89ff9027236
Jul 06 19:26:04.641310 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.641028    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a2be21_40ce_4866_84ce_ede14e71a937.slice/crio-c38021f136d09c08e61fdd2101b76e191ce27cdc26814dbedbd92ec6c538d658 WatchSource:0}: Error finding container c38021f136d09c08e61fdd2101b76e191ce27cdc26814dbedbd92ec6c538d658: Status 404 returned error can't find the container with id c38021f136d09c08e61fdd2101b76e191ce27cdc26814dbedbd92ec6c538d658
Jul 06 19:26:04.646561 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.646454    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00582840_7ec6_4b04_88c0_59fb58170616.slice/crio-40fd64b582bb34f1a25f7701783850319852f24ecf74be2afcc67740d0e525ab WatchSource:0}: Error finding container 40fd64b582bb34f1a25f7701783850319852f24ecf74be2afcc67740d0e525ab: Status 404 returned error can't find the container with id 40fd64b582bb34f1a25f7701783850319852f24ecf74be2afcc67740d0e525ab
Jul 06 19:26:04.647528 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.647493    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e438bf_056d_4181_b799_983a7c7c1770.slice/crio-52f213a4a903ca8376fce7b294ca070acb16d3b9f38b87d1e3e5666fc604e7f1 WatchSource:0}: Error finding container 52f213a4a903ca8376fce7b294ca070acb16d3b9f38b87d1e3e5666fc604e7f1: Status 404 returned error can't find the container with id 52f213a4a903ca8376fce7b294ca070acb16d3b9f38b87d1e3e5666fc604e7f1
Jul 06 19:26:04.649009 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.648984    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9780e3f9_889b_4b83_8570_f5bff19af292.slice/crio-f5d0023d1f259b342bfba162950ec3ddba7d7866b6a287a29735a855042015e6 WatchSource:0}: Error finding container f5d0023d1f259b342bfba162950ec3ddba7d7866b6a287a29735a855042015e6: Status 404 returned error can't find the container with id f5d0023d1f259b342bfba162950ec3ddba7d7866b6a287a29735a855042015e6
Jul 06 19:26:04.649235 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.649210    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c0ed33_d2dd_4667_82be_a1db58dc12a3.slice/crio-be2a2980b006449e70ffe6f5ab08145ae16bbfa1665df0a7b536644e03bd9fe8 WatchSource:0}: Error finding container be2a2980b006449e70ffe6f5ab08145ae16bbfa1665df0a7b536644e03bd9fe8: Status 404 returned error can't find the container with id be2a2980b006449e70ffe6f5ab08145ae16bbfa1665df0a7b536644e03bd9fe8
Jul 06 19:26:04.649893 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.649864    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5527804e_4910_4875_af3b_a58fd9ae2f87.slice/crio-0c3461d5d0c62fdc03bbd19537e1bdc933583f28e8031fd4a53ff9b0ba1e0497 WatchSource:0}: Error finding container 0c3461d5d0c62fdc03bbd19537e1bdc933583f28e8031fd4a53ff9b0ba1e0497: Status 404 returned error can't find the container with id 0c3461d5d0c62fdc03bbd19537e1bdc933583f28e8031fd4a53ff9b0ba1e0497
Jul 06 19:26:04.651909 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.651480    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63dd42b_f6c1_422c_bcb1_2a8ce800a4ea.slice/crio-33efe77b0986a26b460624780893fe1e322913dbc83eed8898e4a5ce6b510521 WatchSource:0}: Error finding container 33efe77b0986a26b460624780893fe1e322913dbc83eed8898e4a5ce6b510521: Status 404 returned error can't find the container with id 33efe77b0986a26b460624780893fe1e322913dbc83eed8898e4a5ce6b510521
Jul 06 19:26:04.653373 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:04.652326    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777caea5_d7d8_4977_89ea_a5b4849ae6c3.slice/crio-9d963a7b3c52be0df1f330a98d57965dbddfda4bd1513b0749a0a76e42420703 WatchSource:0}: Error finding container 9d963a7b3c52be0df1f330a98d57965dbddfda4bd1513b0749a0a76e42420703: Status 404 returned error can't find the container with id 9d963a7b3c52be0df1f330a98d57965dbddfda4bd1513b0749a0a76e42420703
Jul 06 19:26:04.710486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.710295    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2vsm" event={"ID":"777caea5-d7d8-4977-89ea-a5b4849ae6c3","Type":"ContainerStarted","Data":"9d963a7b3c52be0df1f330a98d57965dbddfda4bd1513b0749a0a76e42420703"}
Jul 06 19:26:04.711484 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.711456    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-df7sv" event={"ID":"5527804e-4910-4875-af3b-a58fd9ae2f87","Type":"ContainerStarted","Data":"0c3461d5d0c62fdc03bbd19537e1bdc933583f28e8031fd4a53ff9b0ba1e0497"}
Jul 06 19:26:04.712662 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.712637    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerStarted","Data":"33efe77b0986a26b460624780893fe1e322913dbc83eed8898e4a5ce6b510521"}
Jul 06 19:26:04.713724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.713699    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9ttfp" event={"ID":"9780e3f9-889b-4b83-8570-f5bff19af292","Type":"ContainerStarted","Data":"f5d0023d1f259b342bfba162950ec3ddba7d7866b6a287a29735a855042015e6"}
Jul 06 19:26:04.715090 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.715071    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9" event={"ID":"e3ddad1f-3945-43f0-b247-95b1f71adbb6","Type":"ContainerStarted","Data":"60140ccf493696ffd7a1d2822d36b724db08850158c9ab3e01e1c89ff9027236"}
Jul 06 19:26:04.716302 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.716279    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"52f213a4a903ca8376fce7b294ca070acb16d3b9f38b87d1e3e5666fc604e7f1"}
Jul 06 19:26:04.717978 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.717954    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfk8t" event={"ID":"02c0ed33-d2dd-4667-82be-a1db58dc12a3","Type":"ContainerStarted","Data":"be2a2980b006449e70ffe6f5ab08145ae16bbfa1665df0a7b536644e03bd9fe8"}
Jul 06 19:26:04.719241 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.719218    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbzft" event={"ID":"00582840-7ec6-4b04-88c0-59fb58170616","Type":"ContainerStarted","Data":"40fd64b582bb34f1a25f7701783850319852f24ecf74be2afcc67740d0e525ab"}
Jul 06 19:26:04.720349 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:04.720330    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf4nx" event={"ID":"f4a2be21-40ce-4866-84ce-ede14e71a937","Type":"ContainerStarted","Data":"c38021f136d09c08e61fdd2101b76e191ce27cdc26814dbedbd92ec6c538d658"}
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.244275    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.244345    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.244384    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244521    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244586    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:26:07.244567978 +0000 UTC m=+6.171605878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244675    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244689    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244701    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244736    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:26:07.244725953 +0000 UTC m=+6.171763853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244795    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:05.245246 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.244823    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:07.244813529 +0000 UTC m=+6.171851428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:05.588316 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.588164    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:21:03 +0000 UTC" deadline="2028-01-20 15:04:19.26553663 +0000 UTC"
Jul 06 19:26:05.588316 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.588229    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13507h38m13.67731293s"
Jul 06 19:26:05.702423 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.702373    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:05.702603 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.702525    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:05.702603 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.702378    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:05.702726 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.702655    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:05.702726 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.702679    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:05.702825 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:05.702780    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:05.740162 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.740117    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"03ac6699bc87ac3abedcb3149dcf3083","Type":"ContainerStarted","Data":"204a8ff3ebcb04a50ce05ec351a8084015a852635e595b1e98f3f129653146c3"}
Jul 06 19:26:05.763362 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.763319    2552 generic.go:356] "Generic (PLEG): container finished" podID="661ec5fbdc6dcb8f55ad5865580cfec0" containerID="32b45ce0727b2d288d197e5ecbaf3d4b9728c5e2289202e3c63bc73058761c0b" exitCode=0
Jul 06 19:26:05.763547 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.763389    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"661ec5fbdc6dcb8f55ad5865580cfec0","Type":"ContainerDied","Data":"32b45ce0727b2d288d197e5ecbaf3d4b9728c5e2289202e3c63bc73058761c0b"}
Jul 06 19:26:05.782295 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:05.780811    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podStartSLOduration=3.780787552 podStartE2EDuration="3.780787552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:05.757584047 +0000 UTC m=+4.684621968" watchObservedRunningTime="2026-07-06 19:26:05.780787552 +0000 UTC m=+4.707825475"
Jul 06 19:26:06.774570 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:06.774533    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"661ec5fbdc6dcb8f55ad5865580cfec0","Type":"ContainerStarted","Data":"07a71f4e606464e96dc7f79fe74799ed014acee802405efe571e4bef2a13f4ff"}
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:07.264581    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:07.264655    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:07.264697    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.264832    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.264902    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:11.264882396 +0000 UTC m=+10.191920310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.265346    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.265401    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:26:11.265384978 +0000 UTC m=+10.192422875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.265483    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.265498    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.265510    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:07.265689 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.265546    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:26:11.265535049 +0000 UTC m=+10.192572954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:07.701128 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:07.701042    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:07.701128 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:07.701032    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:07.701349 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.701182    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:07.701349 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:07.701207    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:07.701349 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.701280    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:07.701481 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:07.701348    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:09.703231 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:09.703197    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:09.703610 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:09.703339    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:09.703724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:09.703705    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:09.703833 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:09.703803    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:09.703872 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:09.703855    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:09.703957 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:09.703921    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:11.299877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:11.299836    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:11.300359 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:11.299900    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:11.300359 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:11.299953    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:11.300359 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300112    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:11.300359 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300176    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:26:19.300158037 +0000 UTC m=+18.227195936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:11.300585 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300548    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:11.300585 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300568    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:11.300585 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300579    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:11.300735 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300620    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:26:19.3006047 +0000 UTC m=+18.227642597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:11.300735 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300673    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:11.300735 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.300696    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:19.300688134 +0000 UTC m=+18.227726031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:11.705031 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:11.704944    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:11.705204 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:11.705056    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:11.705204 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:11.705093    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:11.705303 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.705277    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:11.706795 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.706400    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:11.706795 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:11.706531    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:13.701071 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:13.701031    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:13.701678 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:13.701034    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:13.701678 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:13.701181    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:13.701678 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:13.701227    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:13.701678 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:13.701351    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:13.701678 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:13.701444    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:15.702951 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:15.701192    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:15.702951 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:15.701330    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:15.702951 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:15.701396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:15.702951 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:15.701507    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:15.702951 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:15.701645    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:15.702951 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:15.701713    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:17.701091 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:17.701051    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:17.701570 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:17.701182    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:17.701570 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:17.701203    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:17.701570 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:17.701057    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:17.701570 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:17.701320    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:17.701570 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:17.701402    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:19.365946 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:19.365890    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:19.365969    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:19.366018    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366048    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366114    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:35.366094286 +0000 UTC m=+34.293132200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366117    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366125    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366131    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366184    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:26:35.366165833 +0000 UTC m=+34.293203739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366191    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:19.366516 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.366239    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:26:35.366227003 +0000 UTC m=+34.293264899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:19.702721 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:19.702629    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:19.702890 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.702756    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:19.703146 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:19.703123    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:19.703272 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.703223    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:19.703334 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:19.703277    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:19.703388 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:19.703363    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:21.702083 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:21.702050    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:21.702648 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:21.702164    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:21.702648 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:21.702177    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:21.702648 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:21.702282    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:21.702648 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:21.702344    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:21.702648 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:21.702411    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:23.700821 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:23.700789    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:23.701318 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:23.700786    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:23.701318 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:23.700905    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:23.701318 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:23.701005    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:23.701318 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:23.700787    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:23.701318 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:23.701093    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:24.817013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.816597    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf4nx" event={"ID":"f4a2be21-40ce-4866-84ce-ede14e71a937","Type":"ContainerStarted","Data":"016a13551338dbe489fcb442394778f5c55454d660013baf5976d8b6b1ee6523"}
Jul 06 19:26:24.818242 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.818218    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2vsm" event={"ID":"777caea5-d7d8-4977-89ea-a5b4849ae6c3","Type":"ContainerStarted","Data":"8eb170fdd96a5d98048f1ba83a19879855a34827a9297f76452f888810c4e176"}
Jul 06 19:26:24.819708 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.819686    2552 generic.go:356] "Generic (PLEG): container finished" podID="d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea" containerID="c6d73a999c15a8cf8935f9adbc22347a76a8dc748cc91c3bb4a2280d94451da8" exitCode=0
Jul 06 19:26:24.819814 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.819747    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerDied","Data":"c6d73a999c15a8cf8935f9adbc22347a76a8dc748cc91c3bb4a2280d94451da8"}
Jul 06 19:26:24.823232 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.823205    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9ttfp" event={"ID":"9780e3f9-889b-4b83-8570-f5bff19af292","Type":"ContainerStarted","Data":"ff732a447af6725c5f8ded5e50e781e853d4836081aa5ab7b5c2970d121a80cd"}
Jul 06 19:26:24.824628 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.824606    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9" event={"ID":"e3ddad1f-3945-43f0-b247-95b1f71adbb6","Type":"ContainerStarted","Data":"b218a98fb0afd1dea7ee3e2cf194c684d5ac6e0604a899a22da1393ef60e997b"}
Jul 06 19:26:24.827647 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.827619    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"be6e49d46641bf96db110bf5969654747e89548ab2f0e81627916599bcb3dc86"}
Jul 06 19:26:24.827752 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.827723    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"74dec6bbbbe4f56908240a4fb726f757a82fef7ac3b337d71a75937ec7077eb6"}
Jul 06 19:26:24.827815 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.827776    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"f90ba75a55425521b2e45a11a4f6dd7f1d2285fca8baaed8d8535a4dffe6986b"}
Jul 06 19:26:24.827870 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.827827    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"81d9b1b42addabcc70ba3077a3a4e0ba8626544d3de1f1d91f88ee231f783122"}
Jul 06 19:26:24.827923 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.827877    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"90a28062b2a5ef77d39f9b94b6c4686eb48754c6449a8c767ab667be0815b853"}
Jul 06 19:26:24.828000 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.827926    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"15b02622ee1cc1980141d7d032d77b40d7e49abc924316650dca106301b3ed02"}
Jul 06 19:26:24.828957 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.828918    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfk8t" event={"ID":"02c0ed33-d2dd-4667-82be-a1db58dc12a3","Type":"ContainerStarted","Data":"8c18a1bea00c92f77a7a4a387c3d8e953a4bf98f0ffdbc9b172ee59d52192f05"}
Jul 06 19:26:24.830217 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.830198    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbzft" event={"ID":"00582840-7ec6-4b04-88c0-59fb58170616","Type":"ContainerStarted","Data":"232ccd25083a0c1cd5ac16578a57615d680fa401596ca472f3f2349b88401d90"}
Jul 06 19:26:24.840270 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.840233    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" podStartSLOduration=22.840221413 podStartE2EDuration="22.840221413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.798598208 +0000 UTC m=+5.725636128" watchObservedRunningTime="2026-07-06 19:26:24.840221413 +0000 UTC m=+23.767259331"
Jul 06 19:26:24.873292 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.873243    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vfk8t" podStartSLOduration=4.80749595 podStartE2EDuration="23.873226898s" totalImagesPullingTime="19.065730948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:24.873186264 +0000 UTC m=+23.800224194" watchObservedRunningTime="2026-07-06 19:26:24.873226898 +0000 UTC m=+23.800264821"
Jul 06 19:26:24.873808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:24.873780    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kf4nx" podStartSLOduration=8.567162043 podStartE2EDuration="23.87377199s" totalImagesPullingTime="15.306609947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:24.840130048 +0000 UTC m=+23.767167967" watchObservedRunningTime="2026-07-06 19:26:24.87377199 +0000 UTC m=+23.800809905"
Jul 06 19:26:25.006950 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.006850    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t2vsm" podStartSLOduration=4.867330585 podStartE2EDuration="24.006832749s" totalImagesPullingTime="19.139502164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:24.975779065 +0000 UTC m=+23.902816984" watchObservedRunningTime="2026-07-06 19:26:25.006832749 +0000 UTC m=+23.933870668"
Jul 06 19:26:25.007121 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.007036    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zbzft" podStartSLOduration=4.935825338 podStartE2EDuration="24.007029945s" totalImagesPullingTime="19.071204607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:25.006974014 +0000 UTC m=+23.934011915" watchObservedRunningTime="2026-07-06 19:26:25.007029945 +0000 UTC m=+23.934067864"
Jul 06 19:26:25.046872 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.046815    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9ttfp" podStartSLOduration=4.977262716 podStartE2EDuration="24.04679121s" totalImagesPullingTime="19.069528494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:25.04624081 +0000 UTC m=+23.973278731" watchObservedRunningTime="2026-07-06 19:26:25.04679121 +0000 UTC m=+23.973829131"
Jul 06 19:26:25.118125 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.118098    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:26:25.317951 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.317856    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:25.318500 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.318485    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:25.595441 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.595279    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:26:25.118121284Z","UUID":"6e665de6-df13-4a58-a202-1cde0e1f6de3","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:26:25.597401 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.597378    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:26:25.597525 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.597425    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:26:25.700948 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.700911    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:25.701169 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.700924    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:25.701169 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:25.701056    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:25.701169 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.701064    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:25.701169 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:25.701138    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:25.701368 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:25.701218    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:25.834524 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.834480    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-df7sv" event={"ID":"5527804e-4910-4875-af3b-a58fd9ae2f87","Type":"ContainerStarted","Data":"6960ea6b734732f5f0696a46af10269a3a0d7cb85099501891cc1abaf094ce6e"}
Jul 06 19:26:25.837383 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:25.837358    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9" event={"ID":"e3ddad1f-3945-43f0-b247-95b1f71adbb6","Type":"ContainerStarted","Data":"86e44228b2534d0e13291550e355abc566cf6e5fef61c71ac1b460edc0575726"}
Jul 06 19:26:26.842636 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.842540    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9" event={"ID":"e3ddad1f-3945-43f0-b247-95b1f71adbb6","Type":"ContainerStarted","Data":"4f7157923057f17e83dd72753781e5724db67119d331e57fb788337c09c46107"}
Jul 06 19:26:26.846316 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.846281    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"3dbf90ca0c716d221d791f55a566eea37b689cc88a5a581fec82ff4f382c12fb"}
Jul 06 19:26:26.846459 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.846337    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:26:26.868307 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.868247    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-df7sv" podStartSLOduration=6.802748792 podStartE2EDuration="25.868231764s" totalImagesPullingTime="19.065482972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:25.858792845 +0000 UTC m=+24.785830765" watchObservedRunningTime="2026-07-06 19:26:26.868231764 +0000 UTC m=+25.795269682"
Jul 06 19:26:26.868514 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.868482    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hb8p9" podStartSLOduration=4.7431526040000005 podStartE2EDuration="25.868474923s" totalImagesPullingTime="21.125322319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:26.868046088 +0000 UTC m=+25.795083998" watchObservedRunningTime="2026-07-06 19:26:26.868474923 +0000 UTC m=+25.795512841"
Jul 06 19:26:26.942497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.942460    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:26.943079 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:26.943004    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kf4nx"
Jul 06 19:26:27.700709 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:27.700679    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:27.700894 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:27.700680    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:27.700894 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:27.700826    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:27.700894 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:27.700798    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:27.701093 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:27.700946    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:27.701093 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:27.701070    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:29.701403 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.701211    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:29.702170 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.701212    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:29.702170 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:29.701490    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:29.702170 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:29.701578    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:29.702170 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.701213    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:29.702170 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:29.701668    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:29.858779 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.858745    2552 generic.go:356] "Generic (PLEG): container finished" podID="d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea" containerID="49a9318d8a4038260a09da1361e075ddf31d014819fc99ddb38b4949e1d88819" exitCode=0
Jul 06 19:26:29.858978 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.858826    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerDied","Data":"49a9318d8a4038260a09da1361e075ddf31d014819fc99ddb38b4949e1d88819"}
Jul 06 19:26:29.862605 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.862583    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" event={"ID":"b2e438bf-056d-4181-b799-983a7c7c1770","Type":"ContainerStarted","Data":"fdb1df83b32ce72441b2efc488ac9eb8dd4650b188b8d9ad188cb796b069a642"}
Jul 06 19:26:29.862994 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.862955    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:29.863127 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.863024    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:29.863127 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.863073    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:29.879446 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.879424    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:29.879671 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.879657    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:26:29.923733 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:29.923679    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq" podStartSLOduration=9.784558038 podStartE2EDuration="28.923662268s" totalImagesPullingTime="19.13910423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:29.92366387 +0000 UTC m=+28.850701788" watchObservedRunningTime="2026-07-06 19:26:29.923662268 +0000 UTC m=+28.850700166"
Jul 06 19:26:30.906666 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:30.906499    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9kcf"]
Jul 06 19:26:30.907032 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:30.906734    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:30.907032 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:30.906816    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:30.910503 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:30.910176    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2msqc"]
Jul 06 19:26:30.910503 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:30.910230    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x489d"]
Jul 06 19:26:30.910503 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:30.910278    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:30.910503 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:30.910344    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:30.910503 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:30.910397    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:30.910503 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:30.910458    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:31.868812 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:31.868779    2552 generic.go:356] "Generic (PLEG): container finished" podID="d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea" containerID="c3ea9b0033472aebf0f2be39a8c9bcd2641c14a6a559b943996909263d3c7489" exitCode=0
Jul 06 19:26:31.869078 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:31.868866    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerDied","Data":"c3ea9b0033472aebf0f2be39a8c9bcd2641c14a6a559b943996909263d3c7489"}
Jul 06 19:26:32.701200 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:32.701167    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:32.701729 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:32.701269    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:32.701729 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:32.701276    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:32.701729 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:32.701299    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:32.701729 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:32.701377    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:32.701729 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:32.701445    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:33.875485 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:33.875231    2552 generic.go:356] "Generic (PLEG): container finished" podID="d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea" containerID="f9d6dc9fb03a0df8df70ef9cf4475c65933b1595f47fce64847788bf4020e547" exitCode=0
Jul 06 19:26:33.875855 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:33.875312    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerDied","Data":"f9d6dc9fb03a0df8df70ef9cf4475c65933b1595f47fce64847788bf4020e547"}
Jul 06 19:26:34.701416 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:34.701384    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:34.701549 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:34.701421    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:34.701549 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:34.701384    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:34.701549 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:34.701526    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:34.701726 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:34.701619    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:34.701726 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:34.701715    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:35.380112 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:35.380067    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:35.380142    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:35.380181    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380260    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380290    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380288    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380296    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380304    2552 projected.go:196] Error preparing data for projected volume kube-api-access-zl297 for pod openshift-network-diagnostics/network-check-target-z9kcf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380367    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297 podName:c053367a-9916-4fcd-9166-f3df7239ac0c nodeName:}" failed. No retries permitted until 2026-07-06 19:27:07.380348229 +0000 UTC m=+66.307386143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zl297" (UniqueName: "kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297") pod "network-check-target-z9kcf" (UID: "c053367a-9916-4fcd-9166-f3df7239ac0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380388    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:07.380378439 +0000 UTC m=+66.307416344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:35.380571 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:35.380402    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret podName:104c43aa-5c63-423f-a55a-0fd25fa7cf9f nodeName:}" failed. No retries permitted until 2026-07-06 19:27:07.380393839 +0000 UTC m=+66.307431736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret") pod "global-pull-secret-syncer-x489d" (UID: "104c43aa-5c63-423f-a55a-0fd25fa7cf9f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:36.701162 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.701132    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:36.701649 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.701148    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:36.701649 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:36.701283    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2msqc" podUID="abc04eba-5cd2-4909-a877-16816a9fb151"
Jul 06 19:26:36.701649 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.701148    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:36.701649 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:36.701364    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9kcf" podUID="c053367a-9916-4fcd-9166-f3df7239ac0c"
Jul 06 19:26:36.701649 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:36.701411    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x489d" podUID="104c43aa-5c63-423f-a55a-0fd25fa7cf9f"
Jul 06 19:26:36.743540 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.743514    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeReady"
Jul 06 19:26:36.743701 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.743650    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:26:36.801462 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.801417    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qv4m2"]
Jul 06 19:26:36.804584 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.804560    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.806914 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.806890    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5nv5w"]
Jul 06 19:26:36.809120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.808890    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:26:36.809120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.808906    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:26:36.809120 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.808967    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:36.809421 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.809403    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjqsb\""
Jul 06 19:26:36.813998 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.813982    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:26:36.814084 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.814011    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sttlx\""
Jul 06 19:26:36.815049 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.815032    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:26:36.816534 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.816345    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:26:36.824391 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.823651    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qv4m2"]
Jul 06 19:26:36.825525 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.825505    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nv5w"]
Jul 06 19:26:36.890321 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.890280    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmq57\" (UniqueName: \"kubernetes.io/projected/5009aab8-4943-42c6-ad20-fa8f21bfde30-kube-api-access-wmq57\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.890497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.890334    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.890497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.890363    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5009aab8-4943-42c6-ad20-fa8f21bfde30-tmp-dir\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.890497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.890398    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5009aab8-4943-42c6-ad20-fa8f21bfde30-config-volume\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.890497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.890423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqhm\" (UniqueName: \"kubernetes.io/projected/89c50d5c-b643-491f-9ab2-c2edc871fda6-kube-api-access-nsqhm\") pod \"ingress-canary-5nv5w\" (UID: \"89c50d5c-b643-491f-9ab2-c2edc871fda6\") " pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:36.890665 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.890498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c50d5c-b643-491f-9ab2-c2edc871fda6-cert\") pod \"ingress-canary-5nv5w\" (UID: \"89c50d5c-b643-491f-9ab2-c2edc871fda6\") " pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:36.991651 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.991564    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c50d5c-b643-491f-9ab2-c2edc871fda6-cert\") pod \"ingress-canary-5nv5w\" (UID: \"89c50d5c-b643-491f-9ab2-c2edc871fda6\") " pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:36.991829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.991650    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmq57\" (UniqueName: \"kubernetes.io/projected/5009aab8-4943-42c6-ad20-fa8f21bfde30-kube-api-access-wmq57\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.991829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.991677    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.991829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.991700    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5009aab8-4943-42c6-ad20-fa8f21bfde30-tmp-dir\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.991829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.991728    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5009aab8-4943-42c6-ad20-fa8f21bfde30-config-volume\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.991829 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.991748    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqhm\" (UniqueName: \"kubernetes.io/projected/89c50d5c-b643-491f-9ab2-c2edc871fda6-kube-api-access-nsqhm\") pod \"ingress-canary-5nv5w\" (UID: \"89c50d5c-b643-491f-9ab2-c2edc871fda6\") " pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:36.992143 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:36.991847    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:36.992143 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:36.991906    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:37.49188948 +0000 UTC m=+36.418927380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:36.992143 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.992095    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5009aab8-4943-42c6-ad20-fa8f21bfde30-tmp-dir\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.992364 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.992340    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5009aab8-4943-42c6-ad20-fa8f21bfde30-config-volume\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:36.997219 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:36.997187    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c50d5c-b643-491f-9ab2-c2edc871fda6-cert\") pod \"ingress-canary-5nv5w\" (UID: \"89c50d5c-b643-491f-9ab2-c2edc871fda6\") " pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:37.002136 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:37.002079    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmq57\" (UniqueName: \"kubernetes.io/projected/5009aab8-4943-42c6-ad20-fa8f21bfde30-kube-api-access-wmq57\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:37.002273 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:37.002250    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqhm\" (UniqueName: \"kubernetes.io/projected/89c50d5c-b643-491f-9ab2-c2edc871fda6-kube-api-access-nsqhm\") pod \"ingress-canary-5nv5w\" (UID: \"89c50d5c-b643-491f-9ab2-c2edc871fda6\") " pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:37.123513 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:37.123476    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5nv5w"
Jul 06 19:26:37.495919 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:37.495884    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:37.496105 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:37.496046    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:37.496171 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:37.496131    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:38.496113755 +0000 UTC m=+37.423151654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:37.974697 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:37.974550    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5nv5w"]
Jul 06 19:26:37.979292 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:26:37.979260    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c50d5c_b643_491f_9ab2_c2edc871fda6.slice/crio-80a434854772a1396029887168ed03c68f795242de58985c5c1a19f03e3ca0e4 WatchSource:0}: Error finding container 80a434854772a1396029887168ed03c68f795242de58985c5c1a19f03e3ca0e4: Status 404 returned error can't find the container with id 80a434854772a1396029887168ed03c68f795242de58985c5c1a19f03e3ca0e4
Jul 06 19:26:38.503080 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.503045    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:38.503250 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:38.503160    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:38.503250 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:38.503213    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:40.503199534 +0000 UTC m=+39.430237436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:38.700928 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.700890    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:26:38.701092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.700984    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:26:38.701092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.701075    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:26:38.704406 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.704383    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:26:38.705810 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.705603    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:26:38.705810 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.705633    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:26:38.705810 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.705630    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x44r2\""
Jul 06 19:26:38.705810 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.705715    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmvz5\""
Jul 06 19:26:38.705810 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.705602    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:26:38.890565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.890488    2552 generic.go:356] "Generic (PLEG): container finished" podID="d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea" containerID="cb814cea2132ce6b861f07eca0e81771ea79603898daff1a76b99a765d041d25" exitCode=0
Jul 06 19:26:38.890715 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.890568    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerDied","Data":"cb814cea2132ce6b861f07eca0e81771ea79603898daff1a76b99a765d041d25"}
Jul 06 19:26:38.891789 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:38.891764    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nv5w" event={"ID":"89c50d5c-b643-491f-9ab2-c2edc871fda6","Type":"ContainerStarted","Data":"80a434854772a1396029887168ed03c68f795242de58985c5c1a19f03e3ca0e4"}
Jul 06 19:26:39.899890 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:39.899841    2552 generic.go:356] "Generic (PLEG): container finished" podID="d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea" containerID="b767920713cfe935d05e4e3039143ae9df544db51cc582b33424da5ecde19f64" exitCode=0
Jul 06 19:26:39.900395 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:39.899913    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerDied","Data":"b767920713cfe935d05e4e3039143ae9df544db51cc582b33424da5ecde19f64"}
Jul 06 19:26:40.518970 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:40.518924    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:40.519107 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:40.519045    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:40.519146 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:40.519108    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:44.519092606 +0000 UTC m=+43.446130503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:40.904215 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:40.903478    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5nv5w" event={"ID":"89c50d5c-b643-491f-9ab2-c2edc871fda6","Type":"ContainerStarted","Data":"c3a4fb10d823754dcdd7eb59688d24b36ae9badccf0aa84ccd4dfb549d5dd59f"}
Jul 06 19:26:40.906996 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:40.906973    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" event={"ID":"d63dd42b-f6c1-422c-bcb1-2a8ce800a4ea","Type":"ContainerStarted","Data":"063df440755ce2798a897e5e01771ffacb07e3d069dcad08278e6efdf34cf1fc"}
Jul 06 19:26:40.921519 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:40.921016    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5nv5w" podStartSLOduration=2.133833814 podStartE2EDuration="4.920997839s" totalImagesPullingTime="2.787164025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:40.920538687 +0000 UTC m=+39.847576607" watchObservedRunningTime="2026-07-06 19:26:40.920997839 +0000 UTC m=+39.848035760"
Jul 06 19:26:40.960712 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:40.960658    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hkzgz" podStartSLOduration=10.823603093 podStartE2EDuration="39.960641222s" totalImagesPullingTime="29.137038129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:40.958720918 +0000 UTC m=+39.885758837" watchObservedRunningTime="2026-07-06 19:26:40.960641222 +0000 UTC m=+39.887679140"
Jul 06 19:26:44.543702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:44.543648    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:44.544084 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:44.543815    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:44.544084 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:44.543879    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:52.543863893 +0000 UTC m=+51.470901790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:52.597631 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:26:52.597558    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:26:52.598261 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:52.597710    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:52.598261 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:26:52.597780    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:08.597761295 +0000 UTC m=+67.524799204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:01.888881 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:01.888843    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pggbq"
Jul 06 19:27:07.402118 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.402074    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:27:07.402525 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.402134    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:27:07.402525 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.402179    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:27:07.405306 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.405270    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:27:07.405306 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.405302    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:27:07.405503 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.405349    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:27:07.412924 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:07.412905    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:27:07.412999 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:07.412991    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs podName:abc04eba-5cd2-4909-a877-16816a9fb151 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:11.412973342 +0000 UTC m=+130.340011239 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs") pod "network-metrics-daemon-2msqc" (UID: "abc04eba-5cd2-4909-a877-16816a9fb151") : secret "metrics-daemon-secret" not found
Jul 06 19:27:07.415969 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.415953    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:27:07.416758 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.416739    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104c43aa-5c63-423f-a55a-0fd25fa7cf9f-original-pull-secret\") pod \"global-pull-secret-syncer-x489d\" (UID: \"104c43aa-5c63-423f-a55a-0fd25fa7cf9f\") " pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:27:07.425726 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.425702    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl297\" (UniqueName: \"kubernetes.io/projected/c053367a-9916-4fcd-9166-f3df7239ac0c-kube-api-access-zl297\") pod \"network-check-target-z9kcf\" (UID: \"c053367a-9916-4fcd-9166-f3df7239ac0c\") " pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:27:07.519095 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.519065    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x44r2\""
Jul 06 19:27:07.521200 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.521181    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x489d"
Jul 06 19:27:07.526743 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.526728    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:27:07.674453 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.674366    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x489d"]
Jul 06 19:27:07.677284 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:27:07.677256    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104c43aa_5c63_423f_a55a_0fd25fa7cf9f.slice/crio-5f8db492ad1823a4d8fb826eeaac4f15933b68565939923f50995dccb57290bf WatchSource:0}: Error finding container 5f8db492ad1823a4d8fb826eeaac4f15933b68565939923f50995dccb57290bf: Status 404 returned error can't find the container with id 5f8db492ad1823a4d8fb826eeaac4f15933b68565939923f50995dccb57290bf
Jul 06 19:27:07.693907 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.693882    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9kcf"]
Jul 06 19:27:07.697133 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:27:07.697110    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc053367a_9916_4fcd_9166_f3df7239ac0c.slice/crio-181d8f3ebfd77e6f78a9c30734f28faf719c20d3a1c8479550c4b4dc1adcd4b3 WatchSource:0}: Error finding container 181d8f3ebfd77e6f78a9c30734f28faf719c20d3a1c8479550c4b4dc1adcd4b3: Status 404 returned error can't find the container with id 181d8f3ebfd77e6f78a9c30734f28faf719c20d3a1c8479550c4b4dc1adcd4b3
Jul 06 19:27:07.972322 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.972290    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9kcf" event={"ID":"c053367a-9916-4fcd-9166-f3df7239ac0c","Type":"ContainerStarted","Data":"181d8f3ebfd77e6f78a9c30734f28faf719c20d3a1c8479550c4b4dc1adcd4b3"}
Jul 06 19:27:07.973249 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:07.973230    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x489d" event={"ID":"104c43aa-5c63-423f-a55a-0fd25fa7cf9f","Type":"ContainerStarted","Data":"5f8db492ad1823a4d8fb826eeaac4f15933b68565939923f50995dccb57290bf"}
Jul 06 19:27:08.611124 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:08.611075    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:27:08.611513 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:08.611217    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:08.611513 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:08.611284    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:40.611265313 +0000 UTC m=+99.538303213 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:12.989589 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:12.989553    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9kcf" event={"ID":"c053367a-9916-4fcd-9166-f3df7239ac0c","Type":"ContainerStarted","Data":"ccb47d4aece16b7a60a623221c1d193528ca7c84b8f88ca089c8486bcca27cc4"}
Jul 06 19:27:12.990043 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:12.989683    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:27:12.991175 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:12.991151    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x489d" event={"ID":"104c43aa-5c63-423f-a55a-0fd25fa7cf9f","Type":"ContainerStarted","Data":"06fc9e27293ea653426f190e6219be4ef6128c948c60b325ddb753dfe0217279"}
Jul 06 19:27:13.009573 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:13.009526    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z9kcf" podStartSLOduration=67.477353303 podStartE2EDuration="1m12.009512762s" totalImagesPullingTime="4.532159459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:13.008474101 +0000 UTC m=+71.935512019" watchObservedRunningTime="2026-07-06 19:27:13.009512762 +0000 UTC m=+71.936550680"
Jul 06 19:27:13.031196 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:13.031150    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x489d" podStartSLOduration=67.475629053 podStartE2EDuration="1m12.031136101s" totalImagesPullingTime="4.555507048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:13.030402219 +0000 UTC m=+71.957440137" watchObservedRunningTime="2026-07-06 19:27:13.031136101 +0000 UTC m=+71.958174020"
Jul 06 19:27:38.916575 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.916544    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"]
Jul 06 19:27:38.919803 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.919782    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:38.923049 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.923025    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:27:38.925978 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.925909    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:27:38.926090 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.926006    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 19:27:38.926090 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.926010    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 19:27:38.926326 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.926311    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qbhsl\""
Jul 06 19:27:38.936731 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:38.936709    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"]
Jul 06 19:27:39.012180 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.012143    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ftzz\" (UniqueName: \"kubernetes.io/projected/8951dd98-12c9-4ad2-9141-611839ae9331-kube-api-access-5ftzz\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.012180 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.012183    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.012394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.012209    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8951dd98-12c9-4ad2-9141-611839ae9331-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.113278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.113235    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ftzz\" (UniqueName: \"kubernetes.io/projected/8951dd98-12c9-4ad2-9141-611839ae9331-kube-api-access-5ftzz\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.113479 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.113285    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.113479 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.113415    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:39.113479 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.113425    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8951dd98-12c9-4ad2-9141-611839ae9331-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.113625 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.113485    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls podName:8951dd98-12c9-4ad2-9141-611839ae9331 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:39.613465219 +0000 UTC m=+98.540503135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-p2fn5" (UID: "8951dd98-12c9-4ad2-9141-611839ae9331") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:39.114187 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.114165    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8951dd98-12c9-4ad2-9141-611839ae9331-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.135590 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.135553    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ftzz\" (UniqueName: \"kubernetes.io/projected/8951dd98-12c9-4ad2-9141-611839ae9331-kube-api-access-5ftzz\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.136430 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.133181    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-k9njh"]
Jul 06 19:27:39.138900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.138880    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b887b8649-ztlst"]
Jul 06 19:27:39.139109 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.139088    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.140777 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.140759    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.145090 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145062    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 19:27:39.145463 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145442    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f5l9t\""
Jul 06 19:27:39.145546 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145524    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 19:27:39.145604 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145574    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:39.145660 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145598    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:27:39.145710 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145662    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:27:39.145763 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.145754    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:27:39.146043 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.146021    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgt64\""
Jul 06 19:27:39.150692 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.150671    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:39.151684 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.151664    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-k9njh"]
Jul 06 19:27:39.155771 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.155753    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:27:39.155881 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.155843    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 19:27:39.157171 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.157151    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b887b8649-ztlst"]
Jul 06 19:27:39.214780 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214744    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1412b6e-e12b-40f1-9bc2-aff67c564af7-serving-cert\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.214780 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214783    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4fsm\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-kube-api-access-g4fsm\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214831    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1412b6e-e12b-40f1-9bc2-aff67c564af7-trusted-ca\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214852    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-certificates\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214879    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-ca-trust-extracted\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-installation-pull-secrets\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.214991    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.215055    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjxqq\" (UniqueName: \"kubernetes.io/projected/d1412b6e-e12b-40f1-9bc2-aff67c564af7-kube-api-access-sjxqq\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.215092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.215080    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-trusted-ca\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215347 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.215106    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1412b6e-e12b-40f1-9bc2-aff67c564af7-config\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.215347 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.215132    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-image-registry-private-configuration\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.215347 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.215157    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-bound-sa-token\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316056 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316019    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjxqq\" (UniqueName: \"kubernetes.io/projected/d1412b6e-e12b-40f1-9bc2-aff67c564af7-kube-api-access-sjxqq\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.316056 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316054    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-trusted-ca\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316312 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316075    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1412b6e-e12b-40f1-9bc2-aff67c564af7-config\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.316312 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316092    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-image-registry-private-configuration\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316312 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316220    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-bound-sa-token\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316312 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316273    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1412b6e-e12b-40f1-9bc2-aff67c564af7-serving-cert\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.316519 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316423    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4fsm\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-kube-api-access-g4fsm\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316519 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316489    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1412b6e-e12b-40f1-9bc2-aff67c564af7-trusted-ca\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.316622 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316519    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-certificates\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316622 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316588    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-ca-trust-extracted\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316622 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316613    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-installation-pull-secrets\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316770 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.316826 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.316811    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:39.316882 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.316827    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b887b8649-ztlst: secret "image-registry-tls" not found
Jul 06 19:27:39.316882 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316866    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1412b6e-e12b-40f1-9bc2-aff67c564af7-config\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.317020 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.316890    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls podName:4bd913b3-28d0-4e1e-b983-5c8bc2eef497 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:39.81687352 +0000 UTC m=+98.743911432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls") pod "image-registry-5b887b8649-ztlst" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497") : secret "image-registry-tls" not found
Jul 06 19:27:39.317020 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.316983    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-ca-trust-extracted\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.317167 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.317146    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-trusted-ca\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.317645 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.317623    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-certificates\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.317735 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.317712    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d1412b6e-e12b-40f1-9bc2-aff67c564af7-trusted-ca\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.319004 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.318974    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1412b6e-e12b-40f1-9bc2-aff67c564af7-serving-cert\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.319004 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.318987    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-image-registry-private-configuration\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.319142 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.319054    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-installation-pull-secrets\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.327165 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.327132    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-bound-sa-token\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.327385 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.327366    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4fsm\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-kube-api-access-g4fsm\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.327840 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.327815    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjxqq\" (UniqueName: \"kubernetes.io/projected/d1412b6e-e12b-40f1-9bc2-aff67c564af7-kube-api-access-sjxqq\") pod \"console-operator-68b757fb67-k9njh\" (UID: \"d1412b6e-e12b-40f1-9bc2-aff67c564af7\") " pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.449801 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.449761    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:39.585071 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.585035    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-k9njh"]
Jul 06 19:27:39.591034 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:27:39.591003    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1412b6e_e12b_40f1_9bc2_aff67c564af7.slice/crio-b38b00b9c9ba517e1f8ede465317b5c841c50a91921b8a8f1f8566d9ba5520cd WatchSource:0}: Error finding container b38b00b9c9ba517e1f8ede465317b5c841c50a91921b8a8f1f8566d9ba5520cd: Status 404 returned error can't find the container with id b38b00b9c9ba517e1f8ede465317b5c841c50a91921b8a8f1f8566d9ba5520cd
Jul 06 19:27:39.619322 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.619290    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:39.619492 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.619454    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:39.619541 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.619520    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls podName:8951dd98-12c9-4ad2-9141-611839ae9331 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:40.619504968 +0000 UTC m=+99.546542864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-p2fn5" (UID: "8951dd98-12c9-4ad2-9141-611839ae9331") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:39.821430 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.821338    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:39.821586 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.821450    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:39.821586 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.821462    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b887b8649-ztlst: secret "image-registry-tls" not found
Jul 06 19:27:39.821586 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:39.821509    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls podName:4bd913b3-28d0-4e1e-b983-5c8bc2eef497 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:40.821496667 +0000 UTC m=+99.748534564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls") pod "image-registry-5b887b8649-ztlst" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497") : secret "image-registry-tls" not found
Jul 06 19:27:39.955425 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.955389    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"]
Jul 06 19:27:39.958497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.958479    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"
Jul 06 19:27:39.963476 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.963453    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2z7x7\""
Jul 06 19:27:39.973657 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:39.973635    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"]
Jul 06 19:27:40.023206 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.023159    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxj5\" (UniqueName: \"kubernetes.io/projected/20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c-kube-api-access-fsxj5\") pod \"network-check-source-989f8b8dc-5mqkv\" (UID: \"20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"
Jul 06 19:27:40.057175 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.057136    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" event={"ID":"d1412b6e-e12b-40f1-9bc2-aff67c564af7","Type":"ContainerStarted","Data":"b38b00b9c9ba517e1f8ede465317b5c841c50a91921b8a8f1f8566d9ba5520cd"}
Jul 06 19:27:40.123900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.123811    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxj5\" (UniqueName: \"kubernetes.io/projected/20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c-kube-api-access-fsxj5\") pod \"network-check-source-989f8b8dc-5mqkv\" (UID: \"20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"
Jul 06 19:27:40.134001 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.133972    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxj5\" (UniqueName: \"kubernetes.io/projected/20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c-kube-api-access-fsxj5\") pod \"network-check-source-989f8b8dc-5mqkv\" (UID: \"20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"
Jul 06 19:27:40.266849 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.266811    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"
Jul 06 19:27:40.415403 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.415318    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv"]
Jul 06 19:27:40.419300 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:27:40.419266    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c366ab_7b90_49b8_b09d_8c5ab2ac6b1c.slice/crio-4e47dc84dbcb19f2d60600171b645f30c5621d5e3c05b2f47c8239fa02955aec WatchSource:0}: Error finding container 4e47dc84dbcb19f2d60600171b645f30c5621d5e3c05b2f47c8239fa02955aec: Status 404 returned error can't find the container with id 4e47dc84dbcb19f2d60600171b645f30c5621d5e3c05b2f47c8239fa02955aec
Jul 06 19:27:40.627192 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.627153    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:27:40.627358 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.627272    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:40.627358 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.627339    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:40.627453 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.627391    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:40.627453 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.627423    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls podName:5009aab8-4943-42c6-ad20-fa8f21bfde30 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:44.627399426 +0000 UTC m=+163.554437375 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls") pod "dns-default-qv4m2" (UID: "5009aab8-4943-42c6-ad20-fa8f21bfde30") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:40.627453 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.627447    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls podName:8951dd98-12c9-4ad2-9141-611839ae9331 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:42.627430758 +0000 UTC m=+101.554468661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-p2fn5" (UID: "8951dd98-12c9-4ad2-9141-611839ae9331") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:40.829434 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:40.829391    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:40.829633 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.829564    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:40.829633 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.829586    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b887b8649-ztlst: secret "image-registry-tls" not found
Jul 06 19:27:40.829723 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:40.829653    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls podName:4bd913b3-28d0-4e1e-b983-5c8bc2eef497 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:42.829632926 +0000 UTC m=+101.756670836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls") pod "image-registry-5b887b8649-ztlst" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497") : secret "image-registry-tls" not found
Jul 06 19:27:41.061535 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:41.061491    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv" event={"ID":"20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c","Type":"ContainerStarted","Data":"b739e057594c5173003ecea4543311ac3c1153451ca67daeffa32ca7618c0a50"}
Jul 06 19:27:41.061535 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:41.061542    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv" event={"ID":"20c366ab-7b90-49b8-b09d-8c5ab2ac6b1c","Type":"ContainerStarted","Data":"4e47dc84dbcb19f2d60600171b645f30c5621d5e3c05b2f47c8239fa02955aec"}
Jul 06 19:27:41.080907 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:41.080793    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5mqkv" podStartSLOduration=2.080775776 podStartE2EDuration="2.080775776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:41.079531057 +0000 UTC m=+100.006568976" watchObservedRunningTime="2026-07-06 19:27:41.080775776 +0000 UTC m=+100.007813693"
Jul 06 19:27:42.066198 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:42.066173    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/0.log"
Jul 06 19:27:42.066560 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:42.066214    2552 generic.go:356] "Generic (PLEG): container finished" podID="d1412b6e-e12b-40f1-9bc2-aff67c564af7" containerID="816a3e4784cb317cd8c58b6605ad7735d893dfc90ef47cc06c4673741569b803" exitCode=255
Jul 06 19:27:42.066560 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:42.066310    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" event={"ID":"d1412b6e-e12b-40f1-9bc2-aff67c564af7","Type":"ContainerDied","Data":"816a3e4784cb317cd8c58b6605ad7735d893dfc90ef47cc06c4673741569b803"}
Jul 06 19:27:42.066660 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:42.066646    2552 scope.go:117] "RemoveContainer" containerID="816a3e4784cb317cd8c58b6605ad7735d893dfc90ef47cc06c4673741569b803"
Jul 06 19:27:42.645267 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:42.645210    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:42.645452 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:42.645369    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:42.645452 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:42.645438    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls podName:8951dd98-12c9-4ad2-9141-611839ae9331 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:46.645422313 +0000 UTC m=+105.572460232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-p2fn5" (UID: "8951dd98-12c9-4ad2-9141-611839ae9331") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:42.847380 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:42.847348    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:42.847478 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:42.847460    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:42.847478 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:42.847473    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b887b8649-ztlst: secret "image-registry-tls" not found
Jul 06 19:27:42.847539 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:42.847522    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls podName:4bd913b3-28d0-4e1e-b983-5c8bc2eef497 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:46.847508855 +0000 UTC m=+105.774546765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls") pod "image-registry-5b887b8649-ztlst" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497") : secret "image-registry-tls" not found
Jul 06 19:27:43.071199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.071170    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:27:43.071658 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.071574    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/0.log"
Jul 06 19:27:43.071658 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.071605    2552 generic.go:356] "Generic (PLEG): container finished" podID="d1412b6e-e12b-40f1-9bc2-aff67c564af7" containerID="b0b710dfaa93ba2712b5d2ce1eccc538e935eee9a1441bff4d720a97e1a1416d" exitCode=255
Jul 06 19:27:43.071658 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.071630    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" event={"ID":"d1412b6e-e12b-40f1-9bc2-aff67c564af7","Type":"ContainerDied","Data":"b0b710dfaa93ba2712b5d2ce1eccc538e935eee9a1441bff4d720a97e1a1416d"}
Jul 06 19:27:43.071811 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.071682    2552 scope.go:117] "RemoveContainer" containerID="816a3e4784cb317cd8c58b6605ad7735d893dfc90ef47cc06c4673741569b803"
Jul 06 19:27:43.071986 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.071968    2552 scope.go:117] "RemoveContainer" containerID="b0b710dfaa93ba2712b5d2ce1eccc538e935eee9a1441bff4d720a97e1a1416d"
Jul 06 19:27:43.072170 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:43.072151    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-k9njh_openshift-console-operator(d1412b6e-e12b-40f1-9bc2-aff67c564af7)\"" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" podUID="d1412b6e-e12b-40f1-9bc2-aff67c564af7"
Jul 06 19:27:43.779387 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.779352    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-297nl"]
Jul 06 19:27:43.794577 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.794546    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.796358 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.796329    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-297nl"]
Jul 06 19:27:43.798540 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.798521    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:27:43.798817 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.798802    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:27:43.799446 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.799422    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:27:43.799541 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.799458    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtdxx\""
Jul 06 19:27:43.799541 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.799477    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:27:43.853502 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.853465    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.853674 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.853517    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.853674 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.853541    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e456d65-8100-4074-a932-7a3747160f8a-crio-socket\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.853674 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.853559    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e456d65-8100-4074-a932-7a3747160f8a-data-volume\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.853674 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.853635    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv24w\" (UniqueName: \"kubernetes.io/projected/6e456d65-8100-4074-a932-7a3747160f8a-kube-api-access-sv24w\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.954973 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.954916    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv24w\" (UniqueName: \"kubernetes.io/projected/6e456d65-8100-4074-a932-7a3747160f8a-kube-api-access-sv24w\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.955164 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.955034    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.955164 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.955092    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.955164 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.955122    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e456d65-8100-4074-a932-7a3747160f8a-crio-socket\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.955164 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.955147    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e456d65-8100-4074-a932-7a3747160f8a-data-volume\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.955307 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:43.955185    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:43.955307 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:43.955192    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:43.955307 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.955239    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e456d65-8100-4074-a932-7a3747160f8a-crio-socket\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.955307 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:43.955262    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:44.455244397 +0000 UTC m=+103.382282295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:43.955307 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:43.955290    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:44.45527145 +0000 UTC m=+103.382309347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:43.955477 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.955465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e456d65-8100-4074-a932-7a3747160f8a-data-volume\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.964800 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.964774    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv24w\" (UniqueName: \"kubernetes.io/projected/6e456d65-8100-4074-a932-7a3747160f8a-kube-api-access-sv24w\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:43.995501 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:43.995457    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z9kcf"
Jul 06 19:27:44.075884 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:44.075814    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:27:44.076369 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:44.076249    2552 scope.go:117] "RemoveContainer" containerID="b0b710dfaa93ba2712b5d2ce1eccc538e935eee9a1441bff4d720a97e1a1416d"
Jul 06 19:27:44.076472 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:44.076448    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-k9njh_openshift-console-operator(d1412b6e-e12b-40f1-9bc2-aff67c564af7)\"" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" podUID="d1412b6e-e12b-40f1-9bc2-aff67c564af7"
Jul 06 19:27:44.457978 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:44.457928    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:44.458191 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:44.458005    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:44.458191 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:44.458086    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:44.458191 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:44.458152    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:45.458136974 +0000 UTC m=+104.385174871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:44.458191 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:44.458086    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:44.458328 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:44.458226    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:45.458213278 +0000 UTC m=+104.385251193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:45.467653 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:45.467608    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:45.468137 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:45.467737    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:45.468137 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:45.467743    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:45.468137 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:45.467821    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:47.467801136 +0000 UTC m=+106.394839034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:45.468137 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:45.467878    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:45.468137 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:45.467964    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:47.46792352 +0000 UTC m=+106.394961438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:45.745775 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:45.745695    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ttfp_9780e3f9-889b-4b83-8570-f5bff19af292/dns-node-resolver/0.log"
Jul 06 19:27:46.677573 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:46.677524    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:46.678083 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:46.677706    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:46.678083 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:46.677792    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls podName:8951dd98-12c9-4ad2-9141-611839ae9331 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.677769226 +0000 UTC m=+113.604807145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-p2fn5" (UID: "8951dd98-12c9-4ad2-9141-611839ae9331") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:46.879313 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:46.879279    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:46.879533 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:46.879386    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:46.879533 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:46.879398    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b887b8649-ztlst: secret "image-registry-tls" not found
Jul 06 19:27:46.879533 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:46.879448    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls podName:4bd913b3-28d0-4e1e-b983-5c8bc2eef497 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.879434097 +0000 UTC m=+113.806471994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls") pod "image-registry-5b887b8649-ztlst" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497") : secret "image-registry-tls" not found
Jul 06 19:27:46.948048 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:46.948024    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfk8t_02c0ed33-d2dd-4667-82be-a1db58dc12a3/node-ca/0.log"
Jul 06 19:27:47.348536 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:47.348462    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nv5w_89c50d5c-b643-491f-9ab2-c2edc871fda6/serve-healthcheck-canary/0.log"
Jul 06 19:27:47.484229 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:47.484175    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:47.484419 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:47.484251    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:47.484419 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:47.484330    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:47.484419 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:47.484356    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:47.484419 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:47.484396    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.484382191 +0000 UTC m=+110.411420089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:47.484419 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:47.484411    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.484404837 +0000 UTC m=+110.411442734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:49.450053 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:49.450011    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:49.450434 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:49.450076    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:27:49.450434 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:49.450399    2552 scope.go:117] "RemoveContainer" containerID="b0b710dfaa93ba2712b5d2ce1eccc538e935eee9a1441bff4d720a97e1a1416d"
Jul 06 19:27:49.450585 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:49.450564    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-k9njh_openshift-console-operator(d1412b6e-e12b-40f1-9bc2-aff67c564af7)\"" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" podUID="d1412b6e-e12b-40f1-9bc2-aff67c564af7"
Jul 06 19:27:51.516786 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:51.516741    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:51.517194 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:51.516821    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:51.517194 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:51.516885    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:51.517194 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:51.516901    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:51.517194 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:51.516968    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.516953372 +0000 UTC m=+118.443991268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:51.517194 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:51.516983    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls podName:6e456d65-8100-4074-a932-7a3747160f8a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.516975641 +0000 UTC m=+118.444013537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-297nl" (UID: "6e456d65-8100-4074-a932-7a3747160f8a") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:54.745761 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:54.745719    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:27:54.746166 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:54.745863    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:54.746166 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:27:54.745927    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls podName:8951dd98-12c9-4ad2-9141-611839ae9331 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:10.745910498 +0000 UTC m=+129.672948395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-p2fn5" (UID: "8951dd98-12c9-4ad2-9141-611839ae9331") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:54.947606 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:54.947569    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:54.950090 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:54.950062    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"image-registry-5b887b8649-ztlst\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") " pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:55.056310 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:55.056207    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:55.185046 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:55.184986    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b887b8649-ztlst"]
Jul 06 19:27:55.188402 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:27:55.188367    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd913b3_28d0_4e1e_b983_5c8bc2eef497.slice/crio-bcdbb1e5a5a70793869e9e2e16c848c688fceba3d5bbef887b7c4ba828e36c83 WatchSource:0}: Error finding container bcdbb1e5a5a70793869e9e2e16c848c688fceba3d5bbef887b7c4ba828e36c83: Status 404 returned error can't find the container with id bcdbb1e5a5a70793869e9e2e16c848c688fceba3d5bbef887b7c4ba828e36c83
Jul 06 19:27:56.111712 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:56.111677    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" event={"ID":"4bd913b3-28d0-4e1e-b983-5c8bc2eef497","Type":"ContainerStarted","Data":"a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d"}
Jul 06 19:27:56.112096 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:56.111735    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" event={"ID":"4bd913b3-28d0-4e1e-b983-5c8bc2eef497","Type":"ContainerStarted","Data":"bcdbb1e5a5a70793869e9e2e16c848c688fceba3d5bbef887b7c4ba828e36c83"}
Jul 06 19:27:56.112096 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:56.111811    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:27:56.144371 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:56.144322    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" podStartSLOduration=17.144306262 podStartE2EDuration="17.144306262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:56.143994074 +0000 UTC m=+115.071031994" watchObservedRunningTime="2026-07-06 19:27:56.144306262 +0000 UTC m=+115.071344179"
Jul 06 19:27:59.582187 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:59.582147    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:59.582679 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:59.582218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:59.582827 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:59.582805    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e456d65-8100-4074-a932-7a3747160f8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:59.584592 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:59.584567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e456d65-8100-4074-a932-7a3747160f8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-297nl\" (UID: \"6e456d65-8100-4074-a932-7a3747160f8a\") " pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:59.703772 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:59.703739    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-297nl"
Jul 06 19:27:59.840005 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:27:59.839905    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-297nl"]
Jul 06 19:27:59.844212 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:27:59.844187    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e456d65_8100_4074_a932_7a3747160f8a.slice/crio-917729f6f850a96c781ae51a077bf09f4df0cb96b601290367843a2af3117658 WatchSource:0}: Error finding container 917729f6f850a96c781ae51a077bf09f4df0cb96b601290367843a2af3117658: Status 404 returned error can't find the container with id 917729f6f850a96c781ae51a077bf09f4df0cb96b601290367843a2af3117658
Jul 06 19:28:00.125517 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:00.125432    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-297nl" event={"ID":"6e456d65-8100-4074-a932-7a3747160f8a","Type":"ContainerStarted","Data":"917729f6f850a96c781ae51a077bf09f4df0cb96b601290367843a2af3117658"}
Jul 06 19:28:00.700950 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:00.700844    2552 scope.go:117] "RemoveContainer" containerID="b0b710dfaa93ba2712b5d2ce1eccc538e935eee9a1441bff4d720a97e1a1416d"
Jul 06 19:28:01.131388 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:01.131311    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:28:01.131388 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:01.131368    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" event={"ID":"d1412b6e-e12b-40f1-9bc2-aff67c564af7","Type":"ContainerStarted","Data":"ff65653fe3e4c5d0624c0fb570416e05aaa2714517979959ff3ec5644975d528"}
Jul 06 19:28:01.131746 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:01.131722    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:28:01.153719 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:01.153652    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-k9njh" podStartSLOduration=19.833908814 podStartE2EDuration="22.153628337s" totalImagesPullingTime="2.319719523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:01.152170844 +0000 UTC m=+120.079208759" watchObservedRunningTime="2026-07-06 19:28:01.153628337 +0000 UTC m=+120.080666255"
Jul 06 19:28:01.230145 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:01.230108    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-k9njh"
Jul 06 19:28:04.143054 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:04.143017    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-297nl" event={"ID":"6e456d65-8100-4074-a932-7a3747160f8a","Type":"ContainerStarted","Data":"8362cd677a15d4b530a6f8368ffc47f7c86ea7ec76b4b1e61a6f342571f680e1"}
Jul 06 19:28:05.148215 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:05.148176    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-297nl" event={"ID":"6e456d65-8100-4074-a932-7a3747160f8a","Type":"ContainerStarted","Data":"549fa1735ee3403950696884786a822bce96c535f114611ce023d4de01606a7f"}
Jul 06 19:28:06.500953 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.500899    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"]
Jul 06 19:28:06.514003 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.513975    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.518213 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.518187    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mbrg9\""
Jul 06 19:28:06.518348 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.518220    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 19:28:06.518348 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.518226    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 19:28:06.524613 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.524037    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b887b8649-ztlst"]
Jul 06 19:28:06.526066 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.526003    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"]
Jul 06 19:28:06.550863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.550831    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74f4778987-szc7j"]
Jul 06 19:28:06.553015 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.552996    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.584771 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.584741    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f4778987-szc7j"]
Jul 06 19:28:06.642138 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642114    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24c115c9-c3a7-41b3-8d39-fc7852a79a94-trusted-ca\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642271 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-registry-tls\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642271 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642174    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24c115c9-c3a7-41b3-8d39-fc7852a79a94-registry-certificates\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642271 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642245    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24c115c9-c3a7-41b3-8d39-fc7852a79a94-installation-pull-secrets\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642397 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642272    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd16a3a6-90a8-4287-af60-88edfc4cf9df-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d6rnw\" (UID: \"bd16a3a6-90a8-4287-af60-88edfc4cf9df\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.642397 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642308    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24c115c9-c3a7-41b3-8d39-fc7852a79a94-ca-trust-extracted\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642397 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-bound-sa-token\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642397 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642377    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd16a3a6-90a8-4287-af60-88edfc4cf9df-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-d6rnw\" (UID: \"bd16a3a6-90a8-4287-af60-88edfc4cf9df\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.642534 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642400    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24c115c9-c3a7-41b3-8d39-fc7852a79a94-image-registry-private-configuration\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.642534 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.642416    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zbt\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-kube-api-access-l9zbt\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743515 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743475    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24c115c9-c3a7-41b3-8d39-fc7852a79a94-trusted-ca\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743515 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743511    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-registry-tls\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743736 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743529    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24c115c9-c3a7-41b3-8d39-fc7852a79a94-registry-certificates\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743736 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24c115c9-c3a7-41b3-8d39-fc7852a79a94-installation-pull-secrets\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743736 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743699    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd16a3a6-90a8-4287-af60-88edfc4cf9df-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d6rnw\" (UID: \"bd16a3a6-90a8-4287-af60-88edfc4cf9df\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.743887 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743747    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24c115c9-c3a7-41b3-8d39-fc7852a79a94-ca-trust-extracted\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743887 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743771    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-bound-sa-token\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.743887 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743851    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd16a3a6-90a8-4287-af60-88edfc4cf9df-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-d6rnw\" (UID: \"bd16a3a6-90a8-4287-af60-88edfc4cf9df\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.743887 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743874    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24c115c9-c3a7-41b3-8d39-fc7852a79a94-image-registry-private-configuration\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.744116 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.743900    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zbt\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-kube-api-access-l9zbt\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.744446 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.744419    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24c115c9-c3a7-41b3-8d39-fc7852a79a94-registry-certificates\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.744606 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.744585    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24c115c9-c3a7-41b3-8d39-fc7852a79a94-trusted-ca\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.744700 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.744674    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24c115c9-c3a7-41b3-8d39-fc7852a79a94-ca-trust-extracted\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.744801 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.744780    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd16a3a6-90a8-4287-af60-88edfc4cf9df-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-d6rnw\" (UID: \"bd16a3a6-90a8-4287-af60-88edfc4cf9df\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.746423 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.746396    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bd16a3a6-90a8-4287-af60-88edfc4cf9df-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-d6rnw\" (UID: \"bd16a3a6-90a8-4287-af60-88edfc4cf9df\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.746587 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.746571    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24c115c9-c3a7-41b3-8d39-fc7852a79a94-installation-pull-secrets\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.746704 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.746686    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24c115c9-c3a7-41b3-8d39-fc7852a79a94-image-registry-private-configuration\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.746756 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.746737    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-registry-tls\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.754981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.754908    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zbt\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-kube-api-access-l9zbt\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.756500 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.756480    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24c115c9-c3a7-41b3-8d39-fc7852a79a94-bound-sa-token\") pod \"image-registry-74f4778987-szc7j\" (UID: \"24c115c9-c3a7-41b3-8d39-fc7852a79a94\") " pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.826813 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.826768    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"
Jul 06 19:28:06.862059 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.862024    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:06.967053 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:06.967021    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw"]
Jul 06 19:28:06.970262 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:06.970238    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd16a3a6_90a8_4287_af60_88edfc4cf9df.slice/crio-91f84148a0cac51eee7c0884bb22d87adc9f2b236942341df10cfd3b66b0c386 WatchSource:0}: Error finding container 91f84148a0cac51eee7c0884bb22d87adc9f2b236942341df10cfd3b66b0c386: Status 404 returned error can't find the container with id 91f84148a0cac51eee7c0884bb22d87adc9f2b236942341df10cfd3b66b0c386
Jul 06 19:28:07.015506 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.015434    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f4778987-szc7j"]
Jul 06 19:28:07.018424 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:07.018392    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c115c9_c3a7_41b3_8d39_fc7852a79a94.slice/crio-72d11785f18d7033ddb7b274c956dbba07d41a5d602e50d2537f7d10b5ca501a WatchSource:0}: Error finding container 72d11785f18d7033ddb7b274c956dbba07d41a5d602e50d2537f7d10b5ca501a: Status 404 returned error can't find the container with id 72d11785f18d7033ddb7b274c956dbba07d41a5d602e50d2537f7d10b5ca501a
Jul 06 19:28:07.158613 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.158574    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-297nl" event={"ID":"6e456d65-8100-4074-a932-7a3747160f8a","Type":"ContainerStarted","Data":"e13713b528603a67dbc292da55eb1e06a5c85159afc44e63131d1e307c5cb063"}
Jul 06 19:28:07.160067 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.160044    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f4778987-szc7j" event={"ID":"24c115c9-c3a7-41b3-8d39-fc7852a79a94","Type":"ContainerStarted","Data":"5d5d37c2497efcd82cb1257aeade45f2a4db34a95a5ac38f22e92615eaf0d843"}
Jul 06 19:28:07.160211 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.160080    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f4778987-szc7j" event={"ID":"24c115c9-c3a7-41b3-8d39-fc7852a79a94","Type":"ContainerStarted","Data":"72d11785f18d7033ddb7b274c956dbba07d41a5d602e50d2537f7d10b5ca501a"}
Jul 06 19:28:07.160211 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.160135    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:07.161297 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.161277    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw" event={"ID":"bd16a3a6-90a8-4287-af60-88edfc4cf9df","Type":"ContainerStarted","Data":"91f84148a0cac51eee7c0884bb22d87adc9f2b236942341df10cfd3b66b0c386"}
Jul 06 19:28:07.178729 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.178677    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-297nl" podStartSLOduration=17.501642826 podStartE2EDuration="24.178656211s" totalImagesPullingTime="6.677013385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:07.178410119 +0000 UTC m=+126.105448037" watchObservedRunningTime="2026-07-06 19:28:07.178656211 +0000 UTC m=+126.105694127"
Jul 06 19:28:07.207317 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:07.207262    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podStartSLOduration=1.207246987 podStartE2EDuration="1.207246987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:07.206302907 +0000 UTC m=+126.133340825" watchObservedRunningTime="2026-07-06 19:28:07.207246987 +0000 UTC m=+126.134284903"
Jul 06 19:28:08.166332 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:08.166289    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw" event={"ID":"bd16a3a6-90a8-4287-af60-88edfc4cf9df","Type":"ContainerStarted","Data":"8434f4d8796be7d120fc5e3e9c08a76b62c09b431cd0a93505d7e8a0dd529ad6"}
Jul 06 19:28:08.183249 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:08.183097    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-d6rnw" podStartSLOduration=1.210511935 podStartE2EDuration="2.18307842s" totalImagesPullingTime="972.566485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:08.182163148 +0000 UTC m=+127.109201066" watchObservedRunningTime="2026-07-06 19:28:08.18307842 +0000 UTC m=+127.110116340"
Jul 06 19:28:10.779026 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:10.778973    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:28:10.781411 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:10.781392    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8951dd98-12c9-4ad2-9141-611839ae9331-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-p2fn5\" (UID: \"8951dd98-12c9-4ad2-9141-611839ae9331\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:28:11.031430 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.031354    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qbhsl\""
Jul 06 19:28:11.038989 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.038970    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"
Jul 06 19:28:11.172137 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.172034    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5"]
Jul 06 19:28:11.174694 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:11.174667    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8951dd98_12c9_4ad2_9141_611839ae9331.slice/crio-4496b06d62ec4b03293e7265948a7857606bb5a7f1e5d7fddee266dd709b7ec5 WatchSource:0}: Error finding container 4496b06d62ec4b03293e7265948a7857606bb5a7f1e5d7fddee266dd709b7ec5: Status 404 returned error can't find the container with id 4496b06d62ec4b03293e7265948a7857606bb5a7f1e5d7fddee266dd709b7ec5
Jul 06 19:28:11.180680 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.180641    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5" event={"ID":"8951dd98-12c9-4ad2-9141-611839ae9331","Type":"ContainerStarted","Data":"4496b06d62ec4b03293e7265948a7857606bb5a7f1e5d7fddee266dd709b7ec5"}
Jul 06 19:28:11.483976 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.483907    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:28:11.486384 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.486363    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abc04eba-5cd2-4909-a877-16816a9fb151-metrics-certs\") pod \"network-metrics-daemon-2msqc\" (UID: \"abc04eba-5cd2-4909-a877-16816a9fb151\") " pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:28:11.729706 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.729674    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmvz5\""
Jul 06 19:28:11.736856 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.736791    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2msqc"
Jul 06 19:28:11.875698 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:11.875668    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2msqc"]
Jul 06 19:28:11.878418 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:11.878385    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc04eba_5cd2_4909_a877_16816a9fb151.slice/crio-66464150a45d8e0255c820856c0417c48a27cacfa3526d3aafc43ce1141798eb WatchSource:0}: Error finding container 66464150a45d8e0255c820856c0417c48a27cacfa3526d3aafc43ce1141798eb: Status 404 returned error can't find the container with id 66464150a45d8e0255c820856c0417c48a27cacfa3526d3aafc43ce1141798eb
Jul 06 19:28:12.185366 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.185340    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2msqc" event={"ID":"abc04eba-5cd2-4909-a877-16816a9fb151","Type":"ContainerStarted","Data":"66464150a45d8e0255c820856c0417c48a27cacfa3526d3aafc43ce1141798eb"}
Jul 06 19:28:12.543514 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.543427    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ddfc848f-jfw4r"]
Jul 06 19:28:12.545904 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.545878    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.548992 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.548973    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:28:12.550279 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.550240    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:28:12.550389 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.550284    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zpmgh\""
Jul 06 19:28:12.550449 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.550431    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:28:12.550516 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.550446    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:28:12.550590 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.550573    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:28:12.550650 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.550600    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:28:12.551624 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.551502    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:28:12.560216 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.560046    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddfc848f-jfw4r"]
Jul 06 19:28:12.694771 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.694728    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwqh\" (UniqueName: \"kubernetes.io/projected/85806073-eff1-4553-a201-9c7becc670fd-kube-api-access-njwqh\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.694992 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.694880    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-service-ca\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.694992 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.694971    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-oauth-config\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.695121 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.695041    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-oauth-serving-cert\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.695121 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.695108    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-serving-cert\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.695293 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.695132    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-console-config\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.795877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.795794    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-oauth-config\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.795877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.795842    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-oauth-serving-cert\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796118 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.795887    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-serving-cert\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796118 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.795907    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-console-config\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796118 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.795947    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njwqh\" (UniqueName: \"kubernetes.io/projected/85806073-eff1-4553-a201-9c7becc670fd-kube-api-access-njwqh\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796118 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.796024    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-service-ca\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796683 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.796657    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-service-ca\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796781 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.796681    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-console-config\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.796781 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.796681    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-oauth-serving-cert\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.798805 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.798786    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-serving-cert\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.798894 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.798874    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-oauth-config\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.805554 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.805531    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwqh\" (UniqueName: \"kubernetes.io/projected/85806073-eff1-4553-a201-9c7becc670fd-kube-api-access-njwqh\") pod \"console-5ddfc848f-jfw4r\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") " pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:12.863871 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:12.863836    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:13.524013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:13.523962    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddfc848f-jfw4r"]
Jul 06 19:28:13.527521 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:13.527485    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85806073_eff1_4553_a201_9c7becc670fd.slice/crio-b841215c02e0372b5e48002662b281201e1238c787e21164f7ae39e1c44c88f8 WatchSource:0}: Error finding container b841215c02e0372b5e48002662b281201e1238c787e21164f7ae39e1c44c88f8: Status 404 returned error can't find the container with id b841215c02e0372b5e48002662b281201e1238c787e21164f7ae39e1c44c88f8
Jul 06 19:28:14.194167 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:14.194131    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5" event={"ID":"8951dd98-12c9-4ad2-9141-611839ae9331","Type":"ContainerStarted","Data":"44d1fe6587113ca32d6a969ee4071b0b8addb882f72ad1cfccdf50eb32405b0c"}
Jul 06 19:28:14.195909 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:14.195881    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2msqc" event={"ID":"abc04eba-5cd2-4909-a877-16816a9fb151","Type":"ContainerStarted","Data":"b395e283f4514b588384202da43b0eba9dc90b08d03a8bcd3f21b26836f49faa"}
Jul 06 19:28:14.196066 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:14.195967    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2msqc" event={"ID":"abc04eba-5cd2-4909-a877-16816a9fb151","Type":"ContainerStarted","Data":"d220117976dca2c3a2808999997adfcb5c314837453c38a855ea3ca5c0092886"}
Jul 06 19:28:14.197042 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:14.197020    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfc848f-jfw4r" event={"ID":"85806073-eff1-4553-a201-9c7becc670fd","Type":"ContainerStarted","Data":"b841215c02e0372b5e48002662b281201e1238c787e21164f7ae39e1c44c88f8"}
Jul 06 19:28:14.212125 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:14.212083    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-p2fn5" podStartSLOduration=34.007575377 podStartE2EDuration="36.212067699s" totalImagesPullingTime="2.204492322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:14.210342165 +0000 UTC m=+133.137380085" watchObservedRunningTime="2026-07-06 19:28:14.212067699 +0000 UTC m=+133.139105618"
Jul 06 19:28:14.227179 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:14.227123    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2msqc" podStartSLOduration=131.731590665 podStartE2EDuration="2m13.227107903s" totalImagesPullingTime="1.495517238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:14.226975346 +0000 UTC m=+133.154013265" watchObservedRunningTime="2026-07-06 19:28:14.227107903 +0000 UTC m=+133.154145821"
Jul 06 19:28:16.533142 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:16.533097    2552 patch_prober.go:28] interesting pod/image-registry-5b887b8649-ztlst container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:16.533609 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:16.533171    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:17.208795 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:17.208759    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfc848f-jfw4r" event={"ID":"85806073-eff1-4553-a201-9c7becc670fd","Type":"ContainerStarted","Data":"06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15"}
Jul 06 19:28:19.014675 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.014610    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ddfc848f-jfw4r" podStartSLOduration=3.768040069 podStartE2EDuration="7.01459396s" totalImagesPullingTime="3.246553891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:17.251857169 +0000 UTC m=+136.178895086" watchObservedRunningTime="2026-07-06 19:28:19.01459396 +0000 UTC m=+137.941631878"
Jul 06 19:28:19.015512 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.015495    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"]
Jul 06 19:28:19.017783 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.017767    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.020984 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.020966    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 19:28:19.021114 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.021087    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m67bg\""
Jul 06 19:28:19.022267 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.022251    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:28:19.022418 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.022404    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 19:28:19.035699 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.035669    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"]
Jul 06 19:28:19.048860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.048832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9gz\" (UniqueName: \"kubernetes.io/projected/9da1c63f-94ad-477d-ad5b-20627a1261d9-kube-api-access-jl9gz\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.048997 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.048872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9da1c63f-94ad-477d-ad5b-20627a1261d9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.048997 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.048892    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9da1c63f-94ad-477d-ad5b-20627a1261d9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.048997 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.048908    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9da1c63f-94ad-477d-ad5b-20627a1261d9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.149918 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.149883    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9gz\" (UniqueName: \"kubernetes.io/projected/9da1c63f-94ad-477d-ad5b-20627a1261d9-kube-api-access-jl9gz\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.150132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.149957    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9da1c63f-94ad-477d-ad5b-20627a1261d9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.150132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.149981    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9da1c63f-94ad-477d-ad5b-20627a1261d9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.150132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.150007    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9da1c63f-94ad-477d-ad5b-20627a1261d9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.150646 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.150624    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9da1c63f-94ad-477d-ad5b-20627a1261d9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.152553 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.152528    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9da1c63f-94ad-477d-ad5b-20627a1261d9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.152617 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.152580    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9da1c63f-94ad-477d-ad5b-20627a1261d9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.162820 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.162793    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9gz\" (UniqueName: \"kubernetes.io/projected/9da1c63f-94ad-477d-ad5b-20627a1261d9-kube-api-access-jl9gz\") pod \"prometheus-operator-567f7b8b7c-4gjsv\" (UID: \"9da1c63f-94ad-477d-ad5b-20627a1261d9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.326391 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.326302    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"
Jul 06 19:28:19.462614 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:19.462554    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv"]
Jul 06 19:28:19.464568 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:19.464541    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da1c63f_94ad_477d_ad5b_20627a1261d9.slice/crio-ccffa38994a8873a66768b9fd4b5882aecd400b6c778edc8ffd4d68711931f8a WatchSource:0}: Error finding container ccffa38994a8873a66768b9fd4b5882aecd400b6c778edc8ffd4d68711931f8a: Status 404 returned error can't find the container with id ccffa38994a8873a66768b9fd4b5882aecd400b6c778edc8ffd4d68711931f8a
Jul 06 19:28:20.221897 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:20.221865    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv" event={"ID":"9da1c63f-94ad-477d-ad5b-20627a1261d9","Type":"ContainerStarted","Data":"ccffa38994a8873a66768b9fd4b5882aecd400b6c778edc8ffd4d68711931f8a"}
Jul 06 19:28:21.227659 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:21.227578    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv" event={"ID":"9da1c63f-94ad-477d-ad5b-20627a1261d9","Type":"ContainerStarted","Data":"a77c2d032a5fb116cf82290873c0b565a5806ed61506123654debd97c4ad4af0"}
Jul 06 19:28:21.227659 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:21.227628    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv" event={"ID":"9da1c63f-94ad-477d-ad5b-20627a1261d9","Type":"ContainerStarted","Data":"6751b178e6a8650556d488ed446787737ed71b7c05ae5af0cda9a90ec9fb3834"}
Jul 06 19:28:21.254356 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:21.254296    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4gjsv" podStartSLOduration=1.762343353 podStartE2EDuration="3.254275637s" totalImagesPullingTime="1.491932284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:21.252082718 +0000 UTC m=+140.179120638" watchObservedRunningTime="2026-07-06 19:28:21.254275637 +0000 UTC m=+140.181313558"
Jul 06 19:28:22.864956 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:22.864886    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:22.865423 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:22.864997    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:22.866256 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:22.866235    2552 patch_prober.go:28] interesting pod/console-5ddfc848f-jfw4r container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body=
Jul 06 19:28:22.866326 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:22.866288    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5ddfc848f-jfw4r" podUID="85806073-eff1-4553-a201-9c7becc670fd" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused"
Jul 06 19:28:23.812054 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.812013    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"]
Jul 06 19:28:23.814863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.814843    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.822905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.822852    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 19:28:23.823071 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.823052    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:28:23.823117 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.823096    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b89ks\""
Jul 06 19:28:23.882825 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.882792    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"]
Jul 06 19:28:23.888753 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.888730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.888819 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.888765    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.888819 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.888796    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.888880 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.888839    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d56j\" (UniqueName: \"kubernetes.io/projected/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-kube-api-access-4d56j\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.915378 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.915343    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w7lzh"]
Jul 06 19:28:23.918167 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.918148    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.924777 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:23.924744    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret"
Jul 06 19:28:23.925331 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:23.925309    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-hnkzb\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hnkzb\"" type="*v1.Secret"
Jul 06 19:28:23.925462 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:23.925439    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Jul 06 19:28:23.929798 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:23.929773    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret"
Jul 06 19:28:23.989242 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989209    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-textfile\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989392 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989296    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2t9\" (UniqueName: \"kubernetes.io/projected/58cda9ae-6b81-49d9-82fb-5217412b4e1a-kube-api-access-gm2t9\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989392 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989350    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-wtmp\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989494 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58cda9ae-6b81-49d9-82fb-5217412b4e1a-metrics-client-ca\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989544 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989482    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989544 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989537    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.989613 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989557    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-sys\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989613 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989572    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-root\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989613 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989596    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989747 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989703    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.989797 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989754    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-tls\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:23.989797 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989790    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.989892 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.989815    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d56j\" (UniqueName: \"kubernetes.io/projected/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-kube-api-access-4d56j\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.990311 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.990290    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.992328 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.992289    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:23.992428 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:23.992406    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:24.014064 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.014034    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d56j\" (UniqueName: \"kubernetes.io/projected/3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c-kube-api-access-4d56j\") pod \"openshift-state-metrics-54cf96dfcf-ltskc\" (UID: \"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:24.090724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090638    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.090724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090676    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-sys\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.090724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-root\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.090724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090707    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.090724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090727    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-tls\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090748    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-textfile\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090769    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2t9\" (UniqueName: \"kubernetes.io/projected/58cda9ae-6b81-49d9-82fb-5217412b4e1a-kube-api-access-gm2t9\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090771    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-sys\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090782    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-root\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090855    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-wtmp\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.090892    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58cda9ae-6b81-49d9-82fb-5217412b4e1a-metrics-client-ca\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.091012    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-wtmp\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091126 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.091110    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-textfile\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.091396 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.091380    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58cda9ae-6b81-49d9-82fb-5217412b4e1a-metrics-client-ca\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.108324 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.108301    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2t9\" (UniqueName: \"kubernetes.io/projected/58cda9ae-6b81-49d9-82fb-5217412b4e1a-kube-api-access-gm2t9\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:24.123647 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.123615    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"
Jul 06 19:28:24.278553 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.278518    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc"]
Jul 06 19:28:24.282617 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:24.282590    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc3b0b5_7d43_4a5b_9fc1_41beb9be2e0c.slice/crio-ac43259af5c8639d5046d820d30d02567e93f3bbafc9003227f10f7e19f3f04f WatchSource:0}: Error finding container ac43259af5c8639d5046d820d30d02567e93f3bbafc9003227f10f7e19f3f04f: Status 404 returned error can't find the container with id ac43259af5c8639d5046d820d30d02567e93f3bbafc9003227f10f7e19f3f04f
Jul 06 19:28:24.906031 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.906000    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:28:24.911451 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:24.911420    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:25.091489 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:25.091456    2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:25.091682 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:25.091536    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-tls podName:58cda9ae-6b81-49d9-82fb-5217412b4e1a nodeName:}" failed. No retries permitted until 2026-07-06 19:28:25.591520598 +0000 UTC m=+144.518558498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-tls") pod "node-exporter-w7lzh" (UID: "58cda9ae-6b81-49d9-82fb-5217412b4e1a") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:25.091682 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:25.091461    2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:25.091682 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:25.091620    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-kube-rbac-proxy-config podName:58cda9ae-6b81-49d9-82fb-5217412b4e1a nodeName:}" failed. No retries permitted until 2026-07-06 19:28:25.591600209 +0000 UTC m=+144.518638109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-kube-rbac-proxy-config") pod "node-exporter-w7lzh" (UID: "58cda9ae-6b81-49d9-82fb-5217412b4e1a") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:25.244990 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.244952    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc" event={"ID":"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c","Type":"ContainerStarted","Data":"33f06a84c545e3b72dee015a10861617e2246b1d4af286fc225f9137d368479c"}
Jul 06 19:28:25.245160 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.245047    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc" event={"ID":"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c","Type":"ContainerStarted","Data":"613ee2a9ff16a3b8c2cb6dc312bd34e7789907aefc257cf4a9bfd6baf8fd1bdd"}
Jul 06 19:28:25.245160 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.245067    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc" event={"ID":"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c","Type":"ContainerStarted","Data":"ac43259af5c8639d5046d820d30d02567e93f3bbafc9003227f10f7e19f3f04f"}
Jul 06 19:28:25.256639 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.256587    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:28:25.256639 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.256587    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hnkzb\""
Jul 06 19:28:25.502357 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.502273    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:28:25.605928 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.605898    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:25.606048 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.605974    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-tls\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:25.608474 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.608455    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-tls\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:25.608564 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.608478    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58cda9ae-6b81-49d9-82fb-5217412b4e1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7lzh\" (UID: \"58cda9ae-6b81-49d9-82fb-5217412b4e1a\") " pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:25.727203 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:25.727170    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7lzh"
Jul 06 19:28:25.736822 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:25.736794    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cda9ae_6b81_49d9_82fb_5217412b4e1a.slice/crio-2219fb55e90650e656d5d43724275c5e5056e3ec65b1b8c553e9c3c5c4a135ea WatchSource:0}: Error finding container 2219fb55e90650e656d5d43724275c5e5056e3ec65b1b8c553e9c3c5c4a135ea: Status 404 returned error can't find the container with id 2219fb55e90650e656d5d43724275c5e5056e3ec65b1b8c553e9c3c5c4a135ea
Jul 06 19:28:26.251079 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.251041    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc" event={"ID":"3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c","Type":"ContainerStarted","Data":"2dd746929761ac5b01969b50d62b52def310fa1e2cb3255670cc075494260649"}
Jul 06 19:28:26.252219 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.252198    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7lzh" event={"ID":"58cda9ae-6b81-49d9-82fb-5217412b4e1a","Type":"ContainerStarted","Data":"2219fb55e90650e656d5d43724275c5e5056e3ec65b1b8c553e9c3c5c4a135ea"}
Jul 06 19:28:26.278859 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.278809    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ltskc" podStartSLOduration=2.128221727 podStartE2EDuration="3.278793957s" totalImagesPullingTime="1.15057223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:26.277149127 +0000 UTC m=+145.204187049" watchObservedRunningTime="2026-07-06 19:28:26.278793957 +0000 UTC m=+145.205831874"
Jul 06 19:28:26.529256 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.529165    2552 patch_prober.go:28] interesting pod/image-registry-5b887b8649-ztlst container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:26.529256 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.529227    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:26.682156 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.682115    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8595585cc9-229m9"]
Jul 06 19:28:26.685600 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.685565    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.690453 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690427    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 19:28:26.690621 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690462    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 19:28:26.690621 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690513    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 19:28:26.690621 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690519    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 19:28:26.690814 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690798    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4lw9w\""
Jul 06 19:28:26.690882 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690798    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dr5s07o1q5m5q\""
Jul 06 19:28:26.690882 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.690868    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 19:28:26.704028 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.703848    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8595585cc9-229m9"]
Jul 06 19:28:26.716364 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716337    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716518 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716388    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716518 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716478    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716631 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716537    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716631 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716611    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1eafd-4985-49d0-943d-59e6b7ac5135-metrics-client-ca\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716735 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716703    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-grpc-tls\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716793 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716740    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-tls\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.716793 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.716767    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkv5r\" (UniqueName: \"kubernetes.io/projected/9fc1eafd-4985-49d0-943d-59e6b7ac5135-kube-api-access-rkv5r\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817315 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817291    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-grpc-tls\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817415 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817323    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-tls\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817415 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817340    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkv5r\" (UniqueName: \"kubernetes.io/projected/9fc1eafd-4985-49d0-943d-59e6b7ac5135-kube-api-access-rkv5r\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817415 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817370    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817415 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817412    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817579 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817451    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817579 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817482    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.817579 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.817538    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1eafd-4985-49d0-943d-59e6b7ac5135-metrics-client-ca\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.818460 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.818252    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1eafd-4985-49d0-943d-59e6b7ac5135-metrics-client-ca\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.820109 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.820086    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.820109 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.820100    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.820290 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.820274    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-grpc-tls\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.820323 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.820293    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-tls\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.820410 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.820389    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.820463 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.820448    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fc1eafd-4985-49d0-943d-59e6b7ac5135-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.829426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.829307    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkv5r\" (UniqueName: \"kubernetes.io/projected/9fc1eafd-4985-49d0-943d-59e6b7ac5135-kube-api-access-rkv5r\") pod \"thanos-querier-8595585cc9-229m9\" (UID: \"9fc1eafd-4985-49d0-943d-59e6b7ac5135\") " pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:26.867261 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.867228    2552 patch_prober.go:28] interesting pod/image-registry-74f4778987-szc7j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:26.867368 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.867274    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:26.998532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:26.998486    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:27.139817 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:27.139786    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8595585cc9-229m9"]
Jul 06 19:28:27.143964 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:27.143915    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc1eafd_4985_49d0_943d_59e6b7ac5135.slice/crio-bb810ec3b84b5006bdf6216718d68530f72bb694eca4dffd19b93c2ab8b5a7d7 WatchSource:0}: Error finding container bb810ec3b84b5006bdf6216718d68530f72bb694eca4dffd19b93c2ab8b5a7d7: Status 404 returned error can't find the container with id bb810ec3b84b5006bdf6216718d68530f72bb694eca4dffd19b93c2ab8b5a7d7
Jul 06 19:28:27.257409 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:27.257375    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"bb810ec3b84b5006bdf6216718d68530f72bb694eca4dffd19b93c2ab8b5a7d7"}
Jul 06 19:28:27.258899 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:27.258872    2552 generic.go:356] "Generic (PLEG): container finished" podID="58cda9ae-6b81-49d9-82fb-5217412b4e1a" containerID="d2fcd8da23c9f0814c023659bdfd1928cfbf15b990690796b2c155f497100afa" exitCode=0
Jul 06 19:28:27.259060 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:27.258964    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7lzh" event={"ID":"58cda9ae-6b81-49d9-82fb-5217412b4e1a","Type":"ContainerDied","Data":"d2fcd8da23c9f0814c023659bdfd1928cfbf15b990690796b2c155f497100afa"}
Jul 06 19:28:28.170564 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.170527    2552 patch_prober.go:28] interesting pod/image-registry-74f4778987-szc7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:28.170733 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.170576    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:28.265486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.265448    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7lzh" event={"ID":"58cda9ae-6b81-49d9-82fb-5217412b4e1a","Type":"ContainerStarted","Data":"c3ddcf6369897b9f4ffbfbcf62fbfa20ce90de6d7a6793ec4954a18612153a3a"}
Jul 06 19:28:28.265886 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.265511    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7lzh" event={"ID":"58cda9ae-6b81-49d9-82fb-5217412b4e1a","Type":"ContainerStarted","Data":"dd1e290fe9f34686b419b4810c537a88eb2e2b39841270571b7be60d7957d1cb"}
Jul 06 19:28:28.332827 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.332540    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w7lzh" podStartSLOduration=4.20273328 podStartE2EDuration="5.332435719s" totalImagesPullingTime="1.056499146s" totalInitContainerRuntime="73.203293ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:28.325876906 +0000 UTC m=+147.252914823" watchObservedRunningTime="2026-07-06 19:28:28.332435719 +0000 UTC m=+147.259473637"
Jul 06 19:28:28.336461 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.336435    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"]
Jul 06 19:28:28.343242 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.343218    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.349239 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.349219    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:28:28.349239 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.349230    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jxvnr\""
Jul 06 19:28:28.361282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.361259    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"]
Jul 06 19:28:28.433702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.433612    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q9dt\" (UniqueName: \"kubernetes.io/projected/2cf35659-1e84-4dce-b3d1-1b5c73a71984-kube-api-access-2q9dt\") pod \"monitoring-plugin-d5dcff7cf-5j6sl\" (UID: \"2cf35659-1e84-4dce-b3d1-1b5c73a71984\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.433702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.433649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf35659-1e84-4dce-b3d1-1b5c73a71984-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5j6sl\" (UID: \"2cf35659-1e84-4dce-b3d1-1b5c73a71984\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.534689 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.534653    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf35659-1e84-4dce-b3d1-1b5c73a71984-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5j6sl\" (UID: \"2cf35659-1e84-4dce-b3d1-1b5c73a71984\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.534828 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.534744    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q9dt\" (UniqueName: \"kubernetes.io/projected/2cf35659-1e84-4dce-b3d1-1b5c73a71984-kube-api-access-2q9dt\") pod \"monitoring-plugin-d5dcff7cf-5j6sl\" (UID: \"2cf35659-1e84-4dce-b3d1-1b5c73a71984\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.537460 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.537431    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf35659-1e84-4dce-b3d1-1b5c73a71984-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5j6sl\" (UID: \"2cf35659-1e84-4dce-b3d1-1b5c73a71984\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.543451 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.543421    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q9dt\" (UniqueName: \"kubernetes.io/projected/2cf35659-1e84-4dce-b3d1-1b5c73a71984-kube-api-access-2q9dt\") pod \"monitoring-plugin-d5dcff7cf-5j6sl\" (UID: \"2cf35659-1e84-4dce-b3d1-1b5c73a71984\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.592951 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.592914    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"]
Jul 06 19:28:28.596160 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.596140    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.600491 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.600443    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 19:28:28.600491 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.600473    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 19:28:28.600491 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.600487    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7gq69tgh2481l\""
Jul 06 19:28:28.600716 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.600574    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 19:28:28.600886 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.600871    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xpdsp\""
Jul 06 19:28:28.601091 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.600920    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 19:28:28.614478 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.614418    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"]
Jul 06 19:28:28.635633 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635575    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a321ad51-512e-4559-8f6a-8b7f23be048b-metrics-server-audit-profiles\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.635791 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635667    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-client-ca-bundle\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.635791 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635727    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zw7x\" (UniqueName: \"kubernetes.io/projected/a321ad51-512e-4559-8f6a-8b7f23be048b-kube-api-access-4zw7x\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.635889 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635807    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-secret-metrics-server-client-certs\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.635889 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a321ad51-512e-4559-8f6a-8b7f23be048b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.635889 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635858    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-secret-metrics-server-tls\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.636001 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.635892    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a321ad51-512e-4559-8f6a-8b7f23be048b-audit-log\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.652474 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.652433    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:28.736480 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736451    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-secret-metrics-server-client-certs\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.736638 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736488    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a321ad51-512e-4559-8f6a-8b7f23be048b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.736638 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736524    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-secret-metrics-server-tls\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.736638 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736565    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a321ad51-512e-4559-8f6a-8b7f23be048b-audit-log\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.736638 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736619    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a321ad51-512e-4559-8f6a-8b7f23be048b-metrics-server-audit-profiles\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.736863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736661    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-client-ca-bundle\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.736863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.736689    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zw7x\" (UniqueName: \"kubernetes.io/projected/a321ad51-512e-4559-8f6a-8b7f23be048b-kube-api-access-4zw7x\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.737351 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.737325    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a321ad51-512e-4559-8f6a-8b7f23be048b-audit-log\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.738072 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.738011    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a321ad51-512e-4559-8f6a-8b7f23be048b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.738526 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.738493    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a321ad51-512e-4559-8f6a-8b7f23be048b-metrics-server-audit-profiles\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.739712 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.739690    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-secret-metrics-server-client-certs\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.739877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.739852    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-client-ca-bundle\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.740292 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.740248    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a321ad51-512e-4559-8f6a-8b7f23be048b-secret-metrics-server-tls\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.746649 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.746628    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zw7x\" (UniqueName: \"kubernetes.io/projected/a321ad51-512e-4559-8f6a-8b7f23be048b-kube-api-access-4zw7x\") pod \"metrics-server-75f4b4b9cf-lpg2k\" (UID: \"a321ad51-512e-4559-8f6a-8b7f23be048b\") " pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:28.773786 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.773762    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddfc848f-jfw4r"]
Jul 06 19:28:28.907626 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:28.907590    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:29.191239 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.191210    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"]
Jul 06 19:28:29.199949 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:29.199898    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf35659_1e84_4dce_b3d1_1b5c73a71984.slice/crio-67b739a5f3797345b49ba05166fa0dc035f8f9c7b9e7a7686ece86427b731410 WatchSource:0}: Error finding container 67b739a5f3797345b49ba05166fa0dc035f8f9c7b9e7a7686ece86427b731410: Status 404 returned error can't find the container with id 67b739a5f3797345b49ba05166fa0dc035f8f9c7b9e7a7686ece86427b731410
Jul 06 19:28:29.214905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.214822    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"]
Jul 06 19:28:29.217105 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:29.217074    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda321ad51_512e_4559_8f6a_8b7f23be048b.slice/crio-3c2a797f89eab77115f8c954cb7edf8d225653c928428408fd274a6b1381f8a4 WatchSource:0}: Error finding container 3c2a797f89eab77115f8c954cb7edf8d225653c928428408fd274a6b1381f8a4: Status 404 returned error can't find the container with id 3c2a797f89eab77115f8c954cb7edf8d225653c928428408fd274a6b1381f8a4
Jul 06 19:28:29.270667 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.270635    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k" event={"ID":"a321ad51-512e-4559-8f6a-8b7f23be048b","Type":"ContainerStarted","Data":"3c2a797f89eab77115f8c954cb7edf8d225653c928428408fd274a6b1381f8a4"}
Jul 06 19:28:29.272885 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.272861    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"94bb3927909baeae5b5432eae3f553db5f0f6a38a4a45454ebf4d7ed741156c9"}
Jul 06 19:28:29.273004 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.272950    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"d7fb6774ef57ef221c033ab3ed1261f97c6a221fa69c3dc22e6b52a37681a2ae"}
Jul 06 19:28:29.273997 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.273972    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl" event={"ID":"2cf35659-1e84-4dce-b3d1-1b5c73a71984","Type":"ContainerStarted","Data":"67b739a5f3797345b49ba05166fa0dc035f8f9c7b9e7a7686ece86427b731410"}
Jul 06 19:28:29.772468 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.772435    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:28:29.776019 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.775994    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.781627 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.781602    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 19:28:29.781758 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.781736    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 19:28:29.782081 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.782063    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 19:28:29.782181 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.782097    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 19:28:29.782698 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.782669    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 19:28:29.782698 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.782687    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 19:28:29.782848 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.782747    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-quur569p4r63\""
Jul 06 19:28:29.783207 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.783182    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 19:28:29.783331 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.783230    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q2k4f\""
Jul 06 19:28:29.783454 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.783436    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 19:28:29.783557 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.783507    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 19:28:29.783830 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.783563    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 19:28:29.784206 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.784185    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 19:28:29.784307 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.784220    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 19:28:29.784307 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.784282    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 19:28:29.784584 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.784563    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 19:28:29.814523 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.814484    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:28:29.849724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849689    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a71477-af5a-4732-a0a0-a8f208996d40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.849724 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849722    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lhqt\" (UniqueName: \"kubernetes.io/projected/85a71477-af5a-4732-a0a0-a8f208996d40-kube-api-access-7lhqt\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.849880 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849746    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.849880 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849800    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.849880 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850046 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849883    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850046 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850046 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849920    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850046 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.849952    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850046 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850025    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850114    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a71477-af5a-4732-a0a0-a8f208996d40-config-out\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850154    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850183    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850208    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-web-config\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850241    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850264    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850472 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850316    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850472 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850340    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-config\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850472 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850385    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.850472 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.850426    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.951822 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.951767    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952241 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952185    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952372 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952272    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952372 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952312    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952372 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952348    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952372 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952370    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952395    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952428    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952484    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a71477-af5a-4732-a0a0-a8f208996d40-config-out\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952511    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952510    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952536    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952576 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952560    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-web-config\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952597    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952621    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952659    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952684    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-config\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952718    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952771    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.952891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952811    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.953431 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.952816    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a71477-af5a-4732-a0a0-a8f208996d40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.953519 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.953460    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lhqt\" (UniqueName: \"kubernetes.io/projected/85a71477-af5a-4732-a0a0-a8f208996d40-kube-api-access-7lhqt\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.953711 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.953682    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.954349 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.954315    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.955058 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.954754    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.955516 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.955176    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.955838 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.955789    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.956742 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.956218    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.956742 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.956704    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.956967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.956901    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.957323 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.957302    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85a71477-af5a-4732-a0a0-a8f208996d40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.958269 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.958213    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-config\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.958584 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.958560    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.958702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.958678    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-web-config\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.959217 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.959192    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85a71477-af5a-4732-a0a0-a8f208996d40-config-out\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.959365 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.959290    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85a71477-af5a-4732-a0a0-a8f208996d40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.959514 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.959487    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.959808 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.959783    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.960226 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.960138    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85a71477-af5a-4732-a0a0-a8f208996d40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:29.964761 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:29.964736    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lhqt\" (UniqueName: \"kubernetes.io/projected/85a71477-af5a-4732-a0a0-a8f208996d40-kube-api-access-7lhqt\") pod \"prometheus-k8s-0\" (UID: \"85a71477-af5a-4732-a0a0-a8f208996d40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:30.086417 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:30.086301    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:30.275248 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:30.275213    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:28:30.279925 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:30.279899    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a71477_af5a_4732_a0a0_a8f208996d40.slice/crio-e75d44c0e423f6ececc691a84df40f25a7412f51ed4565d93f80d01af2c75f5f WatchSource:0}: Error finding container e75d44c0e423f6ececc691a84df40f25a7412f51ed4565d93f80d01af2c75f5f: Status 404 returned error can't find the container with id e75d44c0e423f6ececc691a84df40f25a7412f51ed4565d93f80d01af2c75f5f
Jul 06 19:28:30.280679 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:30.280600    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"b132e8728382c25fed056e81bf7f796a7a9491934eaa93daed9057f8f834ee1f"}
Jul 06 19:28:31.286159 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:31.286067    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"e75d44c0e423f6ececc691a84df40f25a7412f51ed4565d93f80d01af2c75f5f"}
Jul 06 19:28:31.548110 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:31.548058    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerName="registry" containerID="cri-o://a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d" gracePeriod=30
Jul 06 19:28:31.994529 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:31.994497    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:28:32.075699 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075657    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-certificates\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.075900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075717    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4fsm\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-kube-api-access-g4fsm\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.075900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075750    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-image-registry-private-configuration\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.075900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075778    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.075900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075796    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-trusted-ca\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.075900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075830    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-ca-trust-extracted\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.075900 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075897    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-installation-pull-secrets\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.076230 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.075930    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-bound-sa-token\") pod \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\" (UID: \"4bd913b3-28d0-4e1e-b983-5c8bc2eef497\") "
Jul 06 19:28:32.076333 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.076289    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:28:32.076707 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.076507    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:28:32.078846 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.078809    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:28:32.078967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.078814    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:32.078967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.078850    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:28:32.078967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.078870    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-kube-api-access-g4fsm" (OuterVolumeSpecName: "kube-api-access-g4fsm") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "kube-api-access-g4fsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:32.078967 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.078947    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:32.084530 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.084504    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4bd913b3-28d0-4e1e-b983-5c8bc2eef497" (UID: "4bd913b3-28d0-4e1e-b983-5c8bc2eef497"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177475    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-installation-pull-secrets\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177509    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-bound-sa-token\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177519    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-certificates\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177528    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4fsm\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-kube-api-access-g4fsm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177537    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-image-registry-private-configuration\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177546    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-registry-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177554    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-trusted-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.177565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.177562    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd913b3-28d0-4e1e-b983-5c8bc2eef497-ca-trust-extracted\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:32.291604 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.291569    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k" event={"ID":"a321ad51-512e-4559-8f6a-8b7f23be048b","Type":"ContainerStarted","Data":"d54cc3f4ab9a9fe42e338c836b39201fc11b023c5d2e0be233536faeebc181f8"}
Jul 06 19:28:32.293271 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.293242    2552 generic.go:356] "Generic (PLEG): container finished" podID="85a71477-af5a-4732-a0a0-a8f208996d40" containerID="205e40d2c400c74e81ed0dc4f3e7dddab0ae4e0a261a9b90275a29e7adf2cc7d" exitCode=0
Jul 06 19:28:32.293414 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.293323    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerDied","Data":"205e40d2c400c74e81ed0dc4f3e7dddab0ae4e0a261a9b90275a29e7adf2cc7d"}
Jul 06 19:28:32.296569 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.296543    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"ec462e1f59725054367dd40d01efc04dc6f2a884e14fff927e27c0325f6a0b2a"}
Jul 06 19:28:32.296667 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.296610    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"5319dbf754f7179fa9044deaaafc5a64a266f189f8200b34e8b7b1441ff9845e"}
Jul 06 19:28:32.296667 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.296653    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" event={"ID":"9fc1eafd-4985-49d0-943d-59e6b7ac5135","Type":"ContainerStarted","Data":"bd175ba8eacdf3bfdfd45d5bf26e14cbbb9672a11100147bf41afcf5c228cef4"}
Jul 06 19:28:32.296770 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.296698    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:32.297776 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.297757    2552 generic.go:356] "Generic (PLEG): container finished" podID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerID="a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d" exitCode=0
Jul 06 19:28:32.297861 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.297808    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b887b8649-ztlst"
Jul 06 19:28:32.297861 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.297817    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" event={"ID":"4bd913b3-28d0-4e1e-b983-5c8bc2eef497","Type":"ContainerDied","Data":"a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d"}
Jul 06 19:28:32.297861 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.297855    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b887b8649-ztlst" event={"ID":"4bd913b3-28d0-4e1e-b983-5c8bc2eef497","Type":"ContainerDied","Data":"bcdbb1e5a5a70793869e9e2e16c848c688fceba3d5bbef887b7c4ba828e36c83"}
Jul 06 19:28:32.298002 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.297877    2552 scope.go:117] "RemoveContainer" containerID="a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d"
Jul 06 19:28:32.299353 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.299330    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl" event={"ID":"2cf35659-1e84-4dce-b3d1-1b5c73a71984","Type":"ContainerStarted","Data":"0a33069c7c65548f1c2a9a627a12767959b2cc7ec55d5fc75020f2d5c4f2c6eb"}
Jul 06 19:28:32.299514 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.299493    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:32.304971 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.304952    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl"
Jul 06 19:28:32.307594 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.307578    2552 scope.go:117] "RemoveContainer" containerID="a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d"
Jul 06 19:28:32.307909 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:32.307886    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d\": container with ID starting with a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d not found: ID does not exist" containerID="a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d"
Jul 06 19:28:32.307993 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.307917    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d"} err="failed to get container status \"a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d\": rpc error: code = NotFound desc = could not find container \"a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d\": container with ID starting with a6cf371133d40fb6f0e9d4801ce63071a7020c88a3095d47f047f9d91230b98d not found: ID does not exist"
Jul 06 19:28:32.341547 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.341499    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k" podStartSLOduration=2.184702381 podStartE2EDuration="4.341481903s" totalImagesPullingTime="2.156779522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:32.320985059 +0000 UTC m=+151.248022973" watchObservedRunningTime="2026-07-06 19:28:32.341481903 +0000 UTC m=+151.268519799"
Jul 06 19:28:32.359754 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.359694    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5j6sl" podStartSLOduration=2.18774476 podStartE2EDuration="4.359674298s" totalImagesPullingTime="2.171929538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:32.342106437 +0000 UTC m=+151.269144354" watchObservedRunningTime="2026-07-06 19:28:32.359674298 +0000 UTC m=+151.286712217"
Jul 06 19:28:32.361297 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.361277    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b887b8649-ztlst"]
Jul 06 19:28:32.366796 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.366764    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b887b8649-ztlst"]
Jul 06 19:28:32.393065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:32.393014    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9" podStartSLOduration=2.7534909929999998 podStartE2EDuration="6.392998565s" totalImagesPullingTime="3.639507572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:32.392696932 +0000 UTC m=+151.319734874" watchObservedRunningTime="2026-07-06 19:28:32.392998565 +0000 UTC m=+151.320036511"
Jul 06 19:28:33.707349 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:33.707318    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" path="/var/lib/kubelet/pods/4bd913b3-28d0-4e1e-b983-5c8bc2eef497/volumes"
Jul 06 19:28:36.321745 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.321702    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"c161081e0ff37cdf8811b76429e479f567c1c28e2ff38884cc203b8bafdfee34"}
Jul 06 19:28:36.322232 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.321798    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"5cc1cc84402d361b4b5868cb9b9d9a6917061b750efbeffde54474d1814aea9c"}
Jul 06 19:28:36.322232 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.321841    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"7cf542dc9c0c2ae8e19dd1af98404701eb87718b692a1147d3cf92dfdd579c5f"}
Jul 06 19:28:36.322232 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.321887    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"8e98a371444d66bfb43ee4694ec167057e1eceaceb99fd2ee6628163a11bbbbe"}
Jul 06 19:28:36.322232 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.321924    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"9093fa8bd30665d814ccee49830838c152bc925e2b815f3b79f41881af6bfc63"}
Jul 06 19:28:36.322232 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.321988    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85a71477-af5a-4732-a0a0-a8f208996d40","Type":"ContainerStarted","Data":"b8df0954c076ff0a588c86ccfab328046bd8cf412cce29765f5634b83db12c50"}
Jul 06 19:28:36.357122 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.357068    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.1257236170000002 podStartE2EDuration="7.35704492s" totalImagesPullingTime="5.21074766s" totalInitContainerRuntime="20.573643ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:36.355740977 +0000 UTC m=+155.282778896" watchObservedRunningTime="2026-07-06 19:28:36.35704492 +0000 UTC m=+155.284082903"
Jul 06 19:28:36.865976 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.865929    2552 patch_prober.go:28] interesting pod/image-registry-74f4778987-szc7j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:36.866138 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:36.865999    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:38.170683 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:38.170650    2552 patch_prober.go:28] interesting pod/image-registry-74f4778987-szc7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:38.171068 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:38.170701    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:38.311656 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:38.311626    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8595585cc9-229m9"
Jul 06 19:28:39.817404 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:39.817357    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qv4m2" podUID="5009aab8-4943-42c6-ad20-fa8f21bfde30"
Jul 06 19:28:40.087290 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:40.087213    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:28:40.337866 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:40.337799    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:28:44.689359 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:44.689320    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:28:44.691703 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:44.691684    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5009aab8-4943-42c6-ad20-fa8f21bfde30-metrics-tls\") pod \"dns-default-qv4m2\" (UID: \"5009aab8-4943-42c6-ad20-fa8f21bfde30\") " pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:28:44.844757 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:44.844715    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjqsb\""
Jul 06 19:28:44.850022 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:44.849996    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:28:45.014509 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:45.014135    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qv4m2"]
Jul 06 19:28:45.016464 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:28:45.016435    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5009aab8_4943_42c6_ad20_fa8f21bfde30.slice/crio-ff0c373ef2d778a7524aadff5c8b76bc3e83bf5b5ff5bc3284e367e0355e5852 WatchSource:0}: Error finding container ff0c373ef2d778a7524aadff5c8b76bc3e83bf5b5ff5bc3284e367e0355e5852: Status 404 returned error can't find the container with id ff0c373ef2d778a7524aadff5c8b76bc3e83bf5b5ff5bc3284e367e0355e5852
Jul 06 19:28:45.358168 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:45.358080    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qv4m2" event={"ID":"5009aab8-4943-42c6-ad20-fa8f21bfde30","Type":"ContainerStarted","Data":"ff0c373ef2d778a7524aadff5c8b76bc3e83bf5b5ff5bc3284e367e0355e5852"}
Jul 06 19:28:46.866016 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:46.865989    2552 patch_prober.go:28] interesting pod/image-registry-74f4778987-szc7j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:46.866427 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:46.866036    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:46.866427 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:46.866073    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:46.866548 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:46.866533    2552 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"5d5d37c2497efcd82cb1257aeade45f2a4db34a95a5ac38f22e92615eaf0d843"} pod="openshift-image-registry/image-registry-74f4778987-szc7j" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 06 19:28:46.870213 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:46.870187    2552 patch_prober.go:28] interesting pod/image-registry-74f4778987-szc7j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:46.870312 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:46.870231    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:47.368881 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:47.368782    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qv4m2" event={"ID":"5009aab8-4943-42c6-ad20-fa8f21bfde30","Type":"ContainerStarted","Data":"968830bc1e816bb52a75ed7eb97938b85a7f78b2b0d79831ac8e42bb0fd274b6"}
Jul 06 19:28:47.369061 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:47.368898    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:28:47.369061 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:47.368925    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qv4m2" event={"ID":"5009aab8-4943-42c6-ad20-fa8f21bfde30","Type":"ContainerStarted","Data":"a4d07eba71311622ba71f7e79fd7c0dba21ba619b322b39da799c9ecbb0a003d"}
Jul 06 19:28:47.469316 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:47.469250    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qv4m2" podStartSLOduration=129.762152187 podStartE2EDuration="2m11.469232239s" totalImagesPullingTime="1.707080052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:47.468504506 +0000 UTC m=+166.395542448" watchObservedRunningTime="2026-07-06 19:28:47.469232239 +0000 UTC m=+166.396270156"
Jul 06 19:28:48.908652 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:48.908605    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:48.909054 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:48.908707    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:28:50.210868 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:50.210837    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qv4m2_5009aab8-4943-42c6-ad20-fa8f21bfde30/dns/0.log"
Jul 06 19:28:50.409250 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:50.409225    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qv4m2_5009aab8-4943-42c6-ad20-fa8f21bfde30/kube-rbac-proxy/0.log"
Jul 06 19:28:50.813855 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:50.813831    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ttfp_9780e3f9-889b-4b83-8570-f5bff19af292/dns-node-resolver/0.log"
Jul 06 19:28:51.406989 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:51.406966    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nv5w_89c50d5c-b643-491f-9ab2-c2edc871fda6/serve-healthcheck-canary/0.log"
Jul 06 19:28:53.795207 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:53.795159    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5ddfc848f-jfw4r" podUID="85806073-eff1-4553-a201-9c7becc670fd" containerName="console" containerID="cri-o://06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15" gracePeriod=15
Jul 06 19:28:54.037479 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.037454    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:54.170340 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170242    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-service-ca\") pod \"85806073-eff1-4553-a201-9c7becc670fd\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") "
Jul 06 19:28:54.170340 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170299    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-oauth-config\") pod \"85806073-eff1-4553-a201-9c7becc670fd\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") "
Jul 06 19:28:54.170591 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170344    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-oauth-serving-cert\") pod \"85806073-eff1-4553-a201-9c7becc670fd\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") "
Jul 06 19:28:54.170591 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170382    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-serving-cert\") pod \"85806073-eff1-4553-a201-9c7becc670fd\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") "
Jul 06 19:28:54.170591 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170428    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njwqh\" (UniqueName: \"kubernetes.io/projected/85806073-eff1-4553-a201-9c7becc670fd-kube-api-access-njwqh\") pod \"85806073-eff1-4553-a201-9c7becc670fd\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") "
Jul 06 19:28:54.170591 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170470    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-console-config\") pod \"85806073-eff1-4553-a201-9c7becc670fd\" (UID: \"85806073-eff1-4553-a201-9c7becc670fd\") "
Jul 06 19:28:54.170758 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170689    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "85806073-eff1-4553-a201-9c7becc670fd" (UID: "85806073-eff1-4553-a201-9c7becc670fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:28:54.170856 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170731    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "85806073-eff1-4553-a201-9c7becc670fd" (UID: "85806073-eff1-4553-a201-9c7becc670fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:28:54.171003 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.170899    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-console-config" (OuterVolumeSpecName: "console-config") pod "85806073-eff1-4553-a201-9c7becc670fd" (UID: "85806073-eff1-4553-a201-9c7becc670fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:28:54.172750 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.172717    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85806073-eff1-4553-a201-9c7becc670fd-kube-api-access-njwqh" (OuterVolumeSpecName: "kube-api-access-njwqh") pod "85806073-eff1-4553-a201-9c7becc670fd" (UID: "85806073-eff1-4553-a201-9c7becc670fd"). InnerVolumeSpecName "kube-api-access-njwqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:54.172750 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.172737    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "85806073-eff1-4553-a201-9c7becc670fd" (UID: "85806073-eff1-4553-a201-9c7becc670fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:28:54.172866 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.172750    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "85806073-eff1-4553-a201-9c7becc670fd" (UID: "85806073-eff1-4553-a201-9c7becc670fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:28:54.271913 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.271875    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-console-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:54.271913 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.271906    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:54.271913 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.271915    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-oauth-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:54.271913 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.271925    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85806073-eff1-4553-a201-9c7becc670fd-oauth-serving-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:54.272192 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.271959    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85806073-eff1-4553-a201-9c7becc670fd-console-serving-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:54.272192 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.271972    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njwqh\" (UniqueName: \"kubernetes.io/projected/85806073-eff1-4553-a201-9c7becc670fd-kube-api-access-njwqh\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:28:54.397268 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.397236    2552 generic.go:356] "Generic (PLEG): container finished" podID="85806073-eff1-4553-a201-9c7becc670fd" containerID="06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15" exitCode=0
Jul 06 19:28:54.397405 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.397276    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddfc848f-jfw4r"
Jul 06 19:28:54.397405 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.397322    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfc848f-jfw4r" event={"ID":"85806073-eff1-4553-a201-9c7becc670fd","Type":"ContainerDied","Data":"06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15"}
Jul 06 19:28:54.397405 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.397371    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddfc848f-jfw4r" event={"ID":"85806073-eff1-4553-a201-9c7becc670fd","Type":"ContainerDied","Data":"b841215c02e0372b5e48002662b281201e1238c787e21164f7ae39e1c44c88f8"}
Jul 06 19:28:54.397405 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.397392    2552 scope.go:117] "RemoveContainer" containerID="06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15"
Jul 06 19:28:54.406058 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.406041    2552 scope.go:117] "RemoveContainer" containerID="06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15"
Jul 06 19:28:54.406293 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:28:54.406270    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15\": container with ID starting with 06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15 not found: ID does not exist" containerID="06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15"
Jul 06 19:28:54.406383 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.406295    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15"} err="failed to get container status \"06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15\": rpc error: code = NotFound desc = could not find container \"06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15\": container with ID starting with 06dcbcc15054987f3ce908a62a6a5660d1f87e797b572efac8124a4f5fa1da15 not found: ID does not exist"
Jul 06 19:28:54.456127 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.456097    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddfc848f-jfw4r"]
Jul 06 19:28:54.475205 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:54.475182    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ddfc848f-jfw4r"]
Jul 06 19:28:55.705801 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:55.705763    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85806073-eff1-4553-a201-9c7becc670fd" path="/var/lib/kubelet/pods/85806073-eff1-4553-a201-9c7becc670fd/volumes"
Jul 06 19:28:56.870293 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:56.870268    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:28:57.374985 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:28:57.374902    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qv4m2"
Jul 06 19:29:08.913266 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:08.913239    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:29:08.917024 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:08.917003    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75f4b4b9cf-lpg2k"
Jul 06 19:29:11.895616 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:11.895575    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74f4778987-szc7j" podUID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerName="registry" containerID="cri-o://5d5d37c2497efcd82cb1257aeade45f2a4db34a95a5ac38f22e92615eaf0d843" gracePeriod=30
Jul 06 19:29:13.481101 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:13.481061    2552 generic.go:356] "Generic (PLEG): container finished" podID="24c115c9-c3a7-41b3-8d39-fc7852a79a94" containerID="5d5d37c2497efcd82cb1257aeade45f2a4db34a95a5ac38f22e92615eaf0d843" exitCode=0
Jul 06 19:29:13.481499 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:13.481128    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f4778987-szc7j" event={"ID":"24c115c9-c3a7-41b3-8d39-fc7852a79a94","Type":"ContainerDied","Data":"5d5d37c2497efcd82cb1257aeade45f2a4db34a95a5ac38f22e92615eaf0d843"}
Jul 06 19:29:13.481499 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:13.481167    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f4778987-szc7j" event={"ID":"24c115c9-c3a7-41b3-8d39-fc7852a79a94","Type":"ContainerStarted","Data":"6e2bf5eeb576b74aa1d0fc79373a9bc55b52f59ac24727f8032f8f891cb5706c"}
Jul 06 19:29:13.481499 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:13.481232    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:29:30.086891 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:30.086850    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:29:30.108353 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:30.108329    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:29:30.561603 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:30.561570    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:29:34.489494 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:29:34.489461    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74f4778987-szc7j"
Jul 06 19:31:01.521064 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:01.521038    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:31:01.525181 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:01.525155    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:31:01.532324 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:01.532302    2552 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:31:24.659586 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659503    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"]
Jul 06 19:31:24.661905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659829    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerName="registry"
Jul 06 19:31:24.661905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659839    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerName="registry"
Jul 06 19:31:24.661905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659849    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85806073-eff1-4553-a201-9c7becc670fd" containerName="console"
Jul 06 19:31:24.661905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659859    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="85806073-eff1-4553-a201-9c7becc670fd" containerName="console"
Jul 06 19:31:24.661905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659926    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="85806073-eff1-4553-a201-9c7becc670fd" containerName="console"
Jul 06 19:31:24.661905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.659951    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd913b3-28d0-4e1e-b983-5c8bc2eef497" containerName="registry"
Jul 06 19:31:24.662600 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.662577    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.672092 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.672071    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:31:24.673138 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.673124    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j6qwk\""
Jul 06 19:31:24.674245 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.674233    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:31:24.706816 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.706791    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"]
Jul 06 19:31:24.742419 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.742396    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpppr\" (UniqueName: \"kubernetes.io/projected/a38f59de-5f38-49bc-902e-7f98927eb50f-kube-api-access-gpppr\") pod \"cert-manager-cainjector-559cdd8c87-9vh8h\" (UID: \"a38f59de-5f38-49bc-902e-7f98927eb50f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.742569 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.742455    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a38f59de-5f38-49bc-902e-7f98927eb50f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vh8h\" (UID: \"a38f59de-5f38-49bc-902e-7f98927eb50f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.843354 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.843312    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a38f59de-5f38-49bc-902e-7f98927eb50f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vh8h\" (UID: \"a38f59de-5f38-49bc-902e-7f98927eb50f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.843531 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.843383    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpppr\" (UniqueName: \"kubernetes.io/projected/a38f59de-5f38-49bc-902e-7f98927eb50f-kube-api-access-gpppr\") pod \"cert-manager-cainjector-559cdd8c87-9vh8h\" (UID: \"a38f59de-5f38-49bc-902e-7f98927eb50f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.856565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.856536    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a38f59de-5f38-49bc-902e-7f98927eb50f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vh8h\" (UID: \"a38f59de-5f38-49bc-902e-7f98927eb50f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.857247 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.857219    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpppr\" (UniqueName: \"kubernetes.io/projected/a38f59de-5f38-49bc-902e-7f98927eb50f-kube-api-access-gpppr\") pod \"cert-manager-cainjector-559cdd8c87-9vh8h\" (UID: \"a38f59de-5f38-49bc-902e-7f98927eb50f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:24.987644 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:24.987620    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"
Jul 06 19:31:25.135676 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:25.135645    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h"]
Jul 06 19:31:25.138906 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:31:25.138883    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda38f59de_5f38_49bc_902e_7f98927eb50f.slice/crio-be8fc0d30d166abbd164f52574a854d80ded7d82b9ba730725a6800ed35ecac0 WatchSource:0}: Error finding container be8fc0d30d166abbd164f52574a854d80ded7d82b9ba730725a6800ed35ecac0: Status 404 returned error can't find the container with id be8fc0d30d166abbd164f52574a854d80ded7d82b9ba730725a6800ed35ecac0
Jul 06 19:31:25.140853 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:25.140831    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:31:25.981857 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:25.981796    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h" event={"ID":"a38f59de-5f38-49bc-902e-7f98927eb50f","Type":"ContainerStarted","Data":"be8fc0d30d166abbd164f52574a854d80ded7d82b9ba730725a6800ed35ecac0"}
Jul 06 19:31:28.995374 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:28.995332    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h" event={"ID":"a38f59de-5f38-49bc-902e-7f98927eb50f","Type":"ContainerStarted","Data":"bffebff81e86c9f91eed1840dfb0d503542a76d05c8465d9e45db4720a022084"}
Jul 06 19:31:29.019961 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:29.017585    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vh8h" podStartSLOduration=2.136810704 podStartE2EDuration="5.017566133s" totalImagesPullingTime="2.880755429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:29.014166965 +0000 UTC m=+327.941204884" watchObservedRunningTime="2026-07-06 19:31:29.017566133 +0000 UTC m=+327.944604053"
Jul 06 19:31:55.329549 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.329469    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"]
Jul 06 19:31:55.332799 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.332784    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.355488 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.355465    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:31:55.356619 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.356604    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:31:55.356683 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.356639    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:31:55.356683 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.356650    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:31:55.372807 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.372783    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gfdrn\""
Jul 06 19:31:55.405663 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.405635    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0b8268c-80c2-4629-9123-ad0dca8c1493-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.405783 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.405676    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzgrl\" (UniqueName: \"kubernetes.io/projected/a0b8268c-80c2-4629-9123-ad0dca8c1493-kube-api-access-wzgrl\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.405783 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.405744    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0b8268c-80c2-4629-9123-ad0dca8c1493-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.405783 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.405760    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b8268c-80c2-4629-9123-ad0dca8c1493-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.405893 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.405786    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0b8268c-80c2-4629-9123-ad0dca8c1493-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.502887 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.502858    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"]
Jul 06 19:31:55.506563 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.506541    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0b8268c-80c2-4629-9123-ad0dca8c1493-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.506636 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.506583    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzgrl\" (UniqueName: \"kubernetes.io/projected/a0b8268c-80c2-4629-9123-ad0dca8c1493-kube-api-access-wzgrl\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.506636 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.506624    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0b8268c-80c2-4629-9123-ad0dca8c1493-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.506730 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.506638    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b8268c-80c2-4629-9123-ad0dca8c1493-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.506730 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.506666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0b8268c-80c2-4629-9123-ad0dca8c1493-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.507052 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.507029    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0b8268c-80c2-4629-9123-ad0dca8c1493-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.509041 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.509005    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b8268c-80c2-4629-9123-ad0dca8c1493-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.509191 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.509173    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0b8268c-80c2-4629-9123-ad0dca8c1493-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.509250 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.509206    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0b8268c-80c2-4629-9123-ad0dca8c1493-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.563127 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.563101    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzgrl\" (UniqueName: \"kubernetes.io/projected/a0b8268c-80c2-4629-9123-ad0dca8c1493-kube-api-access-wzgrl\") pod \"opendatahub-operator-controller-manager-79c9ddb849-hhjk6\" (UID: \"a0b8268c-80c2-4629-9123-ad0dca8c1493\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.642618 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.642550    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:31:55.841242 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:55.841209    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"]
Jul 06 19:31:55.844754 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:31:55.844727    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b8268c_80c2_4629_9123_ad0dca8c1493.slice/crio-07e5243fd967b7a5fb804bd0e16e551652cefcf4e523a5ef385bf7c8a699bd27 WatchSource:0}: Error finding container 07e5243fd967b7a5fb804bd0e16e551652cefcf4e523a5ef385bf7c8a699bd27: Status 404 returned error can't find the container with id 07e5243fd967b7a5fb804bd0e16e551652cefcf4e523a5ef385bf7c8a699bd27
Jul 06 19:31:56.102328 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.102290    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6" event={"ID":"a0b8268c-80c2-4629-9123-ad0dca8c1493","Type":"ContainerStarted","Data":"07e5243fd967b7a5fb804bd0e16e551652cefcf4e523a5ef385bf7c8a699bd27"}
Jul 06 19:31:56.690402 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.690366    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"]
Jul 06 19:31:56.693839 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.693820    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.708806 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.708785    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:31:56.709598 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.709579    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-skzbv\""
Jul 06 19:31:56.709709 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.709610    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:31:56.710609 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.710590    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:31:56.710719 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.710655    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:31:56.739524 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.739501    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:31:56.796563 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.796529    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"]
Jul 06 19:31:56.817725 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.817688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f09753-357e-4368-a2a7-6410dc44c757-cert\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.817906 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.817796    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13f09753-357e-4368-a2a7-6410dc44c757-manager-config\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.817906 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.817839    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13f09753-357e-4368-a2a7-6410dc44c757-metrics-cert\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.818058 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.817905    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xr76\" (UniqueName: \"kubernetes.io/projected/13f09753-357e-4368-a2a7-6410dc44c757-kube-api-access-9xr76\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.918739 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.918685    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13f09753-357e-4368-a2a7-6410dc44c757-manager-config\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.918739 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.918740    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13f09753-357e-4368-a2a7-6410dc44c757-metrics-cert\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.919134 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.918797    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xr76\" (UniqueName: \"kubernetes.io/projected/13f09753-357e-4368-a2a7-6410dc44c757-kube-api-access-9xr76\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.919134 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.918848    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f09753-357e-4368-a2a7-6410dc44c757-cert\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.919791 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.919769    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13f09753-357e-4368-a2a7-6410dc44c757-manager-config\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.922175 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.922146    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f09753-357e-4368-a2a7-6410dc44c757-cert\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.922353 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.922334    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13f09753-357e-4368-a2a7-6410dc44c757-metrics-cert\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:56.951021 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:56.950929    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xr76\" (UniqueName: \"kubernetes.io/projected/13f09753-357e-4368-a2a7-6410dc44c757-kube-api-access-9xr76\") pod \"lws-controller-manager-5c85d89ddf-gzq9h\" (UID: \"13f09753-357e-4368-a2a7-6410dc44c757\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:57.003073 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:57.002986    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:31:57.179107 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:57.178949    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"]
Jul 06 19:31:57.182363 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:31:57.182321    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f09753_357e_4368_a2a7_6410dc44c757.slice/crio-570fc8b65b5d6ed6594c4a26a4e9b91377af5d12b68a6afd45a1e78a3ffaa572 WatchSource:0}: Error finding container 570fc8b65b5d6ed6594c4a26a4e9b91377af5d12b68a6afd45a1e78a3ffaa572: Status 404 returned error can't find the container with id 570fc8b65b5d6ed6594c4a26a4e9b91377af5d12b68a6afd45a1e78a3ffaa572
Jul 06 19:31:58.116140 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:31:58.116099    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h" event={"ID":"13f09753-357e-4368-a2a7-6410dc44c757","Type":"ContainerStarted","Data":"570fc8b65b5d6ed6594c4a26a4e9b91377af5d12b68a6afd45a1e78a3ffaa572"}
Jul 06 19:32:01.133189 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:01.133149    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6" event={"ID":"a0b8268c-80c2-4629-9123-ad0dca8c1493","Type":"ContainerStarted","Data":"fb36e06e8ad4a119e5764ca1d101ffb015ea81a6f293d9b6cc368c867b891eb9"}
Jul 06 19:32:01.134705 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:01.134678    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h" event={"ID":"13f09753-357e-4368-a2a7-6410dc44c757","Type":"ContainerStarted","Data":"eab7e48c295c13e23681626360a16032a26e8ce52599d8033895a6412d7f6c8c"}
Jul 06 19:32:01.134814 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:01.134737    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:32:01.189841 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:01.189790    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h" podStartSLOduration=2.082894198 podStartE2EDuration="5.189774315s" totalImagesPullingTime="3.106880117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:01.187619868 +0000 UTC m=+360.114657785" watchObservedRunningTime="2026-07-06 19:32:01.189774315 +0000 UTC m=+360.116812232"
Jul 06 19:32:02.140793 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:02.140759    2552 generic.go:356] "Generic (PLEG): container finished" podID="a0b8268c-80c2-4629-9123-ad0dca8c1493" containerID="fb36e06e8ad4a119e5764ca1d101ffb015ea81a6f293d9b6cc368c867b891eb9" exitCode=0
Jul 06 19:32:02.141260 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:02.140833    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6" event={"ID":"a0b8268c-80c2-4629-9123-ad0dca8c1493","Type":"ContainerDied","Data":"fb36e06e8ad4a119e5764ca1d101ffb015ea81a6f293d9b6cc368c867b891eb9"}
Jul 06 19:32:03.152033 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:03.151997    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6" event={"ID":"a0b8268c-80c2-4629-9123-ad0dca8c1493","Type":"ContainerStarted","Data":"f10d092b6f4c42a3f17b8bfa670b7453b73b3f3698c0273d9e777315363f7409"}
Jul 06 19:32:03.152406 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:03.152136    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:32:03.205158 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:03.205096    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6" podStartSLOduration=2.403572121 podStartE2EDuration="8.205079766s" totalImagesPullingTime="4.789390284s" totalInitContainerRuntime="1.012117361s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:03.203677879 +0000 UTC m=+362.130715798" watchObservedRunningTime="2026-07-06 19:32:03.205079766 +0000 UTC m=+362.132117682"
Jul 06 19:32:12.143536 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:12.143498    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:32:14.158294 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:14.158253    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-hhjk6"
Jul 06 19:32:26.671072 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.671037    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"]
Jul 06 19:32:26.674449 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.674433    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.682820 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.682798    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.682915 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.682832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkkn4\" (UniqueName: \"kubernetes.io/projected/f1dc92a1-adcd-4055-b16d-4e3476722302-kube-api-access-pkkn4\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.682915 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.682859    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.682915 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.682887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.682915 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.682906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1dc92a1-adcd-4055-b16d-4e3476722302-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.683078 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.682922    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.683078 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.683007    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.700098 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.700073    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mjzgz\""
Jul 06 19:32:26.700342 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.700322    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:32:26.700404 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.700335    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:32:26.700404 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:32:26.700334    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret"
Jul 06 19:32:26.700491 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.700407    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:32:26.700491 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:32:26.700409    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret"
Jul 06 19:32:26.700491 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.700413    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:32:26.757058 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.757030    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"]
Jul 06 19:32:26.784117 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784089    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkkn4\" (UniqueName: \"kubernetes.io/projected/f1dc92a1-adcd-4055-b16d-4e3476722302-kube-api-access-pkkn4\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784243 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784129    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784243 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784152    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784243 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784170    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1dc92a1-adcd-4055-b16d-4e3476722302-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784243 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784194    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784243 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784232    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784466 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784296    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.784780 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.784759    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.786578 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.786555    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1dc92a1-adcd-4055-b16d-4e3476722302-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.786693 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.786676    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.825424 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.825389    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:26.827262 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:26.827235    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkkn4\" (UniqueName: \"kubernetes.io/projected/f1dc92a1-adcd-4055-b16d-4e3476722302-kube-api-access-pkkn4\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:27.566917 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:27.566886    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:32:27.576970 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:27.576918    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:27.784749 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:32:27.784716    2552 secret.go:189] Couldn't get secret openshift-ingress/istio-kubeconfig: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:32:27.785142 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:32:27.784808    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-kubeconfig podName:f1dc92a1-adcd-4055-b16d-4e3476722302 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:28.284787096 +0000 UTC m=+387.211824993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-kubeconfig" (UniqueName: "kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-kubeconfig") pod "istiod-openshift-gateway-94bb8fbfd-ctv49" (UID: "f1dc92a1-adcd-4055-b16d-4e3476722302") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:32:28.236380 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:28.236343    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:32:28.295299 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:28.295264    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:28.297682 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:28.297655    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1dc92a1-adcd-4055-b16d-4e3476722302-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ctv49\" (UID: \"f1dc92a1-adcd-4055-b16d-4e3476722302\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:28.482567 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:28.482521    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:28.680853 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:28.680820    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"]
Jul 06 19:32:28.684317 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:32:28.684286    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dc92a1_adcd_4055_b16d_4e3476722302.slice/crio-e8f4f097d2a25f5d59c9a03c280f6796ba1c33f6026c98e675d35270609aab9c WatchSource:0}: Error finding container e8f4f097d2a25f5d59c9a03c280f6796ba1c33f6026c98e675d35270609aab9c: Status 404 returned error can't find the container with id e8f4f097d2a25f5d59c9a03c280f6796ba1c33f6026c98e675d35270609aab9c
Jul 06 19:32:29.271759 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:29.271717    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49" event={"ID":"f1dc92a1-adcd-4055-b16d-4e3476722302","Type":"ContainerStarted","Data":"e8f4f097d2a25f5d59c9a03c280f6796ba1c33f6026c98e675d35270609aab9c"}
Jul 06 19:32:30.745871 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:30.745823    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:32:30.746171 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:30.745891    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 06 19:32:31.281996 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:31.281957    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49" event={"ID":"f1dc92a1-adcd-4055-b16d-4e3476722302","Type":"ContainerStarted","Data":"e0e7814ac9a1a7280f15590d5087d849b3c0ba9c7406b39210f3c457e207068c"}
Jul 06 19:32:31.282208 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:31.282187    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:32:31.283778 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:31.283751    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-ctv49 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:32:31.283895 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:31.283810    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49" podUID="f1dc92a1-adcd-4055-b16d-4e3476722302" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:32:31.363781 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:31.363732    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49" podStartSLOduration=3.30441657 podStartE2EDuration="5.363714212s" totalImagesPullingTime="2.059297642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:31.362782155 +0000 UTC m=+390.289820076" watchObservedRunningTime="2026-07-06 19:32:31.363714212 +0000 UTC m=+390.290752130"
Jul 06 19:32:32.287057 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:32:32.287027    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ctv49"
Jul 06 19:34:52.635571 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.635492    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:34:52.638672 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.638654    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.641516 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.641486    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:34:52.642231 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.642214    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qbkj7\""
Jul 06 19:34:52.642327 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.642244    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:34:52.642396 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.642325    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:34:52.649134 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.649115    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:34:52.726221 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.726187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-config-file\") pod \"limitador-limitador-64c94fd64f-dglrz\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.726375 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.726246    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgtv9\" (UniqueName: \"kubernetes.io/projected/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-kube-api-access-hgtv9\") pod \"limitador-limitador-64c94fd64f-dglrz\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.737561 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.737532    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:34:52.826849 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.826816    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgtv9\" (UniqueName: \"kubernetes.io/projected/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-kube-api-access-hgtv9\") pod \"limitador-limitador-64c94fd64f-dglrz\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.827020 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.826926    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-config-file\") pod \"limitador-limitador-64c94fd64f-dglrz\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.827521 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.827502    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-config-file\") pod \"limitador-limitador-64c94fd64f-dglrz\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.841622 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.841559    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgtv9\" (UniqueName: \"kubernetes.io/projected/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-kube-api-access-hgtv9\") pod \"limitador-limitador-64c94fd64f-dglrz\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:52.948779 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:52.948745    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:53.089589 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:53.089564    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:34:53.092153 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:34:53.092123    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4beb22da_49c9_40dc_b4e1_8780ce9aaf3c.slice/crio-2f2c8a8c301bae8a7d843bdc119098cb1bd35be3db744de7067f9764162503cb WatchSource:0}: Error finding container 2f2c8a8c301bae8a7d843bdc119098cb1bd35be3db744de7067f9764162503cb: Status 404 returned error can't find the container with id 2f2c8a8c301bae8a7d843bdc119098cb1bd35be3db744de7067f9764162503cb
Jul 06 19:34:53.884537 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:53.884494    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz" event={"ID":"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c","Type":"ContainerStarted","Data":"2f2c8a8c301bae8a7d843bdc119098cb1bd35be3db744de7067f9764162503cb"}
Jul 06 19:34:55.894523 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:55.894480    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz" event={"ID":"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c","Type":"ContainerStarted","Data":"469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49"}
Jul 06 19:34:55.894908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:55.894572    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:34:55.912041 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:34:55.911984    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz" podStartSLOduration=1.307014137 podStartE2EDuration="3.911966182s" totalImagesPullingTime="2.604952045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:55.91186619 +0000 UTC m=+534.838904109" watchObservedRunningTime="2026-07-06 19:34:55.911966182 +0000 UTC m=+534.839004105"
Jul 06 19:35:06.900205 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:06.900179    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:35:08.592187 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:08.592147    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:35:08.592588 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:08.592348    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz" podUID="4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" containerName="limitador" containerID="cri-o://469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49" gracePeriod=30
Jul 06 19:35:09.130098 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.130072    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:35:09.163134 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.163056    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-config-file\") pod \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") "
Jul 06 19:35:09.163134 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.163103    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgtv9\" (UniqueName: \"kubernetes.io/projected/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-kube-api-access-hgtv9\") pod \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\" (UID: \"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c\") "
Jul 06 19:35:09.163384 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.163360    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-config-file" (OuterVolumeSpecName: "config-file") pod "4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" (UID: "4beb22da-49c9-40dc-b4e1-8780ce9aaf3c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:09.165429 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.165394    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-kube-api-access-hgtv9" (OuterVolumeSpecName: "kube-api-access-hgtv9") pod "4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" (UID: "4beb22da-49c9-40dc-b4e1-8780ce9aaf3c"). InnerVolumeSpecName "kube-api-access-hgtv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:09.263758 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.263722    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-config-file\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:35:09.263758 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.263750    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgtv9\" (UniqueName: \"kubernetes.io/projected/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c-kube-api-access-hgtv9\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:35:09.956736 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.956701    2552 generic.go:356] "Generic (PLEG): container finished" podID="4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" containerID="469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49" exitCode=0
Jul 06 19:35:09.957237 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.956750    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz"
Jul 06 19:35:09.957237 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.956762    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz" event={"ID":"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c","Type":"ContainerDied","Data":"469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49"}
Jul 06 19:35:09.957237 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.956804    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dglrz" event={"ID":"4beb22da-49c9-40dc-b4e1-8780ce9aaf3c","Type":"ContainerDied","Data":"2f2c8a8c301bae8a7d843bdc119098cb1bd35be3db744de7067f9764162503cb"}
Jul 06 19:35:09.957237 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.956826    2552 scope.go:117] "RemoveContainer" containerID="469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49"
Jul 06 19:35:09.965080 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.965059    2552 scope.go:117] "RemoveContainer" containerID="469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49"
Jul 06 19:35:09.965340 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:35:09.965320    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49\": container with ID starting with 469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49 not found: ID does not exist" containerID="469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49"
Jul 06 19:35:09.965381 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.965350    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49"} err="failed to get container status \"469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49\": rpc error: code = NotFound desc = could not find container \"469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49\": container with ID starting with 469a59b69d52ec47a7ecda3653b9d2ebb3f62a2cf1152bb72ce0cabd6507ae49 not found: ID does not exist"
Jul 06 19:35:09.974757 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.974729    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:35:09.977380 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:09.977361    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dglrz"]
Jul 06 19:35:11.705583 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:11.705549    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" path="/var/lib/kubelet/pods/4beb22da-49c9-40dc-b4e1-8780ce9aaf3c/volumes"
Jul 06 19:35:14.281747 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.281708    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vhz2w"]
Jul 06 19:35:14.282250 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.282233    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" containerName="limitador"
Jul 06 19:35:14.282298 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.282254    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" containerName="limitador"
Jul 06 19:35:14.282367 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.282356    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4beb22da-49c9-40dc-b4e1-8780ce9aaf3c" containerName="limitador"
Jul 06 19:35:14.287119 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.287083    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.290452 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.290425    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ktqft\""
Jul 06 19:35:14.290590 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.290485    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 19:35:14.301954 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.301908    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wtn\" (UniqueName: \"kubernetes.io/projected/e879fa8b-2fda-4927-8501-f1b7c3ff7a35-kube-api-access-86wtn\") pod \"postgres-69fb4594cf-vhz2w\" (UID: \"e879fa8b-2fda-4927-8501-f1b7c3ff7a35\") " pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.302056 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.302027    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e879fa8b-2fda-4927-8501-f1b7c3ff7a35-data\") pod \"postgres-69fb4594cf-vhz2w\" (UID: \"e879fa8b-2fda-4927-8501-f1b7c3ff7a35\") " pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.303869 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.303847    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vhz2w"]
Jul 06 19:35:14.403334 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.403297    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e879fa8b-2fda-4927-8501-f1b7c3ff7a35-data\") pod \"postgres-69fb4594cf-vhz2w\" (UID: \"e879fa8b-2fda-4927-8501-f1b7c3ff7a35\") " pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.403496 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.403354    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wtn\" (UniqueName: \"kubernetes.io/projected/e879fa8b-2fda-4927-8501-f1b7c3ff7a35-kube-api-access-86wtn\") pod \"postgres-69fb4594cf-vhz2w\" (UID: \"e879fa8b-2fda-4927-8501-f1b7c3ff7a35\") " pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.403703 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.403681    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e879fa8b-2fda-4927-8501-f1b7c3ff7a35-data\") pod \"postgres-69fb4594cf-vhz2w\" (UID: \"e879fa8b-2fda-4927-8501-f1b7c3ff7a35\") " pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.414132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.414113    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wtn\" (UniqueName: \"kubernetes.io/projected/e879fa8b-2fda-4927-8501-f1b7c3ff7a35-kube-api-access-86wtn\") pod \"postgres-69fb4594cf-vhz2w\" (UID: \"e879fa8b-2fda-4927-8501-f1b7c3ff7a35\") " pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.597377 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.597294    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:14.732136 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.732084    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vhz2w"]
Jul 06 19:35:14.734396 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:35:14.734368    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode879fa8b_2fda_4927_8501_f1b7c3ff7a35.slice/crio-7c2e3a3af4d2fbd3927dad8c46ae68b556e19e286cca5ed653f0b038d0a105de WatchSource:0}: Error finding container 7c2e3a3af4d2fbd3927dad8c46ae68b556e19e286cca5ed653f0b038d0a105de: Status 404 returned error can't find the container with id 7c2e3a3af4d2fbd3927dad8c46ae68b556e19e286cca5ed653f0b038d0a105de
Jul 06 19:35:14.981330 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:14.981289    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vhz2w" event={"ID":"e879fa8b-2fda-4927-8501-f1b7c3ff7a35","Type":"ContainerStarted","Data":"7c2e3a3af4d2fbd3927dad8c46ae68b556e19e286cca5ed653f0b038d0a105de"}
Jul 06 19:35:20.008730 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:20.008690    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vhz2w" event={"ID":"e879fa8b-2fda-4927-8501-f1b7c3ff7a35","Type":"ContainerStarted","Data":"9497f65e23d45f40fb74394487d5116e8f2d211ff910cbba56e7a57c8bfc3a4d"}
Jul 06 19:35:20.009154 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:20.008831    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:20.032665 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:20.032612    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vhz2w" podStartSLOduration=1.411117934 podStartE2EDuration="6.03259748s" totalImagesPullingTime="4.621479546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:20.031135244 +0000 UTC m=+558.958173163" watchObservedRunningTime="2026-07-06 19:35:20.03259748 +0000 UTC m=+558.959635398"
Jul 06 19:35:26.042085 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:26.042057    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vhz2w"
Jul 06 19:35:33.342221 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.342191    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f67c6b998-98mqz"]
Jul 06 19:35:33.372081 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.372051    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f67c6b998-98mqz"]
Jul 06 19:35:33.372268 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.372174    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:33.377890 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.377864    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:35:33.378187 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.377876    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:35:33.378305 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.377885    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x8sn9\""
Jul 06 19:35:33.469371 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.469333    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:33.469574 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.469457    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9v4r\" (UniqueName: \"kubernetes.io/projected/db332fc2-3151-4f67-8f4f-32b30da0821e-kube-api-access-x9v4r\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:33.570015 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.569970    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9v4r\" (UniqueName: \"kubernetes.io/projected/db332fc2-3151-4f67-8f4f-32b30da0821e-kube-api-access-x9v4r\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:33.570210 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.570057    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:33.570210 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:35:33.570184    2552 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 19:35:33.570329 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:35:33.570263    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert podName:db332fc2-3151-4f67-8f4f-32b30da0821e nodeName:}" failed. No retries permitted until 2026-07-06 19:35:34.070239598 +0000 UTC m=+572.997277496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert") pod "maas-controller-5f67c6b998-98mqz" (UID: "db332fc2-3151-4f67-8f4f-32b30da0821e") : secret "maas-controller-webhook-cert" not found
Jul 06 19:35:33.587266 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.587238    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9v4r\" (UniqueName: \"kubernetes.io/projected/db332fc2-3151-4f67-8f4f-32b30da0821e-kube-api-access-x9v4r\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:33.597745 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.597685    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f4c455986-756xq"]
Jul 06 19:35:33.600277 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.600261    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:33.614114 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.614093    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4c455986-756xq"]
Jul 06 19:35:33.670895 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.670867    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f2e6839-4197-4412-a76c-8a13c22aa4b5-webhook-cert\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:33.671074 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.670915    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8pph\" (UniqueName: \"kubernetes.io/projected/5f2e6839-4197-4412-a76c-8a13c22aa4b5-kube-api-access-t8pph\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:33.772397 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.772365    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f2e6839-4197-4412-a76c-8a13c22aa4b5-webhook-cert\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:33.772588 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.772407    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8pph\" (UniqueName: \"kubernetes.io/projected/5f2e6839-4197-4412-a76c-8a13c22aa4b5-kube-api-access-t8pph\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:33.772588 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:35:33.772497    2552 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 19:35:33.772588 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:35:33.772558    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f2e6839-4197-4412-a76c-8a13c22aa4b5-webhook-cert podName:5f2e6839-4197-4412-a76c-8a13c22aa4b5 nodeName:}" failed. No retries permitted until 2026-07-06 19:35:34.272544292 +0000 UTC m=+573.199582191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5f2e6839-4197-4412-a76c-8a13c22aa4b5-webhook-cert") pod "maas-controller-7f4c455986-756xq" (UID: "5f2e6839-4197-4412-a76c-8a13c22aa4b5") : secret "maas-controller-webhook-cert" not found
Jul 06 19:35:33.781911 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:33.781880    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8pph\" (UniqueName: \"kubernetes.io/projected/5f2e6839-4197-4412-a76c-8a13c22aa4b5-kube-api-access-t8pph\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:34.075603 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.075566    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:34.078097 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.078071    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert\") pod \"maas-controller-5f67c6b998-98mqz\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") " pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:34.277250 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.277207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f2e6839-4197-4412-a76c-8a13c22aa4b5-webhook-cert\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:34.279756 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.279736    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f2e6839-4197-4412-a76c-8a13c22aa4b5-webhook-cert\") pod \"maas-controller-7f4c455986-756xq\" (UID: \"5f2e6839-4197-4412-a76c-8a13c22aa4b5\") " pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:34.282668 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.282647    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:34.419509 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.419482    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f67c6b998-98mqz"]
Jul 06 19:35:34.422136 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:35:34.422108    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb332fc2_3151_4f67_8f4f_32b30da0821e.slice/crio-1e2fd041ab9c2e93ff013530c42471b05d0b41681b2d5c6e54e383d14dc228f0 WatchSource:0}: Error finding container 1e2fd041ab9c2e93ff013530c42471b05d0b41681b2d5c6e54e383d14dc228f0: Status 404 returned error can't find the container with id 1e2fd041ab9c2e93ff013530c42471b05d0b41681b2d5c6e54e383d14dc228f0
Jul 06 19:35:34.510584 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.510504    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:34.663830 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:34.663795    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4c455986-756xq"]
Jul 06 19:35:34.666734 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:35:34.666709    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2e6839_4197_4412_a76c_8a13c22aa4b5.slice/crio-06a0045b724a30ad8a39ede8bf05c2dbafa17c2b1d11f59335fdb32653f573ad WatchSource:0}: Error finding container 06a0045b724a30ad8a39ede8bf05c2dbafa17c2b1d11f59335fdb32653f573ad: Status 404 returned error can't find the container with id 06a0045b724a30ad8a39ede8bf05c2dbafa17c2b1d11f59335fdb32653f573ad
Jul 06 19:35:35.078307 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:35.078260    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f67c6b998-98mqz" event={"ID":"db332fc2-3151-4f67-8f4f-32b30da0821e","Type":"ContainerStarted","Data":"1e2fd041ab9c2e93ff013530c42471b05d0b41681b2d5c6e54e383d14dc228f0"}
Jul 06 19:35:35.079743 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:35.079697    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c455986-756xq" event={"ID":"5f2e6839-4197-4412-a76c-8a13c22aa4b5","Type":"ContainerStarted","Data":"06a0045b724a30ad8a39ede8bf05c2dbafa17c2b1d11f59335fdb32653f573ad"}
Jul 06 19:35:37.090834 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:37.090792    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f67c6b998-98mqz" event={"ID":"db332fc2-3151-4f67-8f4f-32b30da0821e","Type":"ContainerStarted","Data":"628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6"}
Jul 06 19:35:37.091315 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:37.090969    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:37.092226 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:37.092207    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c455986-756xq" event={"ID":"5f2e6839-4197-4412-a76c-8a13c22aa4b5","Type":"ContainerStarted","Data":"707aa37180868f81d91c564f89da4d05de6eaeea26810e7ab3722be493431c92"}
Jul 06 19:35:37.092320 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:37.092248    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:37.119304 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:37.119258    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f67c6b998-98mqz" podStartSLOduration=1.999609215 podStartE2EDuration="4.119244785s" totalImagesPullingTime="2.11963557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:37.118112143 +0000 UTC m=+576.045150063" watchObservedRunningTime="2026-07-06 19:35:37.119244785 +0000 UTC m=+576.046282703"
Jul 06 19:35:37.152799 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:37.152755    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f4c455986-756xq" podStartSLOduration=2.268489863 podStartE2EDuration="4.152742133s" totalImagesPullingTime="1.88425227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:37.151512374 +0000 UTC m=+576.078550291" watchObservedRunningTime="2026-07-06 19:35:37.152742133 +0000 UTC m=+576.079780051"
Jul 06 19:35:48.104233 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.104201    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:35:48.104706 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.104428    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:48.191436 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.191396    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f67c6b998-98mqz"]
Jul 06 19:35:48.191693 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.191643    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5f67c6b998-98mqz" podUID="db332fc2-3151-4f67-8f4f-32b30da0821e" containerName="manager" containerID="cri-o://628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6" gracePeriod=30
Jul 06 19:35:48.433539 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.433509    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:48.607716 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.607688    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9v4r\" (UniqueName: \"kubernetes.io/projected/db332fc2-3151-4f67-8f4f-32b30da0821e-kube-api-access-x9v4r\") pod \"db332fc2-3151-4f67-8f4f-32b30da0821e\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") "
Jul 06 19:35:48.607877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.607819    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert\") pod \"db332fc2-3151-4f67-8f4f-32b30da0821e\" (UID: \"db332fc2-3151-4f67-8f4f-32b30da0821e\") "
Jul 06 19:35:48.610042 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.610015    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "db332fc2-3151-4f67-8f4f-32b30da0821e" (UID: "db332fc2-3151-4f67-8f4f-32b30da0821e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:48.610172 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.610042    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db332fc2-3151-4f67-8f4f-32b30da0821e-kube-api-access-x9v4r" (OuterVolumeSpecName: "kube-api-access-x9v4r") pod "db332fc2-3151-4f67-8f4f-32b30da0821e" (UID: "db332fc2-3151-4f67-8f4f-32b30da0821e"). InnerVolumeSpecName "kube-api-access-x9v4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:48.708962 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.708918    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db332fc2-3151-4f67-8f4f-32b30da0821e-webhook-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:35:48.708962 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:48.708960    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9v4r\" (UniqueName: \"kubernetes.io/projected/db332fc2-3151-4f67-8f4f-32b30da0821e-kube-api-access-x9v4r\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:35:49.145418 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.145386    2552 generic.go:356] "Generic (PLEG): container finished" podID="db332fc2-3151-4f67-8f4f-32b30da0821e" containerID="628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6" exitCode=0
Jul 06 19:35:49.145794 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.145428    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f67c6b998-98mqz"
Jul 06 19:35:49.145794 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.145469    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f67c6b998-98mqz" event={"ID":"db332fc2-3151-4f67-8f4f-32b30da0821e","Type":"ContainerDied","Data":"628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6"}
Jul 06 19:35:49.145794 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.145517    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f67c6b998-98mqz" event={"ID":"db332fc2-3151-4f67-8f4f-32b30da0821e","Type":"ContainerDied","Data":"1e2fd041ab9c2e93ff013530c42471b05d0b41681b2d5c6e54e383d14dc228f0"}
Jul 06 19:35:49.145794 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.145536    2552 scope.go:117] "RemoveContainer" containerID="628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6"
Jul 06 19:35:49.153914 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.153896    2552 scope.go:117] "RemoveContainer" containerID="628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6"
Jul 06 19:35:49.154180 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:35:49.154164    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6\": container with ID starting with 628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6 not found: ID does not exist" containerID="628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6"
Jul 06 19:35:49.154243 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.154192    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6"} err="failed to get container status \"628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6\": rpc error: code = NotFound desc = could not find container \"628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6\": container with ID starting with 628ebc0cfb1c61bbc399f15e96c54cfb25acb6c19929947d4902f48e0a8f84c6 not found: ID does not exist"
Jul 06 19:35:49.170065 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.170047    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f67c6b998-98mqz"]
Jul 06 19:35:49.171428 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.171411    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f67c6b998-98mqz"]
Jul 06 19:35:49.706345 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:35:49.706302    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db332fc2-3151-4f67-8f4f-32b30da0821e" path="/var/lib/kubelet/pods/db332fc2-3151-4f67-8f4f-32b30da0821e/volumes"
Jul 06 19:36:01.551910 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:01.551881    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:36:01.552363 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:01.551928    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:36:08.924568 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.924531    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6bcbb57667-sgfvb"]
Jul 06 19:36:08.924985 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.924877    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db332fc2-3151-4f67-8f4f-32b30da0821e" containerName="manager"
Jul 06 19:36:08.924985 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.924888    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="db332fc2-3151-4f67-8f4f-32b30da0821e" containerName="manager"
Jul 06 19:36:08.924985 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.924978    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="db332fc2-3151-4f67-8f4f-32b30da0821e" containerName="manager"
Jul 06 19:36:08.927847 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.927831    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:08.930920 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.930892    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 19:36:08.931070 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.930980    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ghqtd\""
Jul 06 19:36:08.939788 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.939760    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6bcbb57667-sgfvb"]
Jul 06 19:36:08.976813 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.976776    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd67f99e-0e56-491b-ae16-8aa371530dd6-openshift-service-ca\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:08.976813 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.976819    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkfws\" (UniqueName: \"kubernetes.io/projected/cd67f99e-0e56-491b-ae16-8aa371530dd6-kube-api-access-fkfws\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:08.977066 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:08.976867    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd67f99e-0e56-491b-ae16-8aa371530dd6-maas-api-tls\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.078218 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.078176    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd67f99e-0e56-491b-ae16-8aa371530dd6-maas-api-tls\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.078407 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.078239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd67f99e-0e56-491b-ae16-8aa371530dd6-openshift-service-ca\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.078407 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.078271    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkfws\" (UniqueName: \"kubernetes.io/projected/cd67f99e-0e56-491b-ae16-8aa371530dd6-kube-api-access-fkfws\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.078407 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:36:09.078345    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 19:36:09.078573 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:36:09.078415    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd67f99e-0e56-491b-ae16-8aa371530dd6-maas-api-tls podName:cd67f99e-0e56-491b-ae16-8aa371530dd6 nodeName:}" failed. No retries permitted until 2026-07-06 19:36:09.578393874 +0000 UTC m=+608.505431771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd67f99e-0e56-491b-ae16-8aa371530dd6-maas-api-tls") pod "maas-api-6bcbb57667-sgfvb" (UID: "cd67f99e-0e56-491b-ae16-8aa371530dd6") : secret "maas-api-serving-cert" not found
Jul 06 19:36:09.078920 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.078901    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd67f99e-0e56-491b-ae16-8aa371530dd6-openshift-service-ca\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.088101 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.088073    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkfws\" (UniqueName: \"kubernetes.io/projected/cd67f99e-0e56-491b-ae16-8aa371530dd6-kube-api-access-fkfws\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.469961 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.469904    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qhpnl"]
Jul 06 19:36:09.474556 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.474537    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.478156 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.478136    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 19:36:09.480880 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.480854    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b603e00-1641-4fd6-92e0-c2a5c0a75b36-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qhpnl\" (UID: \"9b603e00-1641-4fd6-92e0-c2a5c0a75b36\") " pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.481013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.480912    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddf67\" (UniqueName: \"kubernetes.io/projected/9b603e00-1641-4fd6-92e0-c2a5c0a75b36-kube-api-access-ddf67\") pod \"payload-pre-processing-7964457696-qhpnl\" (UID: \"9b603e00-1641-4fd6-92e0-c2a5c0a75b36\") " pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.486562 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.486533    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qhpnl"]
Jul 06 19:36:09.506005 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.505972    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qvfxf"]
Jul 06 19:36:09.508493 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.508477    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.511257 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.511230    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-z7hq9\""
Jul 06 19:36:09.521752 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.521723    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qvfxf"]
Jul 06 19:36:09.581744 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.581699    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929c2e44-6900-4553-bb4a-7017a9c9038a-plugins-config-volume\") pod \"payload-processing-58f86c7798-qvfxf\" (UID: \"929c2e44-6900-4553-bb4a-7017a9c9038a\") " pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.581744 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.581749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqtvj\" (UniqueName: \"kubernetes.io/projected/929c2e44-6900-4553-bb4a-7017a9c9038a-kube-api-access-vqtvj\") pod \"payload-processing-58f86c7798-qvfxf\" (UID: \"929c2e44-6900-4553-bb4a-7017a9c9038a\") " pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.581998 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.581850    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd67f99e-0e56-491b-ae16-8aa371530dd6-maas-api-tls\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.581998 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.581890    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b603e00-1641-4fd6-92e0-c2a5c0a75b36-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qhpnl\" (UID: \"9b603e00-1641-4fd6-92e0-c2a5c0a75b36\") " pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.581998 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.581918    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddf67\" (UniqueName: \"kubernetes.io/projected/9b603e00-1641-4fd6-92e0-c2a5c0a75b36-kube-api-access-ddf67\") pod \"payload-pre-processing-7964457696-qhpnl\" (UID: \"9b603e00-1641-4fd6-92e0-c2a5c0a75b36\") " pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.582608 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.582589    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b603e00-1641-4fd6-92e0-c2a5c0a75b36-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qhpnl\" (UID: \"9b603e00-1641-4fd6-92e0-c2a5c0a75b36\") " pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.584575 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.584549    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd67f99e-0e56-491b-ae16-8aa371530dd6-maas-api-tls\") pod \"maas-api-6bcbb57667-sgfvb\" (UID: \"cd67f99e-0e56-491b-ae16-8aa371530dd6\") " pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.591860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.591829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddf67\" (UniqueName: \"kubernetes.io/projected/9b603e00-1641-4fd6-92e0-c2a5c0a75b36-kube-api-access-ddf67\") pod \"payload-pre-processing-7964457696-qhpnl\" (UID: \"9b603e00-1641-4fd6-92e0-c2a5c0a75b36\") " pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.682788 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.682738    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929c2e44-6900-4553-bb4a-7017a9c9038a-plugins-config-volume\") pod \"payload-processing-58f86c7798-qvfxf\" (UID: \"929c2e44-6900-4553-bb4a-7017a9c9038a\") " pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.682788 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.682782    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtvj\" (UniqueName: \"kubernetes.io/projected/929c2e44-6900-4553-bb4a-7017a9c9038a-kube-api-access-vqtvj\") pod \"payload-processing-58f86c7798-qvfxf\" (UID: \"929c2e44-6900-4553-bb4a-7017a9c9038a\") " pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.683577 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.683551    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929c2e44-6900-4553-bb4a-7017a9c9038a-plugins-config-volume\") pod \"payload-processing-58f86c7798-qvfxf\" (UID: \"929c2e44-6900-4553-bb4a-7017a9c9038a\") " pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.691190 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.691168    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqtvj\" (UniqueName: \"kubernetes.io/projected/929c2e44-6900-4553-bb4a-7017a9c9038a-kube-api-access-vqtvj\") pod \"payload-processing-58f86c7798-qvfxf\" (UID: \"929c2e44-6900-4553-bb4a-7017a9c9038a\") " pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.786136 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.786047    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:09.818050 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.818014    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:09.838489 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.838450    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:09.975577 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:09.975517    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qhpnl"]
Jul 06 19:36:10.000405 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:10.000378    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qvfxf"]
Jul 06 19:36:10.002950 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:36:10.002901    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929c2e44_6900_4553_bb4a_7017a9c9038a.slice/crio-cac4a18e6d0b6f76f01dfae169095fa3015592df5b267e3d95b2f2e062a0b867 WatchSource:0}: Error finding container cac4a18e6d0b6f76f01dfae169095fa3015592df5b267e3d95b2f2e062a0b867: Status 404 returned error can't find the container with id cac4a18e6d0b6f76f01dfae169095fa3015592df5b267e3d95b2f2e062a0b867
Jul 06 19:36:10.036815 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:10.036795    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6bcbb57667-sgfvb"]
Jul 06 19:36:10.038541 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:36:10.038518    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd67f99e_0e56_491b_ae16_8aa371530dd6.slice/crio-d1bf8eb6abd64a033a8c616dde935fcffc0997c01d9e3fd9299bdb5909f1124f WatchSource:0}: Error finding container d1bf8eb6abd64a033a8c616dde935fcffc0997c01d9e3fd9299bdb5909f1124f: Status 404 returned error can't find the container with id d1bf8eb6abd64a033a8c616dde935fcffc0997c01d9e3fd9299bdb5909f1124f
Jul 06 19:36:10.243839 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:10.243803    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf" event={"ID":"929c2e44-6900-4553-bb4a-7017a9c9038a","Type":"ContainerStarted","Data":"cac4a18e6d0b6f76f01dfae169095fa3015592df5b267e3d95b2f2e062a0b867"}
Jul 06 19:36:10.244951 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:10.244915    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6bcbb57667-sgfvb" event={"ID":"cd67f99e-0e56-491b-ae16-8aa371530dd6","Type":"ContainerStarted","Data":"d1bf8eb6abd64a033a8c616dde935fcffc0997c01d9e3fd9299bdb5909f1124f"}
Jul 06 19:36:10.246066 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:10.246042    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl" event={"ID":"9b603e00-1641-4fd6-92e0-c2a5c0a75b36","Type":"ContainerStarted","Data":"d76f210826fe5e7b126c6718db893c815de9551e5872af21d748fcaab6bf93dc"}
Jul 06 19:36:12.259365 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:12.259329    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl" event={"ID":"9b603e00-1641-4fd6-92e0-c2a5c0a75b36","Type":"ContainerStarted","Data":"76130efab1ca6f6d177e0d0873f10176329cd01065e3e543ab5e15da865509ad"}
Jul 06 19:36:12.259847 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:12.259550    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:12.261161 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:12.261136    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf" event={"ID":"929c2e44-6900-4553-bb4a-7017a9c9038a","Type":"ContainerStarted","Data":"ea0b6383b7153d1ae2a0e258fb3a31c1fd9f257b907d34fbae28831338c17c27"}
Jul 06 19:36:12.261274 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:12.261263    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:12.278409 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:12.278353    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl" podStartSLOduration=1.9507304460000001 podStartE2EDuration="3.278333558s" totalImagesPullingTime="1.327603112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:12.27778473 +0000 UTC m=+611.204822751" watchObservedRunningTime="2026-07-06 19:36:12.278333558 +0000 UTC m=+611.205371455"
Jul 06 19:36:12.298477 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:12.298419    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf" podStartSLOduration=1.999594522 podStartE2EDuration="3.298393856s" totalImagesPullingTime="1.298799334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:12.296560459 +0000 UTC m=+611.223598379" watchObservedRunningTime="2026-07-06 19:36:12.298393856 +0000 UTC m=+611.225431774"
Jul 06 19:36:13.267100 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:13.267063    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6bcbb57667-sgfvb" event={"ID":"cd67f99e-0e56-491b-ae16-8aa371530dd6","Type":"ContainerStarted","Data":"93005f7ea3343a55293411c38e3c16c9cae6b59a9d4afe482e4f551a9c616275"}
Jul 06 19:36:13.267506 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:13.267168    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:13.292587 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:13.292526    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6bcbb57667-sgfvb" podStartSLOduration=2.976505892 podStartE2EDuration="5.29250718s" totalImagesPullingTime="2.316001288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:13.289796909 +0000 UTC m=+612.216834830" watchObservedRunningTime="2026-07-06 19:36:13.29250718 +0000 UTC m=+612.219545095"
Jul 06 19:36:19.277752 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:19.277721    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6bcbb57667-sgfvb"
Jul 06 19:36:23.268912 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:23.268882    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-qvfxf"
Jul 06 19:36:23.269301 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:23.268974    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qhpnl"
Jul 06 19:36:28.177783 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.177749    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"]
Jul 06 19:36:28.180254 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.180238    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.183005 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.182987    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:36:28.184169 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.184150    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbnnk\""
Jul 06 19:36:28.184271 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.184188    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:36:28.184271 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.184198    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:36:28.193905 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.193879    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"]
Jul 06 19:36:28.258706 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.258674    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.258706 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.258716    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d51460f9-0762-4c10-bd1d-d3c89e688ba6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.258911 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.258792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.258911 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.258818    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mpwp\" (UniqueName: \"kubernetes.io/projected/d51460f9-0762-4c10-bd1d-d3c89e688ba6-kube-api-access-8mpwp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.258911 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.258847    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.258911 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.258872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.359859 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.359818    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.359859 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.359866    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d51460f9-0762-4c10-bd1d-d3c89e688ba6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.359910    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.359927    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mpwp\" (UniqueName: \"kubernetes.io/projected/d51460f9-0762-4c10-bd1d-d3c89e688ba6-kube-api-access-8mpwp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.359991    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360132 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.360021    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360380 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.360356    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360446 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.360397    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.360446 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.360436    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.362240 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.362222    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d51460f9-0762-4c10-bd1d-d3c89e688ba6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.362470 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.362453    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d51460f9-0762-4c10-bd1d-d3c89e688ba6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.369014 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.368994    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mpwp\" (UniqueName: \"kubernetes.io/projected/d51460f9-0762-4c10-bd1d-d3c89e688ba6-kube-api-access-8mpwp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk\" (UID: \"d51460f9-0762-4c10-bd1d-d3c89e688ba6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.490182 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.490144    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:28.623820 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.623795    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"]
Jul 06 19:36:28.626467 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:36:28.626435    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51460f9_0762_4c10_bd1d_d3c89e688ba6.slice/crio-34a1923dcb4097b138d1ac54a43aac8433940c8cd615c3853d4adcc01baf58f4 WatchSource:0}: Error finding container 34a1923dcb4097b138d1ac54a43aac8433940c8cd615c3853d4adcc01baf58f4: Status 404 returned error can't find the container with id 34a1923dcb4097b138d1ac54a43aac8433940c8cd615c3853d4adcc01baf58f4
Jul 06 19:36:28.627981 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:28.627957    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:36:29.343419 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:29.343381    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk" event={"ID":"d51460f9-0762-4c10-bd1d-d3c89e688ba6","Type":"ContainerStarted","Data":"34a1923dcb4097b138d1ac54a43aac8433940c8cd615c3853d4adcc01baf58f4"}
Jul 06 19:36:30.349694 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:30.349651    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk" event={"ID":"d51460f9-0762-4c10-bd1d-d3c89e688ba6","Type":"ContainerStarted","Data":"c43a0ffcf582320211daef7c8fc1e9ee016af301a5171da3ce1938328f2b41c7"}
Jul 06 19:36:30.370754 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:30.370701    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk" podStartSLOduration=1.391718686 podStartE2EDuration="2.370686971s" totalImagesPullingTime="978.968285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:30.368209728 +0000 UTC m=+629.295247647" watchObservedRunningTime="2026-07-06 19:36:30.370686971 +0000 UTC m=+629.297724888"
Jul 06 19:36:38.490803 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:38.490767    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:38.491264 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:38.490977    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:38.503113 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:38.503086    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:39.399674 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:39.399649    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk"
Jul 06 19:36:53.473423 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.473391    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"]
Jul 06 19:36:53.476881 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.476849    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.480078 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480053    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 19:36:53.480445 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480420    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.480501 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480467    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.480620 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480596    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbc5cf3-78f5-4176-8515-f159a7f9454f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.480729 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480711    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j445b\" (UniqueName: \"kubernetes.io/projected/dbbc5cf3-78f5-4176-8515-f159a7f9454f-kube-api-access-j445b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.480772 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480756    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.480804 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.480782    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.486632 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.486608    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"]
Jul 06 19:36:53.582254 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582215    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbc5cf3-78f5-4176-8515-f159a7f9454f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582279    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j445b\" (UniqueName: \"kubernetes.io/projected/dbbc5cf3-78f5-4176-8515-f159a7f9454f-kube-api-access-j445b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582308    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582326    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582364    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582822 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582799    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582928 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582822    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.582928 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.582852    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.584583 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.584566    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbc5cf3-78f5-4176-8515-f159a7f9454f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.584843 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.584825    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbc5cf3-78f5-4176-8515-f159a7f9454f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.592242 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.592223    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j445b\" (UniqueName: \"kubernetes.io/projected/dbbc5cf3-78f5-4176-8515-f159a7f9454f-kube-api-access-j445b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pmwtc\" (UID: \"dbbc5cf3-78f5-4176-8515-f159a7f9454f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.788770 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.788687    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:36:53.924579 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:53.924554    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"]
Jul 06 19:36:53.926479 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:36:53.926448    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbc5cf3_78f5_4176_8515_f159a7f9454f.slice/crio-8b96e0948e04c86d8da45fc216f9e2ff4f042f3f032d467066dc52b613ab0711 WatchSource:0}: Error finding container 8b96e0948e04c86d8da45fc216f9e2ff4f042f3f032d467066dc52b613ab0711: Status 404 returned error can't find the container with id 8b96e0948e04c86d8da45fc216f9e2ff4f042f3f032d467066dc52b613ab0711
Jul 06 19:36:54.455892 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:54.455851    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc" event={"ID":"dbbc5cf3-78f5-4176-8515-f159a7f9454f","Type":"ContainerStarted","Data":"eb0dfbeeeaea71b483e8c1f82e0745d40aff7edaaa127d8db96e57c6aa74b23a"}
Jul 06 19:36:54.456080 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:54.455909    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc" event={"ID":"dbbc5cf3-78f5-4176-8515-f159a7f9454f","Type":"ContainerStarted","Data":"8b96e0948e04c86d8da45fc216f9e2ff4f042f3f032d467066dc52b613ab0711"}
Jul 06 19:36:54.482210 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:36:54.482163    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc" podStartSLOduration=1.302725894 podStartE2EDuration="1.482146854s" totalImagesPullingTime="179.42096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:54.481078385 +0000 UTC m=+653.408116305" watchObservedRunningTime="2026-07-06 19:36:54.482146854 +0000 UTC m=+653.409184771"
Jul 06 19:37:03.789566 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:03.789524    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:37:03.789985 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:03.789587    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:37:03.801717 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:03.801692    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:37:04.513105 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:04.513075    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pmwtc"
Jul 06 19:37:13.777442 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.777400    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"]
Jul 06 19:37:13.781504 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.781487    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.784720 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.784693    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 19:37:13.795262 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.795239    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"]
Jul 06 19:37:13.868495 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.868450    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z82xj\" (UniqueName: \"kubernetes.io/projected/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-kube-api-access-z82xj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.868682 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.868583    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.868682 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.868610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.868682 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.868647    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.868844 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.868692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.868844 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.868749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.969670 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.969639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.969850 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.969698    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z82xj\" (UniqueName: \"kubernetes.io/projected/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-kube-api-access-z82xj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.969850 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.969752    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.969850 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.969768    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.969850 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.969783    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.969850 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.969801    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.970174 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.970147    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.970238 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.970177    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.970286 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.970249    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.972266 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.972239    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.972390 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.972370    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:13.981659 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:13.981639    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z82xj\" (UniqueName: \"kubernetes.io/projected/9f87cfd3-5ae4-471b-a2f8-7984868ad01c-kube-api-access-z82xj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w4rx7\" (UID: \"9f87cfd3-5ae4-471b-a2f8-7984868ad01c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:14.092186 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:14.092091    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:14.234469 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:14.234446    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"]
Jul 06 19:37:14.237233 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:37:14.237206    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f87cfd3_5ae4_471b_a2f8_7984868ad01c.slice/crio-1481aad4cf5cc0255af862bd09833cb5ab18ad5822af773e8493313cb62644de WatchSource:0}: Error finding container 1481aad4cf5cc0255af862bd09833cb5ab18ad5822af773e8493313cb62644de: Status 404 returned error can't find the container with id 1481aad4cf5cc0255af862bd09833cb5ab18ad5822af773e8493313cb62644de
Jul 06 19:37:14.549602 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:14.549568    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7" event={"ID":"9f87cfd3-5ae4-471b-a2f8-7984868ad01c","Type":"ContainerStarted","Data":"1b32ae9057034e259b48788e02cf6a82f2785a376760fecf12585aca51a7ecc6"}
Jul 06 19:37:14.549793 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:14.549629    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7" event={"ID":"9f87cfd3-5ae4-471b-a2f8-7984868ad01c","Type":"ContainerStarted","Data":"1481aad4cf5cc0255af862bd09833cb5ab18ad5822af773e8493313cb62644de"}
Jul 06 19:37:14.575082 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:14.575030    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7" podStartSLOduration=1.387766501 podStartE2EDuration="1.575014928s" totalImagesPullingTime="187.248427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:14.572641271 +0000 UTC m=+673.499679215" watchObservedRunningTime="2026-07-06 19:37:14.575014928 +0000 UTC m=+673.502052847"
Jul 06 19:37:24.093195 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:24.093160    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:24.093643 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:24.093222    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:24.105501 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:24.105471    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:37:24.605854 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:37:24.605827    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w4rx7"
Jul 06 19:40:09.099037 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:09.098994    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:40:13.396326 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:13.396288    2552 generic.go:356] "Generic (PLEG): container finished" podID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerID="707aa37180868f81d91c564f89da4d05de6eaeea26810e7ab3722be493431c92" exitCode=1
Jul 06 19:40:13.396742 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:13.396364    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c455986-756xq" event={"ID":"5f2e6839-4197-4412-a76c-8a13c22aa4b5","Type":"ContainerDied","Data":"707aa37180868f81d91c564f89da4d05de6eaeea26810e7ab3722be493431c92"}
Jul 06 19:40:13.396742 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:13.396731    2552 scope.go:117] "RemoveContainer" containerID="707aa37180868f81d91c564f89da4d05de6eaeea26810e7ab3722be493431c92"
Jul 06 19:40:14.402848 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:14.402819    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c455986-756xq" event={"ID":"5f2e6839-4197-4412-a76c-8a13c22aa4b5","Type":"ContainerStarted","Data":"f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54"}
Jul 06 19:40:14.403247 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:14.403082    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:40:18.226713 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:40:18.226663    2552 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-140-61.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:40:26.410648 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:26.410592    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:40:36.409819 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:36.409768    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:40:43.087325 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:40:43.087280    2552 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-140-61.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:40:46.410228 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:46.410186    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:40:53.087562 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:40:53.087481    2552 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-140-61.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:40:56.410983 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:40:56.410918    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:01.581012 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:01.580985    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:41:01.581652 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:01.581630    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:41:03.087989 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:41:03.087914    2552 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-140-61.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:06.410426 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:06.410389    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:15.558723 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:15.558691    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:41:26.409879 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:26.409830    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:29.752096 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:29.752065    2552 generic.go:356] "Generic (PLEG): container finished" podID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerID="f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54" exitCode=1
Jul 06 19:41:29.752550 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:29.752139    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c455986-756xq" event={"ID":"5f2e6839-4197-4412-a76c-8a13c22aa4b5","Type":"ContainerDied","Data":"f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54"}
Jul 06 19:41:29.752550 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:29.752216    2552 scope.go:117] "RemoveContainer" containerID="707aa37180868f81d91c564f89da4d05de6eaeea26810e7ab3722be493431c92"
Jul 06 19:41:29.752683 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:29.752564    2552 scope.go:117] "RemoveContainer" containerID="f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54"
Jul 06 19:41:29.752778 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:41:29.752759    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-7f4c455986-756xq_opendatahub(5f2e6839-4197-4412-a76c-8a13c22aa4b5)\"" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5"
Jul 06 19:41:30.759508 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:30.759480    2552 generic.go:356] "Generic (PLEG): container finished" podID="13f09753-357e-4368-a2a7-6410dc44c757" containerID="eab7e48c295c13e23681626360a16032a26e8ce52599d8033895a6412d7f6c8c" exitCode=1
Jul 06 19:41:30.759841 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:30.759529    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h" event={"ID":"13f09753-357e-4368-a2a7-6410dc44c757","Type":"ContainerDied","Data":"eab7e48c295c13e23681626360a16032a26e8ce52599d8033895a6412d7f6c8c"}
Jul 06 19:41:30.759884 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:30.759842    2552 scope.go:117] "RemoveContainer" containerID="eab7e48c295c13e23681626360a16032a26e8ce52599d8033895a6412d7f6c8c"
Jul 06 19:41:31.765688 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:31.765652    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h" event={"ID":"13f09753-357e-4368-a2a7-6410dc44c757","Type":"ContainerStarted","Data":"50a46b5426d759cf8fc09bc6a578c3eafda5610e3ca8c45e6586df479bd22b58"}
Jul 06 19:41:31.766179 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:31.765867    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:41:34.511631 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:34.511600    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:41:34.512097 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:34.511890    2552 scope.go:117] "RemoveContainer" containerID="f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54"
Jul 06 19:41:34.512097 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:41:34.512076    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-7f4c455986-756xq_opendatahub(5f2e6839-4197-4412-a76c-8a13c22aa4b5)\"" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5"
Jul 06 19:41:35.409443 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:35.409414    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:41:35.409734 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:35.409721    2552 scope.go:117] "RemoveContainer" containerID="f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54"
Jul 06 19:41:35.409920 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:41:35.409903    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-7f4c455986-756xq_opendatahub(5f2e6839-4197-4412-a76c-8a13c22aa4b5)\"" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5"
Jul 06 19:41:42.772888 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:42.772854    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-gzq9h"
Jul 06 19:41:48.701395 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:48.701362    2552 scope.go:117] "RemoveContainer" containerID="f89e0de2339d77594f50e861b19c33cec814827abf7e5eb1754f45aef2decf54"
Jul 06 19:41:48.701841 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:48.701743    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:41:49.845770 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:49.845736    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4c455986-756xq" event={"ID":"5f2e6839-4197-4412-a76c-8a13c22aa4b5","Type":"ContainerStarted","Data":"1e7d762a73c8e87dee665871d4b03bed960818f5e7be34c8a2d4ce3097c8d9b6"}
Jul 06 19:41:49.846157 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:41:49.845953    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:42:01.850601 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:42:01.850557    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:42:10.931462 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:42:10.931436    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4c455986-756xq"
Jul 06 19:46:01.613039 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:46:01.613003    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:46:01.615702 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:46:01.615669    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:51:01.643297 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:51:01.643270    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:51:01.645779 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:51:01.645755    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:54:34.316186 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.316154    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"]
Jul 06 19:54:34.319611 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.319591    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.322585 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.322561    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-5d383ecf-serving-cert\""
Jul 06 19:54:34.334103 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.334075    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"]
Jul 06 19:54:34.437222 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.437189    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716610f3-c37e-4d74-ac3a-4eacb51a29ab-openshift-service-ca\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.437413 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.437235    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716610f3-c37e-4d74-ac3a-4eacb51a29ab-maas-api-tls\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.437413 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.437383    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grvx\" (UniqueName: \"kubernetes.io/projected/716610f3-c37e-4d74-ac3a-4eacb51a29ab-kube-api-access-8grvx\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.538860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.538818    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716610f3-c37e-4d74-ac3a-4eacb51a29ab-openshift-service-ca\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.538860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.538860    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716610f3-c37e-4d74-ac3a-4eacb51a29ab-maas-api-tls\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.539154 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.538920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grvx\" (UniqueName: \"kubernetes.io/projected/716610f3-c37e-4d74-ac3a-4eacb51a29ab-kube-api-access-8grvx\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.539497 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.539473    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716610f3-c37e-4d74-ac3a-4eacb51a29ab-openshift-service-ca\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.541462 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.541439    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716610f3-c37e-4d74-ac3a-4eacb51a29ab-maas-api-tls\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.547873 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.547852    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grvx\" (UniqueName: \"kubernetes.io/projected/716610f3-c37e-4d74-ac3a-4eacb51a29ab-kube-api-access-8grvx\") pod \"maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") " pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.632399 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.632314    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:34.780355 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.780329    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"]
Jul 06 19:54:34.782324 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:54:34.782296    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716610f3_c37e_4d74_ac3a_4eacb51a29ab.slice/crio-fc2c5a9a994facfecb84c50db6ffb3b61b36bca7b8c57ed18eaec38df797c6d7 WatchSource:0}: Error finding container fc2c5a9a994facfecb84c50db6ffb3b61b36bca7b8c57ed18eaec38df797c6d7: Status 404 returned error can't find the container with id fc2c5a9a994facfecb84c50db6ffb3b61b36bca7b8c57ed18eaec38df797c6d7
Jul 06 19:54:34.783753 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:34.783733    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:54:35.363873 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:35.363837    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2" event={"ID":"716610f3-c37e-4d74-ac3a-4eacb51a29ab","Type":"ContainerStarted","Data":"acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26"}
Jul 06 19:54:35.364259 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:35.363893    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2" event={"ID":"716610f3-c37e-4d74-ac3a-4eacb51a29ab","Type":"ContainerStarted","Data":"fc2c5a9a994facfecb84c50db6ffb3b61b36bca7b8c57ed18eaec38df797c6d7"}
Jul 06 19:54:35.364259 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:35.363924    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:35.385116 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:35.385062    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2" podStartSLOduration=0.92829991 podStartE2EDuration="1.385046816s" totalImagesPullingTime="456.746906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:35.383223481 +0000 UTC m=+1714.310261399" watchObservedRunningTime="2026-07-06 19:54:35.385046816 +0000 UTC m=+1714.312084733"
Jul 06 19:54:39.580548 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.580517    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"]
Jul 06 19:54:39.581047 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.580727    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2" podUID="716610f3-c37e-4d74-ac3a-4eacb51a29ab" containerName="maas-api" containerID="cri-o://acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26" gracePeriod=30
Jul 06 19:54:39.836472 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.836417    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:39.989708 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.989670    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716610f3-c37e-4d74-ac3a-4eacb51a29ab-maas-api-tls\") pod \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") "
Jul 06 19:54:39.989859 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.989736    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716610f3-c37e-4d74-ac3a-4eacb51a29ab-openshift-service-ca\") pod \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") "
Jul 06 19:54:39.989908 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.989856    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8grvx\" (UniqueName: \"kubernetes.io/projected/716610f3-c37e-4d74-ac3a-4eacb51a29ab-kube-api-access-8grvx\") pod \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\" (UID: \"716610f3-c37e-4d74-ac3a-4eacb51a29ab\") "
Jul 06 19:54:39.990134 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.990110    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716610f3-c37e-4d74-ac3a-4eacb51a29ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "716610f3-c37e-4d74-ac3a-4eacb51a29ab" (UID: "716610f3-c37e-4d74-ac3a-4eacb51a29ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:39.990278 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.990264    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/716610f3-c37e-4d74-ac3a-4eacb51a29ab-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:54:39.991898 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.991869    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716610f3-c37e-4d74-ac3a-4eacb51a29ab-kube-api-access-8grvx" (OuterVolumeSpecName: "kube-api-access-8grvx") pod "716610f3-c37e-4d74-ac3a-4eacb51a29ab" (UID: "716610f3-c37e-4d74-ac3a-4eacb51a29ab"). InnerVolumeSpecName "kube-api-access-8grvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:39.992027 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:39.991876    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716610f3-c37e-4d74-ac3a-4eacb51a29ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "716610f3-c37e-4d74-ac3a-4eacb51a29ab" (UID: "716610f3-c37e-4d74-ac3a-4eacb51a29ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:54:40.091052 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.090971    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8grvx\" (UniqueName: \"kubernetes.io/projected/716610f3-c37e-4d74-ac3a-4eacb51a29ab-kube-api-access-8grvx\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:54:40.091052 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.091001    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/716610f3-c37e-4d74-ac3a-4eacb51a29ab-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:54:40.389860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.389758    2552 generic.go:356] "Generic (PLEG): container finished" podID="716610f3-c37e-4d74-ac3a-4eacb51a29ab" containerID="acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26" exitCode=0
Jul 06 19:54:40.389860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.389797    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2" event={"ID":"716610f3-c37e-4d74-ac3a-4eacb51a29ab","Type":"ContainerDied","Data":"acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26"}
Jul 06 19:54:40.389860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.389823    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"
Jul 06 19:54:40.389860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.389857    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2" event={"ID":"716610f3-c37e-4d74-ac3a-4eacb51a29ab","Type":"ContainerDied","Data":"fc2c5a9a994facfecb84c50db6ffb3b61b36bca7b8c57ed18eaec38df797c6d7"}
Jul 06 19:54:40.390182 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.389883    2552 scope.go:117] "RemoveContainer" containerID="acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26"
Jul 06 19:54:40.398974 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.398953    2552 scope.go:117] "RemoveContainer" containerID="acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26"
Jul 06 19:54:40.399257 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:54:40.399237    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26\": container with ID starting with acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26 not found: ID does not exist" containerID="acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26"
Jul 06 19:54:40.399309 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.399266    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26"} err="failed to get container status \"acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26\": rpc error: code = NotFound desc = could not find container \"acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26\": container with ID starting with acce03ecb0cd962ac000502cdefa6726d835de758998d8ca99d5d50c61203d26 not found: ID does not exist"
Jul 06 19:54:40.412233 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.412210    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"]
Jul 06 19:54:40.418282 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:40.418262    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-5d383ecf-86848f6f9-7l5g2"]
Jul 06 19:54:41.707170 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:41.707137    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716610f3-c37e-4d74-ac3a-4eacb51a29ab" path="/var/lib/kubelet/pods/716610f3-c37e-4d74-ac3a-4eacb51a29ab/volumes"
Jul 06 19:54:46.871823 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.871792    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"]
Jul 06 19:54:46.872225 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.872198    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716610f3-c37e-4d74-ac3a-4eacb51a29ab" containerName="maas-api"
Jul 06 19:54:46.872225 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.872209    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="716610f3-c37e-4d74-ac3a-4eacb51a29ab" containerName="maas-api"
Jul 06 19:54:46.872304 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.872266    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="716610f3-c37e-4d74-ac3a-4eacb51a29ab" containerName="maas-api"
Jul 06 19:54:46.876696 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.876676    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:46.879373 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.879349    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-86bf468a-serving-cert\""
Jul 06 19:54:46.887865 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.887839    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"]
Jul 06 19:54:46.953647 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.953618    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:46.953764 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.953657    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-openshift-service-ca\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:46.953764 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:46.953704    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhtbz\" (UniqueName: \"kubernetes.io/projected/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-kube-api-access-jhtbz\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.054698 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.054660    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhtbz\" (UniqueName: \"kubernetes.io/projected/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-kube-api-access-jhtbz\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.054877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.054755    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.054877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.054803    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-openshift-service-ca\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.055031 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:54:47.054896    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-86bf468a-serving-cert: secret "maas-api-e2e-ait-86bf468a-serving-cert" not found
Jul 06 19:54:47.055031 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:54:47.054970    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls podName:db0737d2-eb0a-41ff-b7e5-5953fc9c799e nodeName:}" failed. No retries permitted until 2026-07-06 19:54:47.55495445 +0000 UTC m=+1726.481992346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls") pod "maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" (UID: "db0737d2-eb0a-41ff-b7e5-5953fc9c799e") : secret "maas-api-e2e-ait-86bf468a-serving-cert" not found
Jul 06 19:54:47.055486 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.055462    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-openshift-service-ca\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.074042 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.074013    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhtbz\" (UniqueName: \"kubernetes.io/projected/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-kube-api-access-jhtbz\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.559057 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.559021    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.561509 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.561483    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls\") pod \"maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") " pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.786719 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.786677    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:47.927947 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:47.927909    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"]
Jul 06 19:54:47.929985 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:54:47.929952    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0737d2_eb0a_41ff_b7e5_5953fc9c799e.slice/crio-f80cec019fc9ec8249babb8c06c2505f71aa71d8278a54adb8b1f3650e78a7fe WatchSource:0}: Error finding container f80cec019fc9ec8249babb8c06c2505f71aa71d8278a54adb8b1f3650e78a7fe: Status 404 returned error can't find the container with id f80cec019fc9ec8249babb8c06c2505f71aa71d8278a54adb8b1f3650e78a7fe
Jul 06 19:54:48.430831 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:48.430799    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" event={"ID":"db0737d2-eb0a-41ff-b7e5-5953fc9c799e","Type":"ContainerStarted","Data":"b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56"}
Jul 06 19:54:48.431008 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:48.430852    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" event={"ID":"db0737d2-eb0a-41ff-b7e5-5953fc9c799e","Type":"ContainerStarted","Data":"f80cec019fc9ec8249babb8c06c2505f71aa71d8278a54adb8b1f3650e78a7fe"}
Jul 06 19:54:48.431008 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:48.430882    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:48.456199 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:48.456150    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" podStartSLOduration=2.1075260670000002 podStartE2EDuration="2.456132759s" totalImagesPullingTime="348.606692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:48.455757487 +0000 UTC m=+1727.382795619" watchObservedRunningTime="2026-07-06 19:54:48.456132759 +0000 UTC m=+1727.383170678"
Jul 06 19:54:52.211999 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.211966    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"]
Jul 06 19:54:52.212430 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.212165    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" podUID="db0737d2-eb0a-41ff-b7e5-5953fc9c799e" containerName="maas-api" containerID="cri-o://b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56" gracePeriod=30
Jul 06 19:54:52.452898 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.452873    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:52.453394 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.453373    2552 generic.go:356] "Generic (PLEG): container finished" podID="db0737d2-eb0a-41ff-b7e5-5953fc9c799e" containerID="b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56" exitCode=0
Jul 06 19:54:52.453489 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.453443    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" event={"ID":"db0737d2-eb0a-41ff-b7e5-5953fc9c799e","Type":"ContainerDied","Data":"b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56"}
Jul 06 19:54:52.453527 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.453495    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj" event={"ID":"db0737d2-eb0a-41ff-b7e5-5953fc9c799e","Type":"ContainerDied","Data":"f80cec019fc9ec8249babb8c06c2505f71aa71d8278a54adb8b1f3650e78a7fe"}
Jul 06 19:54:52.453527 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.453516    2552 scope.go:117] "RemoveContainer" containerID="b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56"
Jul 06 19:54:52.461701 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.461684    2552 scope.go:117] "RemoveContainer" containerID="b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56"
Jul 06 19:54:52.461971 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:54:52.461952    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56\": container with ID starting with b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56 not found: ID does not exist" containerID="b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56"
Jul 06 19:54:52.462054 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.461979    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56"} err="failed to get container status \"b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56\": rpc error: code = NotFound desc = could not find container \"b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56\": container with ID starting with b86ef3cc1f697c9d189ab3ce6a670b946ba8f10f19af0b6ef10681981d020c56 not found: ID does not exist"
Jul 06 19:54:52.501703 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.501670    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-openshift-service-ca\") pod \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") "
Jul 06 19:54:52.501863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.501757    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls\") pod \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") "
Jul 06 19:54:52.501863 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.501827    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhtbz\" (UniqueName: \"kubernetes.io/projected/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-kube-api-access-jhtbz\") pod \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\" (UID: \"db0737d2-eb0a-41ff-b7e5-5953fc9c799e\") "
Jul 06 19:54:52.502036 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.502015    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db0737d2-eb0a-41ff-b7e5-5953fc9c799e" (UID: "db0737d2-eb0a-41ff-b7e5-5953fc9c799e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:52.502162 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.502146    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:54:52.504034 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.504006    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db0737d2-eb0a-41ff-b7e5-5953fc9c799e" (UID: "db0737d2-eb0a-41ff-b7e5-5953fc9c799e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:54:52.504130 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.504033    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-kube-api-access-jhtbz" (OuterVolumeSpecName: "kube-api-access-jhtbz") pod "db0737d2-eb0a-41ff-b7e5-5953fc9c799e" (UID: "db0737d2-eb0a-41ff-b7e5-5953fc9c799e"). InnerVolumeSpecName "kube-api-access-jhtbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:52.602797 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.602770    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:54:52.602797 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:52.602791    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhtbz\" (UniqueName: \"kubernetes.io/projected/db0737d2-eb0a-41ff-b7e5-5953fc9c799e-kube-api-access-jhtbz\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:54:53.459163 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:53.459133    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"
Jul 06 19:54:53.485035 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:53.485009    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"]
Jul 06 19:54:53.492027 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:53.492006    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-86bf468a-679f96dc5f-7kgmj"]
Jul 06 19:54:53.706949 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:54:53.706910    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db0737d2-eb0a-41ff-b7e5-5953fc9c799e" path="/var/lib/kubelet/pods/db0737d2-eb0a-41ff-b7e5-5953fc9c799e/volumes"
Jul 06 19:55:06.854880 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.854843    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"]
Jul 06 19:55:06.855316 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.855242    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0737d2-eb0a-41ff-b7e5-5953fc9c799e" containerName="maas-api"
Jul 06 19:55:06.855316 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.855252    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0737d2-eb0a-41ff-b7e5-5953fc9c799e" containerName="maas-api"
Jul 06 19:55:06.855384 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.855337    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="db0737d2-eb0a-41ff-b7e5-5953fc9c799e" containerName="maas-api"
Jul 06 19:55:06.859831 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.859809    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:06.863766 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.863739    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-e3f6a090-serving-cert\""
Jul 06 19:55:06.880147 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.880116    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"]
Jul 06 19:55:06.933644 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.933615    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcb9z\" (UniqueName: \"kubernetes.io/projected/10f20b65-8d8d-4ce6-85dd-d10989f1654b-kube-api-access-bcb9z\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:06.933820 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.933681    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:06.933820 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:06.933701    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f20b65-8d8d-4ce6-85dd-d10989f1654b-openshift-service-ca\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.035198 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.035159    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcb9z\" (UniqueName: \"kubernetes.io/projected/10f20b65-8d8d-4ce6-85dd-d10989f1654b-kube-api-access-bcb9z\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.035385 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.035242    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.035385 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.035273    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f20b65-8d8d-4ce6-85dd-d10989f1654b-openshift-service-ca\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.035504 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:55:07.035451    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-e3f6a090-serving-cert: secret "maas-api-e2e-derive-e3f6a090-serving-cert" not found
Jul 06 19:55:07.035555 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:55:07.035534    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls podName:10f20b65-8d8d-4ce6-85dd-d10989f1654b nodeName:}" failed. No retries permitted until 2026-07-06 19:55:07.535511256 +0000 UTC m=+1746.462549169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls") pod "maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" (UID: "10f20b65-8d8d-4ce6-85dd-d10989f1654b") : secret "maas-api-e2e-derive-e3f6a090-serving-cert" not found
Jul 06 19:55:07.035970 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.035917    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f20b65-8d8d-4ce6-85dd-d10989f1654b-openshift-service-ca\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.057817 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.057784    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcb9z\" (UniqueName: \"kubernetes.io/projected/10f20b65-8d8d-4ce6-85dd-d10989f1654b-kube-api-access-bcb9z\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.541237 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.541206    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.543793 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.543770    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls\") pod \"maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") " pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.770206 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.770174    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:07.927066 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:07.927039    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"]
Jul 06 19:55:07.928126 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:55:07.928099    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f20b65_8d8d_4ce6_85dd_d10989f1654b.slice/crio-eb9e87849aaf8e0f3bdc742407e0517b1c602dd9ab39bd31612c12f4bfe3336e WatchSource:0}: Error finding container eb9e87849aaf8e0f3bdc742407e0517b1c602dd9ab39bd31612c12f4bfe3336e: Status 404 returned error can't find the container with id eb9e87849aaf8e0f3bdc742407e0517b1c602dd9ab39bd31612c12f4bfe3336e
Jul 06 19:55:08.531604 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:08.531569    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" event={"ID":"10f20b65-8d8d-4ce6-85dd-d10989f1654b","Type":"ContainerStarted","Data":"d41343ed4d022e14d540588738e464822be028d9762e289d2e4f5b8116387fd1"}
Jul 06 19:55:08.531773 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:08.531619    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" event={"ID":"10f20b65-8d8d-4ce6-85dd-d10989f1654b","Type":"ContainerStarted","Data":"eb9e87849aaf8e0f3bdc742407e0517b1c602dd9ab39bd31612c12f4bfe3336e"}
Jul 06 19:55:08.531773 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:08.531651    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:08.565409 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:08.565358    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" podStartSLOduration=2.134444011 podStartE2EDuration="2.565342721s" totalImagesPullingTime="430.89871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:08.564018071 +0000 UTC m=+1747.491055989" watchObservedRunningTime="2026-07-06 19:55:08.565342721 +0000 UTC m=+1747.492380638"
Jul 06 19:55:11.415483 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.415453    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"]
Jul 06 19:55:11.415877 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.415635    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" podUID="10f20b65-8d8d-4ce6-85dd-d10989f1654b" containerName="maas-api" containerID="cri-o://d41343ed4d022e14d540588738e464822be028d9762e289d2e4f5b8116387fd1" gracePeriod=30
Jul 06 19:55:11.550842 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.550813    2552 generic.go:356] "Generic (PLEG): container finished" podID="10f20b65-8d8d-4ce6-85dd-d10989f1654b" containerID="d41343ed4d022e14d540588738e464822be028d9762e289d2e4f5b8116387fd1" exitCode=0
Jul 06 19:55:11.551019 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.550905    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" event={"ID":"10f20b65-8d8d-4ce6-85dd-d10989f1654b","Type":"ContainerDied","Data":"d41343ed4d022e14d540588738e464822be028d9762e289d2e4f5b8116387fd1"}
Jul 06 19:55:11.667403 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.667343    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:11.782116 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.782075    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f20b65-8d8d-4ce6-85dd-d10989f1654b-openshift-service-ca\") pod \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") "
Jul 06 19:55:11.782263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.782196    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls\") pod \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") "
Jul 06 19:55:11.782263 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.782252    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcb9z\" (UniqueName: \"kubernetes.io/projected/10f20b65-8d8d-4ce6-85dd-d10989f1654b-kube-api-access-bcb9z\") pod \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\" (UID: \"10f20b65-8d8d-4ce6-85dd-d10989f1654b\") "
Jul 06 19:55:11.782469 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.782440    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10f20b65-8d8d-4ce6-85dd-d10989f1654b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10f20b65-8d8d-4ce6-85dd-d10989f1654b" (UID: "10f20b65-8d8d-4ce6-85dd-d10989f1654b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:11.782547 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.782533    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f20b65-8d8d-4ce6-85dd-d10989f1654b-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:55:11.784286 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.784264    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f20b65-8d8d-4ce6-85dd-d10989f1654b-kube-api-access-bcb9z" (OuterVolumeSpecName: "kube-api-access-bcb9z") pod "10f20b65-8d8d-4ce6-85dd-d10989f1654b" (UID: "10f20b65-8d8d-4ce6-85dd-d10989f1654b"). InnerVolumeSpecName "kube-api-access-bcb9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:11.784338 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.784284    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10f20b65-8d8d-4ce6-85dd-d10989f1654b" (UID: "10f20b65-8d8d-4ce6-85dd-d10989f1654b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:55:11.882929 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.882901    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcb9z\" (UniqueName: \"kubernetes.io/projected/10f20b65-8d8d-4ce6-85dd-d10989f1654b-kube-api-access-bcb9z\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:55:11.882929 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:11.882924    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10f20b65-8d8d-4ce6-85dd-d10989f1654b-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:55:12.557725 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:12.557686    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2" event={"ID":"10f20b65-8d8d-4ce6-85dd-d10989f1654b","Type":"ContainerDied","Data":"eb9e87849aaf8e0f3bdc742407e0517b1c602dd9ab39bd31612c12f4bfe3336e"}
Jul 06 19:55:12.558183 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:12.557734    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"
Jul 06 19:55:12.558183 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:12.557753    2552 scope.go:117] "RemoveContainer" containerID="d41343ed4d022e14d540588738e464822be028d9762e289d2e4f5b8116387fd1"
Jul 06 19:55:12.585133 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:12.585108    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"]
Jul 06 19:55:12.589288 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:12.589268    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-e3f6a090-57cc7895b5-wdfn2"]
Jul 06 19:55:13.706452 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:55:13.706423    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f20b65-8d8d-4ce6-85dd-d10989f1654b" path="/var/lib/kubelet/pods/10f20b65-8d8d-4ce6-85dd-d10989f1654b/volumes"
Jul 06 19:56:01.673007 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:01.672980    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:56:01.674817 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:01.674796    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 19:56:58.787738 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.787703    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"]
Jul 06 19:56:58.788327 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.788310    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f20b65-8d8d-4ce6-85dd-d10989f1654b" containerName="maas-api"
Jul 06 19:56:58.788375 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.788331    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f20b65-8d8d-4ce6-85dd-d10989f1654b" containerName="maas-api"
Jul 06 19:56:58.788456 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.788445    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f20b65-8d8d-4ce6-85dd-d10989f1654b" containerName="maas-api"
Jul 06 19:56:58.791978 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.791959    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:58.795389 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.795361    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-4e857e76-serving-cert\""
Jul 06 19:56:58.811860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.811828    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"]
Jul 06 19:56:58.912050 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.912001    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47b4n\" (UniqueName: \"kubernetes.io/projected/77943d54-e2c3-42f1-8272-ce79755cda38-kube-api-access-47b4n\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:58.912246 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.912066    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77943d54-e2c3-42f1-8272-ce79755cda38-openshift-service-ca\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:58.912246 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:58.912177    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77943d54-e2c3-42f1-8272-ce79755cda38-maas-api-tls\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.012876 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.012842    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47b4n\" (UniqueName: \"kubernetes.io/projected/77943d54-e2c3-42f1-8272-ce79755cda38-kube-api-access-47b4n\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.013089 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.012889    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77943d54-e2c3-42f1-8272-ce79755cda38-openshift-service-ca\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.013089 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.012922    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77943d54-e2c3-42f1-8272-ce79755cda38-maas-api-tls\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.013622 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.013600    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77943d54-e2c3-42f1-8272-ce79755cda38-openshift-service-ca\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.015519 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.015497    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77943d54-e2c3-42f1-8272-ce79755cda38-maas-api-tls\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.026006 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.025974    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47b4n\" (UniqueName: \"kubernetes.io/projected/77943d54-e2c3-42f1-8272-ce79755cda38-kube-api-access-47b4n\") pod \"maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") " pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.102921 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.102831    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:56:59.252532 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:56:59.252506    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"]
Jul 06 19:56:59.255012 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:56:59.254983    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77943d54_e2c3_42f1_8272_ce79755cda38.slice/crio-b925a92093aaaece3231f87fc85efbcb78b8a4ea3a732ee2f06474479c125c73 WatchSource:0}: Error finding container b925a92093aaaece3231f87fc85efbcb78b8a4ea3a732ee2f06474479c125c73: Status 404 returned error can't find the container with id b925a92093aaaece3231f87fc85efbcb78b8a4ea3a732ee2f06474479c125c73
Jul 06 19:57:00.046760 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:00.046728    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp" event={"ID":"77943d54-e2c3-42f1-8272-ce79755cda38","Type":"ContainerStarted","Data":"b925a92093aaaece3231f87fc85efbcb78b8a4ea3a732ee2f06474479c125c73"}
Jul 06 19:57:01.053542 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:01.053503    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp" event={"ID":"77943d54-e2c3-42f1-8272-ce79755cda38","Type":"ContainerStarted","Data":"eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0"}
Jul 06 19:57:01.053924 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:01.053584    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:57:01.076605 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:01.076551    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp" podStartSLOduration=2.308915548 podStartE2EDuration="3.07653318s" totalImagesPullingTime="767.617632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:01.075119792 +0000 UTC m=+1860.002157710" watchObservedRunningTime="2026-07-06 19:57:01.07653318 +0000 UTC m=+1860.003571097"
Jul 06 19:57:07.063890 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:07.063862    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:57:11.397233 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.397164    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"]
Jul 06 19:57:11.397692 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.397460    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp" podUID="77943d54-e2c3-42f1-8272-ce79755cda38" containerName="maas-api" containerID="cri-o://eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0" gracePeriod=30
Jul 06 19:57:11.650477 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.650398    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:57:11.720897 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.720865    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77943d54-e2c3-42f1-8272-ce79755cda38-maas-api-tls\") pod \"77943d54-e2c3-42f1-8272-ce79755cda38\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") "
Jul 06 19:57:11.720897 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.720910    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77943d54-e2c3-42f1-8272-ce79755cda38-openshift-service-ca\") pod \"77943d54-e2c3-42f1-8272-ce79755cda38\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") "
Jul 06 19:57:11.721190 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.720955    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47b4n\" (UniqueName: \"kubernetes.io/projected/77943d54-e2c3-42f1-8272-ce79755cda38-kube-api-access-47b4n\") pod \"77943d54-e2c3-42f1-8272-ce79755cda38\" (UID: \"77943d54-e2c3-42f1-8272-ce79755cda38\") "
Jul 06 19:57:11.721374 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.721347    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77943d54-e2c3-42f1-8272-ce79755cda38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77943d54-e2c3-42f1-8272-ce79755cda38" (UID: "77943d54-e2c3-42f1-8272-ce79755cda38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:11.723217 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.723186    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77943d54-e2c3-42f1-8272-ce79755cda38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77943d54-e2c3-42f1-8272-ce79755cda38" (UID: "77943d54-e2c3-42f1-8272-ce79755cda38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:57:11.723320 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.723211    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77943d54-e2c3-42f1-8272-ce79755cda38-kube-api-access-47b4n" (OuterVolumeSpecName: "kube-api-access-47b4n") pod "77943d54-e2c3-42f1-8272-ce79755cda38" (UID: "77943d54-e2c3-42f1-8272-ce79755cda38"). InnerVolumeSpecName "kube-api-access-47b4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:11.821920 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.821880    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77943d54-e2c3-42f1-8272-ce79755cda38-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:57:11.821920 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.821911    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77943d54-e2c3-42f1-8272-ce79755cda38-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:57:11.821920 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:11.821922    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47b4n\" (UniqueName: \"kubernetes.io/projected/77943d54-e2c3-42f1-8272-ce79755cda38-kube-api-access-47b4n\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:57:12.111349 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.111309    2552 generic.go:356] "Generic (PLEG): container finished" podID="77943d54-e2c3-42f1-8272-ce79755cda38" containerID="eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0" exitCode=0
Jul 06 19:57:12.111533 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.111363    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"
Jul 06 19:57:12.111533 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.111377    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp" event={"ID":"77943d54-e2c3-42f1-8272-ce79755cda38","Type":"ContainerDied","Data":"eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0"}
Jul 06 19:57:12.111533 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.111431    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp" event={"ID":"77943d54-e2c3-42f1-8272-ce79755cda38","Type":"ContainerDied","Data":"b925a92093aaaece3231f87fc85efbcb78b8a4ea3a732ee2f06474479c125c73"}
Jul 06 19:57:12.111533 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.111461    2552 scope.go:117] "RemoveContainer" containerID="eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0"
Jul 06 19:57:12.120972 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.120929    2552 scope.go:117] "RemoveContainer" containerID="eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0"
Jul 06 19:57:12.121266 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:57:12.121245    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0\": container with ID starting with eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0 not found: ID does not exist" containerID="eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0"
Jul 06 19:57:12.121320 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.121275    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0"} err="failed to get container status \"eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0\": rpc error: code = NotFound desc = could not find container \"eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0\": container with ID starting with eb578ec3f9dcf8bb50cee32fa76b95343a53b50476ccdf124d37b8bda894f3d0 not found: ID does not exist"
Jul 06 19:57:12.133605 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.133571    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"]
Jul 06 19:57:12.137888 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:12.137861    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-4e857e76-5997767c5b-qr2qp"]
Jul 06 19:57:13.707033 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:13.706999    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77943d54-e2c3-42f1-8272-ce79755cda38" path="/var/lib/kubelet/pods/77943d54-e2c3-42f1-8272-ce79755cda38/volumes"
Jul 06 19:57:40.951516 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.951483    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"]
Jul 06 19:57:40.952013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.951927    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77943d54-e2c3-42f1-8272-ce79755cda38" containerName="maas-api"
Jul 06 19:57:40.952013 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.951958    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="77943d54-e2c3-42f1-8272-ce79755cda38" containerName="maas-api"
Jul 06 19:57:40.952089 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.952016    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="77943d54-e2c3-42f1-8272-ce79755cda38" containerName="maas-api"
Jul 06 19:57:40.954975 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.954957    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:40.958376 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.958354    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-60bec37b-serving-cert\""
Jul 06 19:57:40.966310 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:40.966285    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"]
Jul 06 19:57:41.094122 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.094067    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rkr\" (UniqueName: \"kubernetes.io/projected/cc051de6-0b0e-4c84-9db0-f570a8f9368f-kube-api-access-n8rkr\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.094300 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.094160    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.094300 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.094210    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc051de6-0b0e-4c84-9db0-f570a8f9368f-openshift-service-ca\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.194864 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.194822    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc051de6-0b0e-4c84-9db0-f570a8f9368f-openshift-service-ca\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.195054 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.194912    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rkr\" (UniqueName: \"kubernetes.io/projected/cc051de6-0b0e-4c84-9db0-f570a8f9368f-kube-api-access-n8rkr\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.195054 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.194988    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.195141 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:57:41.195092    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-60bec37b-serving-cert: secret "maas-api-e2e-mt-60bec37b-serving-cert" not found
Jul 06 19:57:41.195187 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:57:41.195175    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls podName:cc051de6-0b0e-4c84-9db0-f570a8f9368f nodeName:}" failed. No retries permitted until 2026-07-06 19:57:41.695156221 +0000 UTC m=+1900.622194117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls") pod "maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" (UID: "cc051de6-0b0e-4c84-9db0-f570a8f9368f") : secret "maas-api-e2e-mt-60bec37b-serving-cert" not found
Jul 06 19:57:41.195466 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.195447    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc051de6-0b0e-4c84-9db0-f570a8f9368f-openshift-service-ca\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.224457 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.224395    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rkr\" (UniqueName: \"kubernetes.io/projected/cc051de6-0b0e-4c84-9db0-f570a8f9368f-kube-api-access-n8rkr\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.700717 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.700679    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.703494 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.703470    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls\") pod \"maas-api-e2e-mt-60bec37b-564d884b5f-p62kb\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") " pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:41.865493 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:41.865459    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:42.030214 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:42.030185    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"]
Jul 06 19:57:42.033093 ip-10-0-140-61 kubenswrapper[2552]: W0706 19:57:42.033065    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc051de6_0b0e_4c84_9db0_f570a8f9368f.slice/crio-c82feed2879ad118ce6ec43c6c25925fb41f7363b155d8e0a4a87ab62f8105f2 WatchSource:0}: Error finding container c82feed2879ad118ce6ec43c6c25925fb41f7363b155d8e0a4a87ab62f8105f2: Status 404 returned error can't find the container with id c82feed2879ad118ce6ec43c6c25925fb41f7363b155d8e0a4a87ab62f8105f2
Jul 06 19:57:42.254129 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:42.254094    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" event={"ID":"cc051de6-0b0e-4c84-9db0-f570a8f9368f","Type":"ContainerStarted","Data":"c82feed2879ad118ce6ec43c6c25925fb41f7363b155d8e0a4a87ab62f8105f2"}
Jul 06 19:57:43.260652 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:43.260610    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" event={"ID":"cc051de6-0b0e-4c84-9db0-f570a8f9368f","Type":"ContainerStarted","Data":"84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7"}
Jul 06 19:57:43.261036 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:43.260755    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:57:43.282553 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:43.282506    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" podStartSLOduration=2.86799714 podStartE2EDuration="3.282491809s" totalImagesPullingTime="414.494669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:43.280994584 +0000 UTC m=+1902.208032531" watchObservedRunningTime="2026-07-06 19:57:43.282491809 +0000 UTC m=+1902.209529725"
Jul 06 19:57:49.270225 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:57:49.270197    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:58:18.388540 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.388504    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"]
Jul 06 19:58:18.389009 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.388717    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" podUID="cc051de6-0b0e-4c84-9db0-f570a8f9368f" containerName="maas-api" containerID="cri-o://84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7" gracePeriod=30
Jul 06 19:58:18.637793 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.637771    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:58:18.724629 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.724601    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8rkr\" (UniqueName: \"kubernetes.io/projected/cc051de6-0b0e-4c84-9db0-f570a8f9368f-kube-api-access-n8rkr\") pod \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") "
Jul 06 19:58:18.724745 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.724636    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc051de6-0b0e-4c84-9db0-f570a8f9368f-openshift-service-ca\") pod \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") "
Jul 06 19:58:18.724745 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.724739    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls\") pod \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\" (UID: \"cc051de6-0b0e-4c84-9db0-f570a8f9368f\") "
Jul 06 19:58:18.725031 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.725006    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc051de6-0b0e-4c84-9db0-f570a8f9368f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc051de6-0b0e-4c84-9db0-f570a8f9368f" (UID: "cc051de6-0b0e-4c84-9db0-f570a8f9368f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:58:18.726748 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.726729    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc051de6-0b0e-4c84-9db0-f570a8f9368f" (UID: "cc051de6-0b0e-4c84-9db0-f570a8f9368f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:58:18.726860 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.726839    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc051de6-0b0e-4c84-9db0-f570a8f9368f-kube-api-access-n8rkr" (OuterVolumeSpecName: "kube-api-access-n8rkr") pod "cc051de6-0b0e-4c84-9db0-f570a8f9368f" (UID: "cc051de6-0b0e-4c84-9db0-f570a8f9368f"). InnerVolumeSpecName "kube-api-access-n8rkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:18.825388 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.825352    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc051de6-0b0e-4c84-9db0-f570a8f9368f-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:58:18.825388 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.825379    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8rkr\" (UniqueName: \"kubernetes.io/projected/cc051de6-0b0e-4c84-9db0-f570a8f9368f-kube-api-access-n8rkr\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:58:18.825553 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:18.825396    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc051de6-0b0e-4c84-9db0-f570a8f9368f-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 19:58:19.439100 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.439068    2552 generic.go:356] "Generic (PLEG): container finished" podID="cc051de6-0b0e-4c84-9db0-f570a8f9368f" containerID="84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7" exitCode=0
Jul 06 19:58:19.439565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.439124    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"
Jul 06 19:58:19.439565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.439164    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" event={"ID":"cc051de6-0b0e-4c84-9db0-f570a8f9368f","Type":"ContainerDied","Data":"84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7"}
Jul 06 19:58:19.439565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.439227    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb" event={"ID":"cc051de6-0b0e-4c84-9db0-f570a8f9368f","Type":"ContainerDied","Data":"c82feed2879ad118ce6ec43c6c25925fb41f7363b155d8e0a4a87ab62f8105f2"}
Jul 06 19:58:19.439565 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.439250    2552 scope.go:117] "RemoveContainer" containerID="84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7"
Jul 06 19:58:19.448684 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.448667    2552 scope.go:117] "RemoveContainer" containerID="84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7"
Jul 06 19:58:19.448910 ip-10-0-140-61 kubenswrapper[2552]: E0706 19:58:19.448891    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7\": container with ID starting with 84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7 not found: ID does not exist" containerID="84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7"
Jul 06 19:58:19.448983 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.448919    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7"} err="failed to get container status \"84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7\": rpc error: code = NotFound desc = could not find container \"84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7\": container with ID starting with 84551bb985132ebf2e058676ec91129b2ccd6e95b5b148fc874d0e771856c5c7 not found: ID does not exist"
Jul 06 19:58:19.474164 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.474140    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"]
Jul 06 19:58:19.481539 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.481518    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-60bec37b-564d884b5f-p62kb"]
Jul 06 19:58:19.707536 ip-10-0-140-61 kubenswrapper[2552]: I0706 19:58:19.707476    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc051de6-0b0e-4c84-9db0-f570a8f9368f" path="/var/lib/kubelet/pods/cc051de6-0b0e-4c84-9db0-f570a8f9368f/volumes"
Jul 06 20:00:16.923361 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.923324    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"]
Jul 06 20:00:16.923923 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.923904    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc051de6-0b0e-4c84-9db0-f570a8f9368f" containerName="maas-api"
Jul 06 20:00:16.923989 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.923928    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc051de6-0b0e-4c84-9db0-f570a8f9368f" containerName="maas-api"
Jul 06 20:00:16.924090 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.924078    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc051de6-0b0e-4c84-9db0-f570a8f9368f" containerName="maas-api"
Jul 06 20:00:16.927597 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.927573    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:16.931178 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.931152    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-b05069-serving-cert\""
Jul 06 20:00:16.939832 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:16.939803    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"]
Jul 06 20:00:17.055901 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.055848    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkx5c\" (UniqueName: \"kubernetes.io/projected/17efb2b9-1932-404d-b667-3a6f9d118c60-kube-api-access-tkx5c\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.056116 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.055927    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17efb2b9-1932-404d-b667-3a6f9d118c60-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.056116 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.056050    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.157194 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.157154    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkx5c\" (UniqueName: \"kubernetes.io/projected/17efb2b9-1932-404d-b667-3a6f9d118c60-kube-api-access-tkx5c\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.157395 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.157222    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17efb2b9-1932-404d-b667-3a6f9d118c60-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.157395 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.157286    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.157475 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:00:17.157456    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-b05069-serving-cert: secret "maas-api-e2e-inf-a-b05069-serving-cert" not found
Jul 06 20:00:17.157534 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:00:17.157521    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls podName:17efb2b9-1932-404d-b667-3a6f9d118c60 nodeName:}" failed. No retries permitted until 2026-07-06 20:00:17.657503543 +0000 UTC m=+2056.584541443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls") pod "maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" (UID: "17efb2b9-1932-404d-b667-3a6f9d118c60") : secret "maas-api-e2e-inf-a-b05069-serving-cert" not found
Jul 06 20:00:17.157898 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.157879    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17efb2b9-1932-404d-b667-3a6f9d118c60-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.171117 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.171096    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkx5c\" (UniqueName: \"kubernetes.io/projected/17efb2b9-1932-404d-b667-3a6f9d118c60-kube-api-access-tkx5c\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.662737 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.662698    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.665218 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.665192    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls\") pod \"maas-api-e2e-inf-a-b05069-64f99b9647-p2db5\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") " pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.840275 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.840232    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:17.999554 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:17.999524    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"]
Jul 06 20:00:18.001659 ip-10-0-140-61 kubenswrapper[2552]: W0706 20:00:18.001624    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17efb2b9_1932_404d_b667_3a6f9d118c60.slice/crio-0e1761c2d514f45922c383eaaf89a9d59153a19b7951b019eb267817cee29d81 WatchSource:0}: Error finding container 0e1761c2d514f45922c383eaaf89a9d59153a19b7951b019eb267817cee29d81: Status 404 returned error can't find the container with id 0e1761c2d514f45922c383eaaf89a9d59153a19b7951b019eb267817cee29d81
Jul 06 20:00:18.003463 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:18.003442    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:00:18.995387 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:18.995356    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" event={"ID":"17efb2b9-1932-404d-b667-3a6f9d118c60","Type":"ContainerStarted","Data":"f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280"}
Jul 06 20:00:18.995559 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:18.995407    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" event={"ID":"17efb2b9-1932-404d-b667-3a6f9d118c60","Type":"ContainerStarted","Data":"0e1761c2d514f45922c383eaaf89a9d59153a19b7951b019eb267817cee29d81"}
Jul 06 20:00:18.995559 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:18.995456    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:19.017074 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:19.017025    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" podStartSLOduration=2.588732754 podStartE2EDuration="3.017010597s" totalImagesPullingTime="428.277843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:19.015647337 +0000 UTC m=+2057.942685255" watchObservedRunningTime="2026-07-06 20:00:19.017010597 +0000 UTC m=+2057.944048514"
Jul 06 20:00:24.787061 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.787025    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"]
Jul 06 20:00:24.791975 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.791924    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.795042 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.795019    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-66d504-serving-cert\""
Jul 06 20:00:24.802579 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.802555    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"]
Jul 06 20:00:24.822322 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.822290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.822446 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.822324    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94da91a3-ca11-4669-977a-ae58a74ec57b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.822446 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.822356    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8mt\" (UniqueName: \"kubernetes.io/projected/94da91a3-ca11-4669-977a-ae58a74ec57b-kube-api-access-cb8mt\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.923412 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.923383    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.923584 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.923423    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94da91a3-ca11-4669-977a-ae58a74ec57b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.923584 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.923455    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8mt\" (UniqueName: \"kubernetes.io/projected/94da91a3-ca11-4669-977a-ae58a74ec57b-kube-api-access-cb8mt\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.923584 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:00:24.923529    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-66d504-serving-cert: secret "maas-api-e2e-inf-b-66d504-serving-cert" not found
Jul 06 20:00:24.923754 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:00:24.923598    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls podName:94da91a3-ca11-4669-977a-ae58a74ec57b nodeName:}" failed. No retries permitted until 2026-07-06 20:00:25.423581577 +0000 UTC m=+2064.350619473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls") pod "maas-api-e2e-inf-b-66d504-59c894877-z486r" (UID: "94da91a3-ca11-4669-977a-ae58a74ec57b") : secret "maas-api-e2e-inf-b-66d504-serving-cert" not found
Jul 06 20:00:24.924133 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.924101    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94da91a3-ca11-4669-977a-ae58a74ec57b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:24.932751 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:24.932729    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8mt\" (UniqueName: \"kubernetes.io/projected/94da91a3-ca11-4669-977a-ae58a74ec57b-kube-api-access-cb8mt\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:25.005084 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:25.005062    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:00:25.426506 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:25.426477    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:25.426678 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:00:25.426594    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-66d504-serving-cert: secret "maas-api-e2e-inf-b-66d504-serving-cert" not found
Jul 06 20:00:25.426678 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:00:25.426646    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls podName:94da91a3-ca11-4669-977a-ae58a74ec57b nodeName:}" failed. No retries permitted until 2026-07-06 20:00:26.426633281 +0000 UTC m=+2065.353671177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls") pod "maas-api-e2e-inf-b-66d504-59c894877-z486r" (UID: "94da91a3-ca11-4669-977a-ae58a74ec57b") : secret "maas-api-e2e-inf-b-66d504-serving-cert" not found
Jul 06 20:00:26.436319 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:26.436286    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:26.438703 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:26.438674    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") pod \"maas-api-e2e-inf-b-66d504-59c894877-z486r\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") " pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:26.603742 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:26.603709    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:26.739497 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:26.739467    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"]
Jul 06 20:00:26.742755 ip-10-0-140-61 kubenswrapper[2552]: W0706 20:00:26.742729    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94da91a3_ca11_4669_977a_ae58a74ec57b.slice/crio-cc28a63cf506fbceb39ba385d987bccf60b9da25f098091013786e6c3c196a14 WatchSource:0}: Error finding container cc28a63cf506fbceb39ba385d987bccf60b9da25f098091013786e6c3c196a14: Status 404 returned error can't find the container with id cc28a63cf506fbceb39ba385d987bccf60b9da25f098091013786e6c3c196a14
Jul 06 20:00:27.035281 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:27.035192    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r" event={"ID":"94da91a3-ca11-4669-977a-ae58a74ec57b","Type":"ContainerStarted","Data":"cc28a63cf506fbceb39ba385d987bccf60b9da25f098091013786e6c3c196a14"}
Jul 06 20:00:28.041946 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:28.041900    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r" event={"ID":"94da91a3-ca11-4669-977a-ae58a74ec57b","Type":"ContainerStarted","Data":"f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315"}
Jul 06 20:00:28.042322 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:28.042041    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:00:28.074595 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:28.069782    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r" podStartSLOduration=3.604686864 podStartE2EDuration="4.069764069s" totalImagesPullingTime="465.077205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:28.067245962 +0000 UTC m=+2066.994283880" watchObservedRunningTime="2026-07-06 20:00:28.069764069 +0000 UTC m=+2066.996801987"
Jul 06 20:00:34.051960 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:00:34.051912    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:01:01.705345 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:01.705307    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:01:01.709742 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:01.709722    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:01:20.578897 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.578865    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"]
Jul 06 20:01:20.579710 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.579090    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" podUID="17efb2b9-1932-404d-b667-3a6f9d118c60" containerName="maas-api" containerID="cri-o://f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280" gracePeriod=30
Jul 06 20:01:20.836636 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.836570    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:01:20.907032 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.906999    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls\") pod \"17efb2b9-1932-404d-b667-3a6f9d118c60\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") "
Jul 06 20:01:20.907228 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.907059    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkx5c\" (UniqueName: \"kubernetes.io/projected/17efb2b9-1932-404d-b667-3a6f9d118c60-kube-api-access-tkx5c\") pod \"17efb2b9-1932-404d-b667-3a6f9d118c60\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") "
Jul 06 20:01:20.907228 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.907185    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17efb2b9-1932-404d-b667-3a6f9d118c60-openshift-service-ca\") pod \"17efb2b9-1932-404d-b667-3a6f9d118c60\" (UID: \"17efb2b9-1932-404d-b667-3a6f9d118c60\") "
Jul 06 20:01:20.907568 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.907539    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17efb2b9-1932-404d-b667-3a6f9d118c60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17efb2b9-1932-404d-b667-3a6f9d118c60" (UID: "17efb2b9-1932-404d-b667-3a6f9d118c60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:01:20.909422 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.909394    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17efb2b9-1932-404d-b667-3a6f9d118c60-kube-api-access-tkx5c" (OuterVolumeSpecName: "kube-api-access-tkx5c") pod "17efb2b9-1932-404d-b667-3a6f9d118c60" (UID: "17efb2b9-1932-404d-b667-3a6f9d118c60"). InnerVolumeSpecName "kube-api-access-tkx5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:20.909514 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:20.909401    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17efb2b9-1932-404d-b667-3a6f9d118c60" (UID: "17efb2b9-1932-404d-b667-3a6f9d118c60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:21.008072 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.008028    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17efb2b9-1932-404d-b667-3a6f9d118c60-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:01:21.008072 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.008063    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17efb2b9-1932-404d-b667-3a6f9d118c60-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:01:21.008072 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.008075    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkx5c\" (UniqueName: \"kubernetes.io/projected/17efb2b9-1932-404d-b667-3a6f9d118c60-kube-api-access-tkx5c\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:01:21.291099 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.291065    2552 generic.go:356] "Generic (PLEG): container finished" podID="17efb2b9-1932-404d-b667-3a6f9d118c60" containerID="f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280" exitCode=0
Jul 06 20:01:21.291304 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.291116    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"
Jul 06 20:01:21.291304 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.291160    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" event={"ID":"17efb2b9-1932-404d-b667-3a6f9d118c60","Type":"ContainerDied","Data":"f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280"}
Jul 06 20:01:21.291304 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.291222    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5" event={"ID":"17efb2b9-1932-404d-b667-3a6f9d118c60","Type":"ContainerDied","Data":"0e1761c2d514f45922c383eaaf89a9d59153a19b7951b019eb267817cee29d81"}
Jul 06 20:01:21.291304 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.291252    2552 scope.go:117] "RemoveContainer" containerID="f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280"
Jul 06 20:01:21.301406 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.301387    2552 scope.go:117] "RemoveContainer" containerID="f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280"
Jul 06 20:01:21.301725 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:01:21.301705    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280\": container with ID starting with f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280 not found: ID does not exist" containerID="f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280"
Jul 06 20:01:21.301803 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.301736    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280"} err="failed to get container status \"f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280\": rpc error: code = NotFound desc = could not find container \"f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280\": container with ID starting with f44b0eb012aa49637a39063869c195b609f76bd3401fb432d775a64936a15280 not found: ID does not exist"
Jul 06 20:01:21.314055 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.314023    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"]
Jul 06 20:01:21.318201 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.318177    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-b05069-64f99b9647-p2db5"]
Jul 06 20:01:21.707915 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:21.707884    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17efb2b9-1932-404d-b667-3a6f9d118c60" path="/var/lib/kubelet/pods/17efb2b9-1932-404d-b667-3a6f9d118c60/volumes"
Jul 06 20:01:54.393793 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.393713    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"]
Jul 06 20:01:54.394335 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.394003    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r" podUID="94da91a3-ca11-4669-977a-ae58a74ec57b" containerName="maas-api" containerID="cri-o://f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315" gracePeriod=30
Jul 06 20:01:54.644572 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.644494    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:01:54.731381 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.731341    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") pod \"94da91a3-ca11-4669-977a-ae58a74ec57b\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") "
Jul 06 20:01:54.731569 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.731412    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb8mt\" (UniqueName: \"kubernetes.io/projected/94da91a3-ca11-4669-977a-ae58a74ec57b-kube-api-access-cb8mt\") pod \"94da91a3-ca11-4669-977a-ae58a74ec57b\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") "
Jul 06 20:01:54.731569 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.731434    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94da91a3-ca11-4669-977a-ae58a74ec57b-openshift-service-ca\") pod \"94da91a3-ca11-4669-977a-ae58a74ec57b\" (UID: \"94da91a3-ca11-4669-977a-ae58a74ec57b\") "
Jul 06 20:01:54.731873 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.731844    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94da91a3-ca11-4669-977a-ae58a74ec57b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94da91a3-ca11-4669-977a-ae58a74ec57b" (UID: "94da91a3-ca11-4669-977a-ae58a74ec57b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:01:54.733581 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.733546    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94da91a3-ca11-4669-977a-ae58a74ec57b-kube-api-access-cb8mt" (OuterVolumeSpecName: "kube-api-access-cb8mt") pod "94da91a3-ca11-4669-977a-ae58a74ec57b" (UID: "94da91a3-ca11-4669-977a-ae58a74ec57b"). InnerVolumeSpecName "kube-api-access-cb8mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:54.733676 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.733597    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94da91a3-ca11-4669-977a-ae58a74ec57b" (UID: "94da91a3-ca11-4669-977a-ae58a74ec57b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:54.832390 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.832351    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94da91a3-ca11-4669-977a-ae58a74ec57b-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:01:54.832390 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.832383    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb8mt\" (UniqueName: \"kubernetes.io/projected/94da91a3-ca11-4669-977a-ae58a74ec57b-kube-api-access-cb8mt\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:01:54.832390 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:54.832392    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94da91a3-ca11-4669-977a-ae58a74ec57b-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:01:55.460112 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.460075    2552 generic.go:356] "Generic (PLEG): container finished" podID="94da91a3-ca11-4669-977a-ae58a74ec57b" containerID="f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315" exitCode=0
Jul 06 20:01:55.460529 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.460122    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"
Jul 06 20:01:55.460529 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.460156    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r" event={"ID":"94da91a3-ca11-4669-977a-ae58a74ec57b","Type":"ContainerDied","Data":"f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315"}
Jul 06 20:01:55.460529 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.460207    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r" event={"ID":"94da91a3-ca11-4669-977a-ae58a74ec57b","Type":"ContainerDied","Data":"cc28a63cf506fbceb39ba385d987bccf60b9da25f098091013786e6c3c196a14"}
Jul 06 20:01:55.460529 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.460228    2552 scope.go:117] "RemoveContainer" containerID="f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315"
Jul 06 20:01:55.469685 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.469666    2552 scope.go:117] "RemoveContainer" containerID="f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315"
Jul 06 20:01:55.469998 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:01:55.469976    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315\": container with ID starting with f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315 not found: ID does not exist" containerID="f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315"
Jul 06 20:01:55.470054 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.470010    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315"} err="failed to get container status \"f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315\": rpc error: code = NotFound desc = could not find container \"f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315\": container with ID starting with f20a6d9a1e3fa5f4e0a78a719bc3dc69dd680286d8309a68ba4bc26c8a1da315 not found: ID does not exist"
Jul 06 20:01:55.504270 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.504234    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"]
Jul 06 20:01:55.514618 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.514588    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-66d504-59c894877-z486r"]
Jul 06 20:01:55.707437 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:01:55.707392    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94da91a3-ca11-4669-977a-ae58a74ec57b" path="/var/lib/kubelet/pods/94da91a3-ca11-4669-977a-ae58a74ec57b/volumes"
Jul 06 20:02:04.272736 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.272697    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"]
Jul 06 20:02:04.273331 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.273310    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94da91a3-ca11-4669-977a-ae58a74ec57b" containerName="maas-api"
Jul 06 20:02:04.273389 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.273337    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="94da91a3-ca11-4669-977a-ae58a74ec57b" containerName="maas-api"
Jul 06 20:02:04.273389 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.273383    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17efb2b9-1932-404d-b667-3a6f9d118c60" containerName="maas-api"
Jul 06 20:02:04.273456 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.273392    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="17efb2b9-1932-404d-b667-3a6f9d118c60" containerName="maas-api"
Jul 06 20:02:04.273513 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.273500    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="17efb2b9-1932-404d-b667-3a6f9d118c60" containerName="maas-api"
Jul 06 20:02:04.273547 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.273520    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="94da91a3-ca11-4669-977a-ae58a74ec57b" containerName="maas-api"
Jul 06 20:02:04.276794 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.276772    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.280450 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.280429    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-d1d6a7-serving-cert\""
Jul 06 20:02:04.287284 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.287252    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"]
Jul 06 20:02:04.323229 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.323188    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtbw\" (UniqueName: \"kubernetes.io/projected/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-kube-api-access-nhtbw\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.323404 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.323236    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.323404 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.323318    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-openshift-service-ca\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.424472 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.424433    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-openshift-service-ca\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.424652 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.424529    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtbw\" (UniqueName: \"kubernetes.io/projected/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-kube-api-access-nhtbw\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.424652 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.424555    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.424725 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:02:04.424667    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-d1d6a7-serving-cert: secret "maas-api-e2e-api-a-d1d6a7-serving-cert" not found
Jul 06 20:02:04.424760 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:02:04.424747    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls podName:ce7bb443-a04a-49de-8804-2b86b6ff2aa2 nodeName:}" failed. No retries permitted until 2026-07-06 20:02:04.924731024 +0000 UTC m=+2163.851768922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls") pod "maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" (UID: "ce7bb443-a04a-49de-8804-2b86b6ff2aa2") : secret "maas-api-e2e-api-a-d1d6a7-serving-cert" not found
Jul 06 20:02:04.425159 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.425140    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-openshift-service-ca\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.444439 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.444410    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtbw\" (UniqueName: \"kubernetes.io/projected/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-kube-api-access-nhtbw\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.928831 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.928789    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:04.931623 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:04.931590    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") " pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:05.188330 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:05.188295    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:05.348610 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:05.348582    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"]
Jul 06 20:02:05.351187 ip-10-0-140-61 kubenswrapper[2552]: W0706 20:02:05.351162    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7bb443_a04a_49de_8804_2b86b6ff2aa2.slice/crio-8a35d8686a6a923cd85d0dcb80f6132f8d6274c8841bf91b3d8b5c616d46b646 WatchSource:0}: Error finding container 8a35d8686a6a923cd85d0dcb80f6132f8d6274c8841bf91b3d8b5c616d46b646: Status 404 returned error can't find the container with id 8a35d8686a6a923cd85d0dcb80f6132f8d6274c8841bf91b3d8b5c616d46b646
Jul 06 20:02:05.518766 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:05.518671    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" event={"ID":"ce7bb443-a04a-49de-8804-2b86b6ff2aa2","Type":"ContainerStarted","Data":"8a35d8686a6a923cd85d0dcb80f6132f8d6274c8841bf91b3d8b5c616d46b646"}
Jul 06 20:02:06.526291 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:06.526259    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" event={"ID":"ce7bb443-a04a-49de-8804-2b86b6ff2aa2","Type":"ContainerStarted","Data":"e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653"}
Jul 06 20:02:06.526695 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:06.526458    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:06.546099 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:06.546050    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" podStartSLOduration=2.055439647 podStartE2EDuration="2.546034762s" totalImagesPullingTime="490.595115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:06.544012096 +0000 UTC m=+2165.471050012" watchObservedRunningTime="2026-07-06 20:02:06.546034762 +0000 UTC m=+2165.473072681"
Jul 06 20:02:12.315083 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.315048    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"]
Jul 06 20:02:12.318663 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.318620    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.322881 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.322858    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-47ea5d-serving-cert\""
Jul 06 20:02:12.331703 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.331675    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"]
Jul 06 20:02:12.404236 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.404189    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-openshift-service-ca\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.404416 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.404269    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmxm\" (UniqueName: \"kubernetes.io/projected/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-kube-api-access-zrmxm\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.404416 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.404366    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-maas-api-tls\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.505348 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.505304    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-maas-api-tls\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.505549 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.505374    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-openshift-service-ca\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.505549 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.505448    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmxm\" (UniqueName: \"kubernetes.io/projected/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-kube-api-access-zrmxm\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.506061 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.506038    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-openshift-service-ca\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.507908 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.507882    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-maas-api-tls\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.517810 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.517785    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmxm\" (UniqueName: \"kubernetes.io/projected/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-kube-api-access-zrmxm\") pod \"maas-api-e2e-api-b-47ea5d-7d56599b9-4585w\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") " pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.537676 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.537651    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:12.629906 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.629809    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:12.783071 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:12.782874    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"]
Jul 06 20:02:13.561621 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:13.561586    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w" event={"ID":"037fc3f2-a9be-4c46-a327-7ffef8cb82c6","Type":"ContainerStarted","Data":"ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd"}
Jul 06 20:02:13.562009 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:13.561636    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w" event={"ID":"037fc3f2-a9be-4c46-a327-7ffef8cb82c6","Type":"ContainerStarted","Data":"66d498fdbbeacebfdac81ace4bf8049ae2e1d9184fe44a51e33ace1ee2eebee0"}
Jul 06 20:02:13.562009 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:13.561725    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:13.584604 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:13.584555    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w" podStartSLOduration=1.22197366 podStartE2EDuration="1.584541726s" totalImagesPullingTime="362.568066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:13.583906349 +0000 UTC m=+2172.510944267" watchObservedRunningTime="2026-07-06 20:02:13.584541726 +0000 UTC m=+2172.511579644"
Jul 06 20:02:19.571580 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:19.571550    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:26.300444 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.300413    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"]
Jul 06 20:02:26.300863 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.300643    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" podUID="ce7bb443-a04a-49de-8804-2b86b6ff2aa2" containerName="maas-api" containerID="cri-o://e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653" gracePeriod=30
Jul 06 20:02:26.554780 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.554715    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:26.626695 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.626660    2552 generic.go:356] "Generic (PLEG): container finished" podID="ce7bb443-a04a-49de-8804-2b86b6ff2aa2" containerID="e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653" exitCode=0
Jul 06 20:02:26.626875 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.626710    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"
Jul 06 20:02:26.626875 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.626727    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" event={"ID":"ce7bb443-a04a-49de-8804-2b86b6ff2aa2","Type":"ContainerDied","Data":"e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653"}
Jul 06 20:02:26.626875 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.626780    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b" event={"ID":"ce7bb443-a04a-49de-8804-2b86b6ff2aa2","Type":"ContainerDied","Data":"8a35d8686a6a923cd85d0dcb80f6132f8d6274c8841bf91b3d8b5c616d46b646"}
Jul 06 20:02:26.626875 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.626809    2552 scope.go:117] "RemoveContainer" containerID="e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653"
Jul 06 20:02:26.637110 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.637091    2552 scope.go:117] "RemoveContainer" containerID="e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653"
Jul 06 20:02:26.637418 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:02:26.637386    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653\": container with ID starting with e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653 not found: ID does not exist" containerID="e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653"
Jul 06 20:02:26.637485 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.637428    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653"} err="failed to get container status \"e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653\": rpc error: code = NotFound desc = could not find container \"e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653\": container with ID starting with e803154d267bcea7da8c266457de3ec77ada997069671a5e4dad0f3c91264653 not found: ID does not exist"
Jul 06 20:02:26.648653 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.648630    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls\") pod \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") "
Jul 06 20:02:26.648766 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.648665    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhtbw\" (UniqueName: \"kubernetes.io/projected/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-kube-api-access-nhtbw\") pod \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") "
Jul 06 20:02:26.648766 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.648683    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-openshift-service-ca\") pod \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\" (UID: \"ce7bb443-a04a-49de-8804-2b86b6ff2aa2\") "
Jul 06 20:02:26.649088 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.649065    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce7bb443-a04a-49de-8804-2b86b6ff2aa2" (UID: "ce7bb443-a04a-49de-8804-2b86b6ff2aa2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:26.650888 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.650867    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-kube-api-access-nhtbw" (OuterVolumeSpecName: "kube-api-access-nhtbw") pod "ce7bb443-a04a-49de-8804-2b86b6ff2aa2" (UID: "ce7bb443-a04a-49de-8804-2b86b6ff2aa2"). InnerVolumeSpecName "kube-api-access-nhtbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:26.651135 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.651103    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce7bb443-a04a-49de-8804-2b86b6ff2aa2" (UID: "ce7bb443-a04a-49de-8804-2b86b6ff2aa2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:02:26.749566 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.749526    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:02:26.749566 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.749561    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhtbw\" (UniqueName: \"kubernetes.io/projected/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-kube-api-access-nhtbw\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:02:26.749566 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.749572    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce7bb443-a04a-49de-8804-2b86b6ff2aa2-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:02:26.961160 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.961128    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"]
Jul 06 20:02:26.963979 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:26.963954    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d6a7-6b446bd95c-5ht5b"]
Jul 06 20:02:27.710558 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:27.710516    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce7bb443-a04a-49de-8804-2b86b6ff2aa2" path="/var/lib/kubelet/pods/ce7bb443-a04a-49de-8804-2b86b6ff2aa2/volumes"
Jul 06 20:02:33.609311 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.609276    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"]
Jul 06 20:02:33.609800 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.609468    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w" podUID="037fc3f2-a9be-4c46-a327-7ffef8cb82c6" containerName="maas-api" containerID="cri-o://ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd" gracePeriod=30
Jul 06 20:02:33.870160 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.870097    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:33.914330 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.914298    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrmxm\" (UniqueName: \"kubernetes.io/projected/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-kube-api-access-zrmxm\") pod \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") "
Jul 06 20:02:33.914493 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.914412    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-maas-api-tls\") pod \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") "
Jul 06 20:02:33.914493 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.914448    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-openshift-service-ca\") pod \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\" (UID: \"037fc3f2-a9be-4c46-a327-7ffef8cb82c6\") "
Jul 06 20:02:33.914865 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.914836    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "037fc3f2-a9be-4c46-a327-7ffef8cb82c6" (UID: "037fc3f2-a9be-4c46-a327-7ffef8cb82c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:33.916537 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.916510    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-kube-api-access-zrmxm" (OuterVolumeSpecName: "kube-api-access-zrmxm") pod "037fc3f2-a9be-4c46-a327-7ffef8cb82c6" (UID: "037fc3f2-a9be-4c46-a327-7ffef8cb82c6"). InnerVolumeSpecName "kube-api-access-zrmxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:33.916659 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:33.916613    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "037fc3f2-a9be-4c46-a327-7ffef8cb82c6" (UID: "037fc3f2-a9be-4c46-a327-7ffef8cb82c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:02:34.015683 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.015647    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:02:34.015683 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.015676    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:02:34.015683 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.015687    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrmxm\" (UniqueName: \"kubernetes.io/projected/037fc3f2-a9be-4c46-a327-7ffef8cb82c6-kube-api-access-zrmxm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:02:34.668087 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.668051    2552 generic.go:356] "Generic (PLEG): container finished" podID="037fc3f2-a9be-4c46-a327-7ffef8cb82c6" containerID="ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd" exitCode=0
Jul 06 20:02:34.668567 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.668097    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"
Jul 06 20:02:34.668567 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.668118    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w" event={"ID":"037fc3f2-a9be-4c46-a327-7ffef8cb82c6","Type":"ContainerDied","Data":"ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd"}
Jul 06 20:02:34.668567 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.668161    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w" event={"ID":"037fc3f2-a9be-4c46-a327-7ffef8cb82c6","Type":"ContainerDied","Data":"66d498fdbbeacebfdac81ace4bf8049ae2e1d9184fe44a51e33ace1ee2eebee0"}
Jul 06 20:02:34.668567 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.668182    2552 scope.go:117] "RemoveContainer" containerID="ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd"
Jul 06 20:02:34.677908 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.677887    2552 scope.go:117] "RemoveContainer" containerID="ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd"
Jul 06 20:02:34.678249 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:02:34.678228    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd\": container with ID starting with ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd not found: ID does not exist" containerID="ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd"
Jul 06 20:02:34.678325 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.678259    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd"} err="failed to get container status \"ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd\": rpc error: code = NotFound desc = could not find container \"ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd\": container with ID starting with ca89b348be6746fbb7830a1cf32947c2d9dec6162d7782b00ddf2bd28e0c6ebd not found: ID does not exist"
Jul 06 20:02:34.690132 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.690107    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"]
Jul 06 20:02:34.694103 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:34.694084    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-47ea5d-7d56599b9-4585w"]
Jul 06 20:02:35.707095 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:35.707059    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037fc3f2-a9be-4c46-a327-7ffef8cb82c6" path="/var/lib/kubelet/pods/037fc3f2-a9be-4c46-a327-7ffef8cb82c6/volumes"
Jul 06 20:02:43.512836 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.512798    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"]
Jul 06 20:02:43.513252 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.513237    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037fc3f2-a9be-4c46-a327-7ffef8cb82c6" containerName="maas-api"
Jul 06 20:02:43.513296 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.513254    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="037fc3f2-a9be-4c46-a327-7ffef8cb82c6" containerName="maas-api"
Jul 06 20:02:43.513296 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.513267    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7bb443-a04a-49de-8804-2b86b6ff2aa2" containerName="maas-api"
Jul 06 20:02:43.513296 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.513272    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7bb443-a04a-49de-8804-2b86b6ff2aa2" containerName="maas-api"
Jul 06 20:02:43.513434 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.513335    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7bb443-a04a-49de-8804-2b86b6ff2aa2" containerName="maas-api"
Jul 06 20:02:43.513434 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.513348    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="037fc3f2-a9be-4c46-a327-7ffef8cb82c6" containerName="maas-api"
Jul 06 20:02:43.517915 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.517890    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.520848 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.520825    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-96f4cb-serving-cert\""
Jul 06 20:02:43.527951 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.527915    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"]
Jul 06 20:02:43.606911 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.606873    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc70440-aa77-4881-876e-f8a71b43f52c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.607120 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.606927    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfglk\" (UniqueName: \"kubernetes.io/projected/abc70440-aa77-4881-876e-f8a71b43f52c-kube-api-access-gfglk\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.607120 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.607078    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abc70440-aa77-4881-876e-f8a71b43f52c-maas-api-tls\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.707748 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.707710    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abc70440-aa77-4881-876e-f8a71b43f52c-maas-api-tls\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.707980 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.707777    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc70440-aa77-4881-876e-f8a71b43f52c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.707980 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.707829    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfglk\" (UniqueName: \"kubernetes.io/projected/abc70440-aa77-4881-876e-f8a71b43f52c-kube-api-access-gfglk\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.708562 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.708542    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc70440-aa77-4881-876e-f8a71b43f52c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.710695 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.710673    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abc70440-aa77-4881-876e-f8a71b43f52c-maas-api-tls\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.717586 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.717559    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfglk\" (UniqueName: \"kubernetes.io/projected/abc70440-aa77-4881-876e-f8a71b43f52c-kube-api-access-gfglk\") pod \"maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") " pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:43.828652 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:43.828575    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:44.197250 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:44.197215    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"]
Jul 06 20:02:44.203232 ip-10-0-140-61 kubenswrapper[2552]: W0706 20:02:44.203199    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc70440_aa77_4881_876e_f8a71b43f52c.slice/crio-bd8b457a1411359efe297aa1aa3efc679b7788ea03052b6d8f1053049c93d94a WatchSource:0}: Error finding container bd8b457a1411359efe297aa1aa3efc679b7788ea03052b6d8f1053049c93d94a: Status 404 returned error can't find the container with id bd8b457a1411359efe297aa1aa3efc679b7788ea03052b6d8f1053049c93d94a
Jul 06 20:02:44.719128 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:44.719091    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc" event={"ID":"abc70440-aa77-4881-876e-f8a71b43f52c","Type":"ContainerStarted","Data":"bd8b457a1411359efe297aa1aa3efc679b7788ea03052b6d8f1053049c93d94a"}
Jul 06 20:02:45.725134 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:45.725092    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc" event={"ID":"abc70440-aa77-4881-876e-f8a71b43f52c","Type":"ContainerStarted","Data":"0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b"}
Jul 06 20:02:45.725598 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:45.725226    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:45.742821 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:45.742772    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc" podStartSLOduration=2.217878894 podStartE2EDuration="2.742759643s" totalImagesPullingTime="524.880749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:45.742294689 +0000 UTC m=+2204.669332609" watchObservedRunningTime="2026-07-06 20:02:45.742759643 +0000 UTC m=+2204.669797579"
Jul 06 20:02:51.643706 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.643671    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"]
Jul 06 20:02:51.647544 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.647521    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.653081 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.653059    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-fd49c7-serving-cert\""
Jul 06 20:02:51.683948 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.683900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbkm\" (UniqueName: \"kubernetes.io/projected/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-kube-api-access-rpbkm\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.684114 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.684074    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.684191 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.684131    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.685757 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.685727    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"]
Jul 06 20:02:51.735783 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.735750    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:02:51.784879 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.784830    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.785092 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.784961    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.785092 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:02:51.784989    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-fd49c7-serving-cert: secret "maas-api-e2e-shared-b-fd49c7-serving-cert" not found
Jul 06 20:02:51.785092 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.785028    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbkm\" (UniqueName: \"kubernetes.io/projected/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-kube-api-access-rpbkm\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.785092 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:02:51.785060    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls podName:10fd8aa4-4b8b-4573-a753-03fbf1eac2ad nodeName:}" failed. No retries permitted until 2026-07-06 20:02:52.285038172 +0000 UTC m=+2211.212076069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls") pod "maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" (UID: "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad") : secret "maas-api-e2e-shared-b-fd49c7-serving-cert" not found
Jul 06 20:02:51.786142 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.786091    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:51.801047 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:51.801012    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbkm\" (UniqueName: \"kubernetes.io/projected/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-kube-api-access-rpbkm\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:52.289985 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:52.289946    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:52.292534 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:52.292506    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls\") pod \"maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") " pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:52.558676 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:52.558594    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:52.711494 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:52.711469    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"]
Jul 06 20:02:52.713877 ip-10-0-140-61 kubenswrapper[2552]: W0706 20:02:52.713845    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fd8aa4_4b8b_4573_a753_03fbf1eac2ad.slice/crio-ec4cba1e0e2b46beb33be9137a8c2ea1e5b888e1f09551a82e1f20fae3e45d88 WatchSource:0}: Error finding container ec4cba1e0e2b46beb33be9137a8c2ea1e5b888e1f09551a82e1f20fae3e45d88: Status 404 returned error can't find the container with id ec4cba1e0e2b46beb33be9137a8c2ea1e5b888e1f09551a82e1f20fae3e45d88
Jul 06 20:02:52.761154 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:52.761117    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" event={"ID":"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad","Type":"ContainerStarted","Data":"ec4cba1e0e2b46beb33be9137a8c2ea1e5b888e1f09551a82e1f20fae3e45d88"}
Jul 06 20:02:53.767521 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:53.767481    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" event={"ID":"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad","Type":"ContainerStarted","Data":"f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc"}
Jul 06 20:02:53.767966 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:53.767602    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:02:53.790210 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:53.790148    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" podStartSLOduration=2.396796743 podStartE2EDuration="2.790131549s" totalImagesPullingTime="393.334806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:53.788633453 +0000 UTC m=+2212.715671377" watchObservedRunningTime="2026-07-06 20:02:53.790131549 +0000 UTC m=+2212.717169468"
Jul 06 20:02:59.778422 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:02:59.778392    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:06:01.736508 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:06:01.736476    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:06:01.741214 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:06:01.741184    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:06:21.851167 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:06:21.851063    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-7f4c455986-756xq" podUID="5f2e6839-4197-4412-a76c-8a13c22aa4b5" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.29:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:09:34.846996 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:34.846963    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"]
Jul 06 20:09:34.847460 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:34.847211    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc" podUID="abc70440-aa77-4881-876e-f8a71b43f52c" containerName="maas-api" containerID="cri-o://0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b" gracePeriod=30
Jul 06 20:09:35.101612 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.101549    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:09:35.264853 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.264827    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abc70440-aa77-4881-876e-f8a71b43f52c-maas-api-tls\") pod \"abc70440-aa77-4881-876e-f8a71b43f52c\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") "
Jul 06 20:09:35.265019 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.264860    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfglk\" (UniqueName: \"kubernetes.io/projected/abc70440-aa77-4881-876e-f8a71b43f52c-kube-api-access-gfglk\") pod \"abc70440-aa77-4881-876e-f8a71b43f52c\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") "
Jul 06 20:09:35.265019 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.264902    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc70440-aa77-4881-876e-f8a71b43f52c-openshift-service-ca\") pod \"abc70440-aa77-4881-876e-f8a71b43f52c\" (UID: \"abc70440-aa77-4881-876e-f8a71b43f52c\") "
Jul 06 20:09:35.265333 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.265306    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abc70440-aa77-4881-876e-f8a71b43f52c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "abc70440-aa77-4881-876e-f8a71b43f52c" (UID: "abc70440-aa77-4881-876e-f8a71b43f52c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:35.267012 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.266991    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc70440-aa77-4881-876e-f8a71b43f52c-kube-api-access-gfglk" (OuterVolumeSpecName: "kube-api-access-gfglk") pod "abc70440-aa77-4881-876e-f8a71b43f52c" (UID: "abc70440-aa77-4881-876e-f8a71b43f52c"). InnerVolumeSpecName "kube-api-access-gfglk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:35.267114 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.267093    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc70440-aa77-4881-876e-f8a71b43f52c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "abc70440-aa77-4881-876e-f8a71b43f52c" (UID: "abc70440-aa77-4881-876e-f8a71b43f52c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:35.366458 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.366387    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc70440-aa77-4881-876e-f8a71b43f52c-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:09:35.366458 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.366411    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abc70440-aa77-4881-876e-f8a71b43f52c-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:09:35.366458 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.366423    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfglk\" (UniqueName: \"kubernetes.io/projected/abc70440-aa77-4881-876e-f8a71b43f52c-kube-api-access-gfglk\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:09:35.763579 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.763549    2552 generic.go:356] "Generic (PLEG): container finished" podID="abc70440-aa77-4881-876e-f8a71b43f52c" containerID="0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b" exitCode=0
Jul 06 20:09:35.763709 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.763585    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"
Jul 06 20:09:35.763709 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.763602    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc" event={"ID":"abc70440-aa77-4881-876e-f8a71b43f52c","Type":"ContainerDied","Data":"0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b"}
Jul 06 20:09:35.763709 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.763653    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc" event={"ID":"abc70440-aa77-4881-876e-f8a71b43f52c","Type":"ContainerDied","Data":"bd8b457a1411359efe297aa1aa3efc679b7788ea03052b6d8f1053049c93d94a"}
Jul 06 20:09:35.763709 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.763675    2552 scope.go:117] "RemoveContainer" containerID="0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b"
Jul 06 20:09:35.772209 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.772196    2552 scope.go:117] "RemoveContainer" containerID="0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b"
Jul 06 20:09:35.772473 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:09:35.772449    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b\": container with ID starting with 0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b not found: ID does not exist" containerID="0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b"
Jul 06 20:09:35.772576 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.772478    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b"} err="failed to get container status \"0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b\": rpc error: code = NotFound desc = could not find container \"0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b\": container with ID starting with 0bc9b35b3d8d0e8c7107cc1c3894f960fdbbca624314fa3fb58e03920b853d9b not found: ID does not exist"
Jul 06 20:09:35.788276 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.788253    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"]
Jul 06 20:09:35.791041 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:35.791016    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-96f4cb-6cfbd97bf-pr7wc"]
Jul 06 20:09:37.706417 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:09:37.706385    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc70440-aa77-4881-876e-f8a71b43f52c" path="/var/lib/kubelet/pods/abc70440-aa77-4881-876e-f8a71b43f52c/volumes"
Jul 06 20:10:19.245729 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.245690    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"]
Jul 06 20:10:19.246277 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.245996    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" podUID="10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" containerName="maas-api" containerID="cri-o://f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc" gracePeriod=30
Jul 06 20:10:19.499265 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.499214    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:10:19.607513 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.607483    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-openshift-service-ca\") pod \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") "
Jul 06 20:10:19.607701 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.607537    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls\") pod \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") "
Jul 06 20:10:19.607701 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.607567    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpbkm\" (UniqueName: \"kubernetes.io/projected/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-kube-api-access-rpbkm\") pod \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\" (UID: \"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad\") "
Jul 06 20:10:19.607914 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.607888    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" (UID: "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:10:19.609753 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.609734    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" (UID: "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:10:19.609822 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.609785    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-kube-api-access-rpbkm" (OuterVolumeSpecName: "kube-api-access-rpbkm") pod "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" (UID: "10fd8aa4-4b8b-4573-a753-03fbf1eac2ad"). InnerVolumeSpecName "kube-api-access-rpbkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:10:19.708306 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.708274    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:10:19.708306 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.708301    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:10:19.708306 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.708310    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpbkm\" (UniqueName: \"kubernetes.io/projected/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad-kube-api-access-rpbkm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 06 20:10:19.966758 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.966728    2552 generic.go:356] "Generic (PLEG): container finished" podID="10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" containerID="f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc" exitCode=0
Jul 06 20:10:19.966915 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.966773    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"
Jul 06 20:10:19.966915 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.966789    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" event={"ID":"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad","Type":"ContainerDied","Data":"f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc"}
Jul 06 20:10:19.966915 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.966833    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr" event={"ID":"10fd8aa4-4b8b-4573-a753-03fbf1eac2ad","Type":"ContainerDied","Data":"ec4cba1e0e2b46beb33be9137a8c2ea1e5b888e1f09551a82e1f20fae3e45d88"}
Jul 06 20:10:19.966915 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.966856    2552 scope.go:117] "RemoveContainer" containerID="f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc"
Jul 06 20:10:19.975285 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.975265    2552 scope.go:117] "RemoveContainer" containerID="f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc"
Jul 06 20:10:19.975520 ip-10-0-140-61 kubenswrapper[2552]: E0706 20:10:19.975500    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc\": container with ID starting with f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc not found: ID does not exist" containerID="f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc"
Jul 06 20:10:19.975565 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:19.975529    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc"} err="failed to get container status \"f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc\": rpc error: code = NotFound desc = could not find container \"f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc\": container with ID starting with f195fd259ee1d34193e31e64ef31bdd943c94b8523e8b4a5dc2d9fe25e7811fc not found: ID does not exist"
Jul 06 20:10:20.013886 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:20.013862    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"]
Jul 06 20:10:20.021618 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:20.021600    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fd49c7-756c7cdb4f-fctsr"]
Jul 06 20:10:21.706604 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:21.706576    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" path="/var/lib/kubelet/pods/10fd8aa4-4b8b-4573-a753-03fbf1eac2ad/volumes"
Jul 06 20:10:31.886787 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:31.886754    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6bcbb57667-sgfvb_cd67f99e-0e56-491b-ae16-8aa371530dd6/maas-api/0.log"
Jul 06 20:10:32.329152 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:32.329122    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f4c455986-756xq_5f2e6839-4197-4412-a76c-8a13c22aa4b5/manager/2.log"
Jul 06 20:10:33.036102 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:33.036076    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-hhjk6_a0b8268c-80c2-4629-9123-ad0dca8c1493/copy-manifests/0.log"
Jul 06 20:10:33.049701 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:33.049677    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-hhjk6_a0b8268c-80c2-4629-9123-ad0dca8c1493/manager/0.log"
Jul 06 20:10:33.183384 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:33.183365    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vhz2w_e879fa8b-2fda-4927-8501-f1b7c3ff7a35/postgres/0.log"
Jul 06 20:10:36.219200 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:36.219170    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ctv49_f1dc92a1-adcd-4055-b16d-4e3476722302/discovery/0.log"
Jul 06 20:10:36.744192 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:36.744157    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qhpnl_9b603e00-1641-4fd6-92e0-c2a5c0a75b36/payload-pre-processing/0.log"
Jul 06 20:10:36.885829 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:36.885799    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvfxf_929c2e44-6900-4553-bb4a-7017a9c9038a/payload-processing/0.log"
Jul 06 20:10:37.424888 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:37.424863    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-knxfk_d51460f9-0762-4c10-bd1d-d3c89e688ba6/main/0.log"
Jul 06 20:10:37.679751 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:37.679671    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pmwtc_dbbc5cf3-78f5-4176-8515-f159a7f9454f/main/0.log"
Jul 06 20:10:37.922726 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:37.922697    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w4rx7_9f87cfd3-5ae4-471b-a2f8-7984868ad01c/main/0.log"
Jul 06 20:10:45.854730 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:45.854702    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x489d_104c43aa-5c63-423f-a55a-0fd25fa7cf9f/global-pull-secret-syncer/0.log"
Jul 06 20:10:46.053813 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:46.053790    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kf4nx_f4a2be21-40ce-4866-84ce-ede14e71a937/konnectivity-agent/0.log"
Jul 06 20:10:46.158855 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:46.158773    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-61.ec2.internal_03ac6699bc87ac3abedcb3149dcf3083/haproxy/0.log"
Jul 06 20:10:54.080702 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.080628    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-p2fn5_8951dd98-12c9-4ad2-9141-611839ae9331/cluster-monitoring-operator/0.log"
Jul 06 20:10:54.257441 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.257412    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75f4b4b9cf-lpg2k_a321ad51-512e-4559-8f6a-8b7f23be048b/metrics-server/0.log"
Jul 06 20:10:54.294540 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.294508    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5j6sl_2cf35659-1e84-4dce-b3d1-1b5c73a71984/monitoring-plugin/0.log"
Jul 06 20:10:54.587371 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.587347    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7lzh_58cda9ae-6b81-49d9-82fb-5217412b4e1a/node-exporter/0.log"
Jul 06 20:10:54.658423 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.658403    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7lzh_58cda9ae-6b81-49d9-82fb-5217412b4e1a/kube-rbac-proxy/0.log"
Jul 06 20:10:54.695231 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.695209    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7lzh_58cda9ae-6b81-49d9-82fb-5217412b4e1a/init-textfile/0.log"
Jul 06 20:10:54.730524 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.730505    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ltskc_3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c/kube-rbac-proxy-main/0.log"
Jul 06 20:10:54.773389 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.773368    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ltskc_3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c/kube-rbac-proxy-self/0.log"
Jul 06 20:10:54.805047 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.805028    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ltskc_3bc3b0b5-7d43-4a5b-9fc1-41beb9be2e0c/openshift-state-metrics/0.log"
Jul 06 20:10:54.850788 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.850741    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/prometheus/0.log"
Jul 06 20:10:54.884247 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.884228    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/config-reloader/0.log"
Jul 06 20:10:54.935612 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.935594    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/thanos-sidecar/0.log"
Jul 06 20:10:54.978341 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:54.978318    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/kube-rbac-proxy-web/0.log"
Jul 06 20:10:55.015501 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.015481    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/kube-rbac-proxy/0.log"
Jul 06 20:10:55.046930 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.046918    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/kube-rbac-proxy-thanos/0.log"
Jul 06 20:10:55.079780 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.079761    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_85a71477-af5a-4732-a0a0-a8f208996d40/init-config-reloader/0.log"
Jul 06 20:10:55.125195 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.125146    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4gjsv_9da1c63f-94ad-477d-ad5b-20627a1261d9/prometheus-operator/0.log"
Jul 06 20:10:55.296425 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.296403    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4gjsv_9da1c63f-94ad-477d-ad5b-20627a1261d9/kube-rbac-proxy/0.log"
Jul 06 20:10:55.402681 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.402608    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"]
Jul 06 20:10:55.403079 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.403063    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc70440-aa77-4881-876e-f8a71b43f52c" containerName="maas-api"
Jul 06 20:10:55.403173 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.403081    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc70440-aa77-4881-876e-f8a71b43f52c" containerName="maas-api"
Jul 06 20:10:55.403173 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.403092    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" containerName="maas-api"
Jul 06 20:10:55.403173 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.403100    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" containerName="maas-api"
Jul 06 20:10:55.403345 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.403238    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="10fd8aa4-4b8b-4573-a753-03fbf1eac2ad" containerName="maas-api"
Jul 06 20:10:55.403345 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.403256    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="abc70440-aa77-4881-876e-f8a71b43f52c" containerName="maas-api"
Jul 06 20:10:55.406369 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.406351    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.413586 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.413563    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7wvf\"/\"default-dockercfg-v9qnr\""
Jul 06 20:10:55.413681 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.413613    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7wvf\"/\"openshift-service-ca.crt\""
Jul 06 20:10:55.413681 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.413650    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7wvf\"/\"kube-root-ca.crt\""
Jul 06 20:10:55.436081 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.436061    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"]
Jul 06 20:10:55.513616 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.513591    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-podres\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.513755 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.513625    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-sys\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.513755 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.513660    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-proc\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.513873 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.513754    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-lib-modules\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.513873 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.513822    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cccrc\" (UniqueName: \"kubernetes.io/projected/7bd49844-87fc-4ff2-ba91-1925bb872dfb-kube-api-access-cccrc\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.614967 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.614916    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-podres\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615101 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.614988    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-sys\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615101 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615046    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-proc\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615101 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615090    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-podres\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615101 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615095    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-lib-modules\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615256 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615111    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-sys\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615256 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615170    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-lib-modules\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615256 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615170    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bd49844-87fc-4ff2-ba91-1925bb872dfb-proc\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.615256 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.615191    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cccrc\" (UniqueName: \"kubernetes.io/projected/7bd49844-87fc-4ff2-ba91-1925bb872dfb-kube-api-access-cccrc\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.639208 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.639183    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cccrc\" (UniqueName: \"kubernetes.io/projected/7bd49844-87fc-4ff2-ba91-1925bb872dfb-kube-api-access-cccrc\") pod \"perf-node-gather-daemonset-pgw2m\" (UID: \"7bd49844-87fc-4ff2-ba91-1925bb872dfb\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.642614 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.642589    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8595585cc9-229m9_9fc1eafd-4985-49d0-943d-59e6b7ac5135/thanos-query/0.log"
Jul 06 20:10:55.682976 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.682883    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8595585cc9-229m9_9fc1eafd-4985-49d0-943d-59e6b7ac5135/kube-rbac-proxy-web/0.log"
Jul 06 20:10:55.716000 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.715978    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:55.720368 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.720353    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8595585cc9-229m9_9fc1eafd-4985-49d0-943d-59e6b7ac5135/kube-rbac-proxy/0.log"
Jul 06 20:10:55.752257 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.752234    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8595585cc9-229m9_9fc1eafd-4985-49d0-943d-59e6b7ac5135/prom-label-proxy/0.log"
Jul 06 20:10:55.786021 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.785991    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8595585cc9-229m9_9fc1eafd-4985-49d0-943d-59e6b7ac5135/kube-rbac-proxy-rules/0.log"
Jul 06 20:10:55.830101 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.830076    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8595585cc9-229m9_9fc1eafd-4985-49d0-943d-59e6b7ac5135/kube-rbac-proxy-metrics/0.log"
Jul 06 20:10:55.853716 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:55.853697    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"]
Jul 06 20:10:55.855904 ip-10-0-140-61 kubenswrapper[2552]: W0706 20:10:55.855874    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7bd49844_87fc_4ff2_ba91_1925bb872dfb.slice/crio-da61e1e99e5b8fa3fde54350d6b6c81773a5ba74d712e1de0e2ccdfd884a9aee WatchSource:0}: Error finding container da61e1e99e5b8fa3fde54350d6b6c81773a5ba74d712e1de0e2ccdfd884a9aee: Status 404 returned error can't find the container with id da61e1e99e5b8fa3fde54350d6b6c81773a5ba74d712e1de0e2ccdfd884a9aee
Jul 06 20:10:56.136058 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:56.136020    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m" event={"ID":"7bd49844-87fc-4ff2-ba91-1925bb872dfb","Type":"ContainerStarted","Data":"3c1626326b566628f9dc96d2b8e6790dfa9209bad2e4483997ccb41368b4f832"}
Jul 06 20:10:56.136427 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:56.136066    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m" event={"ID":"7bd49844-87fc-4ff2-ba91-1925bb872dfb","Type":"ContainerStarted","Data":"da61e1e99e5b8fa3fde54350d6b6c81773a5ba74d712e1de0e2ccdfd884a9aee"}
Jul 06 20:10:56.136427 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:56.136155    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:10:56.179747 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:56.179701    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m" podStartSLOduration=1.1796875390000001 podStartE2EDuration="1.179687539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:56.178862192 +0000 UTC m=+2695.105900109" watchObservedRunningTime="2026-07-06 20:10:56.179687539 +0000 UTC m=+2695.106725456"
Jul 06 20:10:57.067844 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:57.067818    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-d6rnw_bd16a3a6-90a8-4287-af60-88edfc4cf9df/networking-console-plugin/0.log"
Jul 06 20:10:57.726817 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:57.726792    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:10:57.732283 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:10:57.732250    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/2.log"
Jul 06 20:11:00.596545 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:00.596516    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qv4m2_5009aab8-4943-42c6-ad20-fa8f21bfde30/dns/0.log"
Jul 06 20:11:00.640631 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:00.640603    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qv4m2_5009aab8-4943-42c6-ad20-fa8f21bfde30/kube-rbac-proxy/0.log"
Jul 06 20:11:00.725941 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:00.725917    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ttfp_9780e3f9-889b-4b83-8570-f5bff19af292/dns-node-resolver/0.log"
Jul 06 20:11:01.377692 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:01.377641    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74f4778987-szc7j_24c115c9-c3a7-41b3-8d39-fc7852a79a94/registry/0.log"
Jul 06 20:11:01.387838 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:01.387015    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74f4778987-szc7j_24c115c9-c3a7-41b3-8d39-fc7852a79a94/registry/1.log"
Jul 06 20:11:01.497973 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:01.497904    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfk8t_02c0ed33-d2dd-4667-82be-a1db58dc12a3/node-ca/0.log"
Jul 06 20:11:01.766291 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:01.766265    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:11:01.772596 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:01.772573    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-k9njh_d1412b6e-e12b-40f1-9bc2-aff67c564af7/console-operator/1.log"
Jul 06 20:11:02.150218 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:02.150147    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-pgw2m"
Jul 06 20:11:02.658254 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:02.658219    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ctv49_f1dc92a1-adcd-4055-b16d-4e3476722302/discovery/0.log"
Jul 06 20:11:02.873363 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:02.873328    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qhpnl_9b603e00-1641-4fd6-92e0-c2a5c0a75b36/payload-pre-processing/0.log"
Jul 06 20:11:02.932182 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:02.932101    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvfxf_929c2e44-6900-4553-bb4a-7017a9c9038a/payload-processing/0.log"
Jul 06 20:11:03.881745 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:03.881714    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5nv5w_89c50d5c-b643-491f-9ab2-c2edc871fda6/serve-healthcheck-canary/0.log"
Jul 06 20:11:04.763744 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:04.763717    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-297nl_6e456d65-8100-4074-a932-7a3747160f8a/kube-rbac-proxy/0.log"
Jul 06 20:11:04.804659 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:04.804633    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-297nl_6e456d65-8100-4074-a932-7a3747160f8a/exporter/0.log"
Jul 06 20:11:04.851576 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:04.851553    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-297nl_6e456d65-8100-4074-a932-7a3747160f8a/extractor/0.log"
Jul 06 20:11:06.059334 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:06.059307    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ctv49_f1dc92a1-adcd-4055-b16d-4e3476722302/discovery/0.log"
Jul 06 20:11:06.187777 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:06.187747    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qhpnl_9b603e00-1641-4fd6-92e0-c2a5c0a75b36/payload-pre-processing/0.log"
Jul 06 20:11:06.234324 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:06.234297    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvfxf_929c2e44-6900-4553-bb4a-7017a9c9038a/payload-processing/0.log"
Jul 06 20:11:07.674341 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:07.674298    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ctv49_f1dc92a1-adcd-4055-b16d-4e3476722302/discovery/0.log"
Jul 06 20:11:07.796248 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:07.796217    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6bcbb57667-sgfvb_cd67f99e-0e56-491b-ae16-8aa371530dd6/maas-api/0.log"
Jul 06 20:11:07.849057 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:07.849034    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qhpnl_9b603e00-1641-4fd6-92e0-c2a5c0a75b36/payload-pre-processing/0.log"
Jul 06 20:11:07.900243 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:07.900219    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvfxf_929c2e44-6900-4553-bb4a-7017a9c9038a/payload-processing/0.log"
Jul 06 20:11:07.943582 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:07.943561    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f4c455986-756xq_5f2e6839-4197-4412-a76c-8a13c22aa4b5/manager/1.log"
Jul 06 20:11:08.012877 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:08.012857    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f4c455986-756xq_5f2e6839-4197-4412-a76c-8a13c22aa4b5/manager/2.log"
Jul 06 20:11:08.455563 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:08.455535    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-hhjk6_a0b8268c-80c2-4629-9123-ad0dca8c1493/manager/0.log"
Jul 06 20:11:08.496799 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:08.496778    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-hhjk6_a0b8268c-80c2-4629-9123-ad0dca8c1493/copy-manifests/0.log"
Jul 06 20:11:08.542232 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:08.542213    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vhz2w_e879fa8b-2fda-4927-8501-f1b7c3ff7a35/postgres/0.log"
Jul 06 20:11:09.913650 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:09.913624    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c85d89ddf-gzq9h_13f09753-357e-4368-a2a7-6410dc44c757/manager/1.log"
Jul 06 20:11:09.914177 ip-10-0-140-61 kubenswrapper[2552]: I0706 20:11:09.914010    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c85d89ddf-gzq9h_13f09753-357e-4368-a2a7-6410dc44c757/manager/0.log"