Jul 02 21:36:00.869619 ip-10-0-139-133 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 21:36:01.317558 ip-10-0-139-133 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:36:01.317558 ip-10-0-139-133 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 21:36:01.317558 ip-10-0-139-133 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:36:01.317558 ip-10-0-139-133 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 21:36:01.317558 ip-10-0-139-133 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:36:01.320190 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.320077    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 21:36:01.324867 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324848    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:36:01.324867 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324867    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324871    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324874    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324878    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324881    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324886    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324889    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324893    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324896    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324899    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324903    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324906    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324909    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324912    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324915    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324919    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324922    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324925    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324928    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324931    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:36:01.324942 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324934    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324937    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324939    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324942    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324945    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324948    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324951    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324954    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324957    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324960    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324963    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324966    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324969    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324972    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324975    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324978    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324980    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324984    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324986    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324989    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:36:01.325576 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324991    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324994    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324997    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.324999    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325002    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325004    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325007    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325010    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325012    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325015    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325018    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325021    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325023    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325026    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325029    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325032    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325035    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325039    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325042    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325045    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:36:01.326357 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325047    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325050    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325053    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325101    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325162    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325169    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325174    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325180    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325184    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325189    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325192    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325195    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325199    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325201    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325209    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325217    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325221    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325240    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.325249    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:36:01.327150 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326686    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326838    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326853    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326859    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326865    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326870    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326876    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326881    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326885    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326894    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326901    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326907    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326911    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326916    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326921    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326925    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326930    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326936    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:36:01.328019 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.326941    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328354    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328366    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328372    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328377    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328383    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328388    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328392    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328396    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328401    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328405    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328410    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328414    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328419    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328424    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328435    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328440    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328444    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328448    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328453    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:36:01.328855 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328457    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328462    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328466    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328471    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328476    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328481    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328485    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328489    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328494    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328498    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328502    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328507    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328512    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328516    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328522    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328528    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328532    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328537    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328541    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328546    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:36:01.329798 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328550    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328556    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328563    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328569    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328574    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328579    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328585    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328590    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328596    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328601    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328606    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328611    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328615    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328620    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328625    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328630    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328635    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328640    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328644    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:36:01.330806 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328652    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328656    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328661    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328665    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328670    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328675    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328679    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328684    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328689    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328694    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328698    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328703    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328709    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328715    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328719    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328723    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328728    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328733    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328738    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328742    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:36:01.331717 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328747    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328751    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328756    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328762    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328767    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328772    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328779    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328785    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328792    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328798    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328803    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328808    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328815    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328820    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328825    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328830    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328835    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328839    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328844    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:36:01.332328 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328849    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.328855    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329558    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329568    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329574    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329579    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329584    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329588    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329593    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329597    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329602    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329607    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329613    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329617    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329622    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329626    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329632    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329637    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329641    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329647    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:36:01.332921 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329654    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329661    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329665    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329669    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329674    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329682    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329686    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329691    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329695    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329700    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329704    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329709    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329717    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329723    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329728    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329734    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329739    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329743    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329748    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329752    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:36:01.333566 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329757    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329762    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329766    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329771    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329775    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329780    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329784    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329789    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329793    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329798    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329802    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329807    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329811    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329815    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329819    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329824    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329828    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329833    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329837    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:36:01.334242 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329842    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329846    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329851    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329855    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329860    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329865    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329870    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329874    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329879    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329884    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329888    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329893    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329897    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329902    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329906    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329911    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329915    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329920    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329924    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329929    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:36:01.334748 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329934    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329938    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329942    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329948    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329952    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329956    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329961    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329967    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329974    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329980    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329985    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329990    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329994    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.329998    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330003    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330008    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330013    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330018    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330022    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:36:01.335337 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330027    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330032    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.330036    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330150    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330162    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330172    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330179    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330187    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330192    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330200    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330207    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330213    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330218    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330224    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330255    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330262    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330268    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330279    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330284    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330289    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330294    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330302    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330306    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 21:36:01.335845 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330312    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330318    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330323    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330336    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330341    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330347    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330354    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330359    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330365    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330369    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330375    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330380    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330387    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330393    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330399    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330405    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330411    2571 flags.go:64] FLAG: --enable-server="true"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330417    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330425    2571 flags.go:64] FLAG: --event-burst="100"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330430    2571 flags.go:64] FLAG: --event-qps="50"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330435    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330440    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330445    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330453    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 21:36:01.336467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330458    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330463    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330469    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330475    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330480    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330485    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330490    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330495    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330500    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330505    2571 flags.go:64] FLAG: --feature-gates=""
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330511    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330517    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330522    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330527    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330533    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330538    2571 flags.go:64] FLAG: --help="false"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330544    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330549    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330554    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330559    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330566    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330572    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330577    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 21:36:01.337066 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330581    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330586    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330591    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330596    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330603    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330607    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330613    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330618    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330627    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330633    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330638    2571 flags.go:64] FLAG: --lock-file=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330643    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330648    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330655    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330665    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330670    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330675    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330680    2571 flags.go:64] FLAG: --logging-format="text"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330684    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330690    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330696    2571 flags.go:64] FLAG: --manifest-url=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330700    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330708    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330714    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330722    2571 flags.go:64] FLAG: --max-pods="110"
Jul 02 21:36:01.337735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330728    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330734    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330738    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330743    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330748    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330754    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330759    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330771    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330776    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330782    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330788    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330793    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330802    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330807    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330812    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330820    2571 flags.go:64] FLAG: --port="10250"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330825    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330830    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ca97a3880ba2165"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330835    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330840    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330846    2571 flags.go:64] FLAG: --register-node="true"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330852    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330863    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330868    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 02 21:36:01.338525 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330873    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330878    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330885    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330890    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330895    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330900    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330905    2571 flags.go:64] FLAG: --runonce="false"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330911    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330917    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330922    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330927    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330932    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330938    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330944    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330949    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330954    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330959    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330964    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330970    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330975    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330980    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330985    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.330994    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331001    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331007    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 21:36:01.339266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331015    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331019    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331025    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331030    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331037    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331043    2571 flags.go:64] FLAG: --v="2"
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331050    2571 flags.go:64] FLAG: --version="false"
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331057    2571 flags.go:64] FLAG: --vmodule=""
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331063    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.331069    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331297    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331308    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331314    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331320    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331327    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331333    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331338    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331343    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331347    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331352    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331356    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:36:01.339931 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331361    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331366    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331371    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331376    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331381    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331386    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331390    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331395    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331399    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331406    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331411    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331416    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331421    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331425    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331430    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331434    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331439    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331445    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331450    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331454    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:36:01.340507 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331459    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331466    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331471    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331476    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331481    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331485    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331490    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331495    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331499    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331504    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331508    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331513    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331517    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331522    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331527    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331531    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331536    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331540    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331545    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331549    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:36:01.341043 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331554    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331566    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331573    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331579    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331585    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331589    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331594    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331599    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331603    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331608    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331613    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331618    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331622    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331628    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331632    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331637    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331642    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331646    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331651    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:36:01.341632 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331655    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331660    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331665    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331669    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331673    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331677    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331683    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331687    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331692    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331696    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331701    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331705    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331710    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331715    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331722    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331726    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331730    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331734    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331739    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331744    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:36:01.342125 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331748    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331753    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331757    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331763    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331769    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331774    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331780    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331785    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.331790    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.332577    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.340490    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.340509    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.340531    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.340538    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340596    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:36:01.342671 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340603    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340607    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340610    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340613    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340616    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340619    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340623    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340626    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340629    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340631    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340634    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340637    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340640    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340642    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340645    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340649    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340652    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340654    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340657    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340661    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:36:01.343073 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340663    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340667    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340671    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340673    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340676    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340679    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340682    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340685    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340688    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340691    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340694    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340699    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340703    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340706    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340709    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340712    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340715    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340718    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340720    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:36:01.343618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340723    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340726    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340729    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340732    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340734    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340737    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340740    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340742    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340746    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340749    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340752    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340755    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340758    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340769    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340772    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340776    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340779    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340782    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340786    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:36:01.344108 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340790    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340793    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340797    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340800    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340803    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340806    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340809    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340812    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340815    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340818    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340820    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340823    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340826    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340829    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340831    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340834    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340837    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340840    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340843    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340846    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:36:01.344616 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340848    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340853    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340857    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340860    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340863    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340866    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340869    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340872    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340874    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340879    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340882    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340885    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340887    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340890    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340893    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340897    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340900    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340903    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340905    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:36:01.345143 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.340908    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.340914    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341043    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341049    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341053    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341056    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341060    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341064    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341067    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341070    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341074    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341077    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341079    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341082    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:36:01.345746 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341087    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341090    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341093    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341095    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341098    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341101    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341104    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341107    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341109    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341113    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341116    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341119    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341121    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341124    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341127    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341130    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341132    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341135    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341138    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:36:01.346116 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341140    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341143    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341146    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341149    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341151    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341154    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341156    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341159    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341162    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341164    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341167    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341170    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341173    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341177    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341180    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341182    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341185    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341188    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341191    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341193    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:36:01.346647 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341196    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341199    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341201    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341204    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341209    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341212    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341215    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341219    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341222    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341225    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341242    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341245    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341248    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341251    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341253    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341256    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341259    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341262    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341265    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:36:01.347171 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341268    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341271    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341273    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341276    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341279    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341282    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341285    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341287    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341290    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341293    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341296    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341299    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341301    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341304    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341307    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341309    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341312    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341315    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341318    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341321    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:36:01.347677 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341324    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341327    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341330    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341332    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341335    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341338    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341341    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341343    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:01.341346    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.341352    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.341493    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.343780    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.345168    2571 server.go:1019] "Starting client certificate rotation"
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.345282    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 21:36:01.348178 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.346042    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 21:36:01.348705 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.348338    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 21:36:01.350014 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.349993    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 21:36:01.359706 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.359679    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 02 21:36:01.362080 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.362062    2571 log.go:25] "Validated CRI v1 image API"
Jul 02 21:36:01.363848 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.363825    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 21:36:01.366986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.366959    2571 fs.go:135] Filesystem UUIDs: map[195eb7c6-0494-45fc-9be1-363c1de1424d:/dev/nvme0n1p4 61e80548-7e35-4e26-8878-fe49e2d6d31c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 02 21:36:01.367087 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.366982    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 21:36:01.373749 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.373619    2571 manager.go:216] Machine: {Timestamp:2026-07-02 21:36:01.371141497 +0000 UTC m=+0.369061569 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100563 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d341dbe849ca33d3ebe65ac07fbd8 SystemUUID:ec2d341d-be84-9ca3-3d3e-be65ac07fbd8 BootID:9851211b-833b-48da-8b3a-ceee707d9d21 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:64:02:57:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:64:02:57:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:f3:02:94:e9:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 21:36:01.373749 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.373744    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 21:36:01.373873 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.373845    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 21:36:01.377476 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.377448    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 21:36:01.377624 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.377480    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 21:36:01.379074 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.379061    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 21:36:01.379112 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.379078    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 21:36:01.379143 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.379114    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 21:36:01.379143 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.379117    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 21:36:01.379856 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.379840    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 21:36:01.381647 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.381635    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 21:36:01.385998 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.385983    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 21:36:01.386139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386128    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 21:36:01.386171 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386164    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 21:36:01.386200 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386182    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 21:36:01.386246 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386202    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 21:36:01.386246 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386218    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 02 21:36:01.386330 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386247    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 21:36:01.386656 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386644    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 21:36:01.386698 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.386664    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 21:36:01.389148 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.389120    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 21:36:01.391223 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.391204    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 21:36:01.391345 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.391264    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 21:36:01.392443 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392427    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392448    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392459    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392467    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392481    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392489    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392502    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 21:36:01.392519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392510    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 21:36:01.392770 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392522    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 21:36:01.392770 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392532    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 21:36:01.392770 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392545    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 21:36:01.392770 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.392554    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 21:36:01.394139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.394126    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 21:36:01.394197 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.394142    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 21:36:01.397790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.397773    2571 server.go:1268] "Started kubelet"
Jul 02 21:36:01.397980 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.397889    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 21:36:01.398040 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.397969    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 21:36:01.398091 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.398051    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 21:36:01.398535 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.398515    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 21:36:01.398629 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.398530    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 21:36:01.398629 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.398618    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 21:36:01.398879 ip-10-0-139-133 systemd[1]: Started Kubernetes Kubelet.
Jul 02 21:36:01.399739 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.399719    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 21:36:01.405128 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.405104    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 21:36:01.405248 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.405142    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 21:36:01.408333 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.408309    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9p4b"
Jul 02 21:36:01.410382 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.410357    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 21:36:01.410467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.410362    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 21:36:01.410562 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.410540    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:01.411089 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.409968    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18be96aa78a15aa5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-07-02 21:36:01.397742245 +0000 UTC m=+0.395662294,LastTimestamp:2026-07-02 21:36:01.397742245 +0000 UTC m=+0.395662294,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Jul 02 21:36:01.411227 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411179    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 21:36:01.411402 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411361    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 21:36:01.411402 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411392    2571 factory.go:55] Registering systemd factory
Jul 02 21:36:01.411402 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411401    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 21:36:01.411402 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411407    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 02 21:36:01.411635 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411513    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 21:36:01.411635 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411525    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 21:36:01.411733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411639    2571 factory.go:153] Registering CRI-O factory
Jul 02 21:36:01.411733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411656    2571 factory.go:223] Registration of the crio container factory successfully
Jul 02 21:36:01.411733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411713    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 21:36:01.411861 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411741    2571 factory.go:103] Registering Raw factory
Jul 02 21:36:01.411861 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.411758    2571 manager.go:1196] Started watching for new ooms in manager
Jul 02 21:36:01.412497 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.412476    2571 manager.go:349] Starting recovery of all containers
Jul 02 21:36:01.415459 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.415430    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 21:36:01.415578 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.415539    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 21:36:01.417504 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.417482    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9p4b"
Jul 02 21:36:01.423729 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.423709    2571 manager.go:354] Recovery completed
Jul 02 21:36:01.428229 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.428204    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.430151 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430132    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.430224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430165    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.430224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430177    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.430796 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430774    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 21:36:01.430883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430797    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 21:36:01.430883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430825    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 21:36:01.430883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.430832    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.432755 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.432684    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18be96aa7a8fdf8a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-07-02 21:36:01.43015105 +0000 UTC m=+0.428071098,LastTimestamp:2026-07-02 21:36:01.43015105 +0000 UTC m=+0.428071098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Jul 02 21:36:01.433060 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.433042    2571 policy_none.go:49] "None policy: Start"
Jul 02 21:36:01.433060 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.433061    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 21:36:01.433209 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.433072    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 21:36:01.433275 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.433256    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.433326 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.433285    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.433326 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.433295    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.435166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.435149    2571 policy_none.go:47] "Start"
Jul 02 21:36:01.478010 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.477987    2571 manager.go:337] "Starting Device Plugin manager"
Jul 02 21:36:01.478150 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.478035    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 21:36:01.478150 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.478049    2571 server.go:87] "Starting device plugin registration server"
Jul 02 21:36:01.478439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.478423    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 21:36:01.478493 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.478444    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 21:36:01.478539 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.478527    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 21:36:01.478675 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.478659    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 21:36:01.478675 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.478674    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 21:36:01.479280 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.479252    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 21:36:01.479380 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.479319    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:01.580052 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.579970    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.582366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.581082    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.582366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.581117    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.582366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.581132    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.582366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.581186    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.601038 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.601012    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.601150 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.601044    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-133.ec2.internal\": node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:01.603858 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.603813    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 21:36:01.605200 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.605180    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 21:36:01.605299 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.605219    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 21:36:01.605299 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.605245    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 21:36:01.605299 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.605291    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 21:36:01.608084 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.608064    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:36:01.708596 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.708562    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"]
Jul 02 21:36:01.708773 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.708649    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.709763 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.709743    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.709872 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.709775    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.709872 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.709785    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.712378 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.712364    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.712488 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.712472    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.712488 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.712505    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.712946 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.712921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47729380b2e6babaaf740e1f7f2eba87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"47729380b2e6babaaf740e1f7f2eba87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.713055 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.712955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47729380b2e6babaaf740e1f7f2eba87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"47729380b2e6babaaf740e1f7f2eba87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.713215 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.713202    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.713267 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.713247    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.713267 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.713260    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.714473 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.714453    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.714591 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.714485    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.714591 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.714512    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.716864 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.716846    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.716961 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.716882    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:36:01.717633 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.717619    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:36:01.717730 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.717649    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:36:01.717730 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.717664    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:36:01.717907 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.717787    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:01.732943 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.732917    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.737413 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.737391    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.813127 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.813083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47729380b2e6babaaf740e1f7f2eba87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"47729380b2e6babaaf740e1f7f2eba87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.813318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.813124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47729380b2e6babaaf740e1f7f2eba87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"47729380b2e6babaaf740e1f7f2eba87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.813318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.813191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/32ae2d495edd1c172f704b47a293daec-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"32ae2d495edd1c172f704b47a293daec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.813318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.813252    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47729380b2e6babaaf740e1f7f2eba87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"47729380b2e6babaaf740e1f7f2eba87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.813318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.813275    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47729380b2e6babaaf740e1f7f2eba87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"47729380b2e6babaaf740e1f7f2eba87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.818654 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.818631    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:01.913424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.913331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/32ae2d495edd1c172f704b47a293daec-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"32ae2d495edd1c172f704b47a293daec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.913424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:01.913392    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/32ae2d495edd1c172f704b47a293daec-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"32ae2d495edd1c172f704b47a293daec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:01.918759 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:01.918717    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.019827 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.019784    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.037137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.037095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:02.040851 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.040823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:02.120030 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.119986    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.220732 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.220651    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.320939 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.320898    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.345108 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.345081    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 21:36:02.345310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.345290    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 21:36:02.421598 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.421572    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.421598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.421560    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:31:01 +0000 UTC" deadline="2028-03-25 20:46:52.122700498 +0000 UTC"
Jul 02 21:36:02.421790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.421608    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15167h10m49.701098599s"
Jul 02 21:36:02.522471 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.522394    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.564951 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.564927    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:36:02.590989 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.590959    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:36:02.623318 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.623288    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.702188 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:02.702130    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ae2d495edd1c172f704b47a293daec.slice/crio-d3e6dcbf641a39e19ccfabb6f137add69ccaf70babd3217490338f4cf9d9702e WatchSource:0}: Error finding container d3e6dcbf641a39e19ccfabb6f137add69ccaf70babd3217490338f4cf9d9702e: Status 404 returned error can't find the container with id d3e6dcbf641a39e19ccfabb6f137add69ccaf70babd3217490338f4cf9d9702e
Jul 02 21:36:02.703216 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:02.703194    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47729380b2e6babaaf740e1f7f2eba87.slice/crio-d51a27069863b9bd5b25482d3ab87293cdda392e60c63cc1995bd249da6f2e2a WatchSource:0}: Error finding container d51a27069863b9bd5b25482d3ab87293cdda392e60c63cc1995bd249da6f2e2a: Status 404 returned error can't find the container with id d51a27069863b9bd5b25482d3ab87293cdda392e60c63cc1995bd249da6f2e2a
Jul 02 21:36:02.707557 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.707538    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:36:02.723570 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.723532    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.824204 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.824069    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.924959 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:02.924915    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Jul 02 21:36:02.941663 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:02.941641    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:36:03.012388 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.012352    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:03.022759 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.022737    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 21:36:03.023809 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.023795    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Jul 02 21:36:03.034368 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.034344    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 21:36:03.279523 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.279432    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:36:03.387338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.387305    2571 apiserver.go:52] "Watching apiserver"
Jul 02 21:36:03.397217 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.397179    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 21:36:03.398226 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.398166    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-klc95","openshift-ovn-kubernetes/ovnkube-node-p4k2z","kube-system/global-pull-secret-syncer-6xm9s","kube-system/konnectivity-agent-rxwdf","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x84mq","openshift-dns/node-resolver-bndfl","openshift-image-registry/node-ca-rmmlm","openshift-multus/multus-wn2p8","openshift-network-diagnostics/network-check-target-2wwfp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","openshift-multus/multus-additional-cni-plugins-tx4kd","openshift-multus/network-metrics-daemon-zc8td"]
Jul 02 21:36:03.401246 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.401207    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.403656 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.403569    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.403786 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.403773    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.403850 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.403826    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.404451 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.404428    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vt796\""
Jul 02 21:36:03.407851 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.407829    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.408102 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.408051    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mjpkf\""
Jul 02 21:36:03.408266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.408227    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.408357 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.408331    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:03.408660 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.408639    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.408779 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.408764    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 21:36:03.408879 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.408863    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.410984 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.410960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:03.411086 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.411035    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:03.411157 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.411097    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 21:36:03.412401 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.412380    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnsz7\""
Jul 02 21:36:03.412494 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.412435    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 21:36:03.413407 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.413388    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.413491 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.413454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 21:36:03.415545 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.415522    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.416862 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.416838    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.416965 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.416949    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cbgxj\""
Jul 02 21:36:03.417168 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.417150    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.419400 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.419381    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.419946 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.419925    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.420030 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.419989    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.420030 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.419925    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 21:36:03.420180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.420163    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 21:36:03.420707 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.420681    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w5cf9\""
Jul 02 21:36:03.421563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.421544    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.422615 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.422597    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 21:36:03.422801 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.422786    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 21:36:03.424963 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.424941    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:03.425083 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.425058    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:03.425710 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425690    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 21:36:03.425797 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425708    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.425797 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425745    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-sys-fs\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.425797 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425792    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-host\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.425959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425818    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-tmp\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.425959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/46ded035-79e8-4c40-87de-9bab0965336e-hosts-file\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.425959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.425959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-kubernetes\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.425959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425922    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-var-lib-kubelet\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.425959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l99ht\" (UniqueName: \"kubernetes.io/projected/46ded035-79e8-4c40-87de-9bab0965336e-kube-api-access-l99ht\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-socket-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.425998    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysctl-conf\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47776b6a-6004-4f70-a8fc-9339ebba8a9c-kubelet-config\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-tuned\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426123    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 21:36:03.426289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426244    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wr2tc\""
Jul 02 21:36:03.426637 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426484    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 21:36:03.426637 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426496    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.426735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-registration-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.426735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r27qz\" (UniqueName: \"kubernetes.io/projected/07fb91f4-a56f-4013-837c-400eb9faeab0-kube-api-access-r27qz\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.426735 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426730    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 21:36:03.426898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426733    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-systemd\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.426898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-run\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.426898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4r2m\" (UniqueName: \"kubernetes.io/projected/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-kube-api-access-q4r2m\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.426898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.426882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.427428 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427403    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lv45z\""
Jul 02 21:36:03.427628 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.427772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/241b0783-6b39-4256-a74a-91afbd1950f1-konnectivity-ca\") pod \"konnectivity-agent-rxwdf\" (UID: \"241b0783-6b39-4256-a74a-91afbd1950f1\") " pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.427847 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-lib-modules\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.427907 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427865    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-device-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.427907 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/241b0783-6b39-4256-a74a-91afbd1950f1-agent-certs\") pod \"konnectivity-agent-rxwdf\" (UID: \"241b0783-6b39-4256-a74a-91afbd1950f1\") " pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.428012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjnkk\" (UniqueName: \"kubernetes.io/projected/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-kube-api-access-hjnkk\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:03.428012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.427963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-modprobe-d\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.428115 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.428021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysconfig\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.428115 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.428045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-sys\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.428115 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.428087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ded035-79e8-4c40-87de-9bab0965336e-tmp-dir\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.428297 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.428115    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47776b6a-6004-4f70-a8fc-9339ebba8a9c-dbus\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.428297 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.428141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:03.428297 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.428190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysctl-d\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.429946 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.429926    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.430040 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.430010    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.430397 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.430378    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.430740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.430723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 21:36:03.430936 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.430888    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2skp\""
Jul 02 21:36:03.435607 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.435556    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 21:36:03.435607 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.435591    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jh89m\""
Jul 02 21:36:03.435743 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.435630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 21:36:03.435743 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.435649    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 21:36:03.443338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.443311    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 21:36:03.480446 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.480419    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ktpkm"
Jul 02 21:36:03.494145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.494078    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ktpkm"
Jul 02 21:36:03.513119 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.513092    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 21:36:03.528960 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.528910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4dp5\" (UniqueName: \"kubernetes.io/projected/2a863c86-f513-4fff-9402-d63252872752-kube-api-access-t4dp5\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.528960 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.528958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-ovnkube-config\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.529177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.528986    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-os-release\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.529177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529025    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-socket-dir-parent\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.529177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-hostroot\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.529177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5pf\" (UniqueName: \"kubernetes.io/projected/d164b23f-6290-4f3e-9199-b583850e1d39-kube-api-access-zq5pf\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.529177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529121    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-sys-fs\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.529177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529151    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-tmp\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.529490 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529231    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-sys-fs\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.529490 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.529490 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529310    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-ovnkube-script-lib\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.529490 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.529429    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.529500    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:36:04.029476377 +0000 UTC m=+3.027396429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-system-cni-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529532    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-cni-multus\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-kubernetes\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kktpg\" (UniqueName: \"kubernetes.io/projected/e121c982-1a32-41ea-ac76-4188c86516e7-kube-api-access-kktpg\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-etc-kubernetes\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.529719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47776b6a-6004-4f70-a8fc-9339ebba8a9c-kubelet-config\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529745    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-kubernetes\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a863c86-f513-4fff-9402-d63252872752-serviceca\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-slash\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgcdk\" (UniqueName: \"kubernetes.io/projected/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-kube-api-access-lgcdk\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529852    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47776b6a-6004-4f70-a8fc-9339ebba8a9c-kubelet-config\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-k8s-cni-cncf-io\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529929    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-conf-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.529992    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-run\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4r2m\" (UniqueName: \"kubernetes.io/projected/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-kube-api-access-q4r2m\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530085    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-run\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/241b0783-6b39-4256-a74a-91afbd1950f1-konnectivity-ca\") pod \"konnectivity-agent-rxwdf\" (UID: \"241b0783-6b39-4256-a74a-91afbd1950f1\") " pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.530166 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-kubelet\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-kubelet\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530222    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-daemon-config\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6sln\" (UniqueName: \"kubernetes.io/projected/2aef917f-6420-4954-816a-ef85fdd6c61d-kube-api-access-s6sln\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530221    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-lib-modules\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-device-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-cni-netd\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2aef917f-6420-4954-816a-ef85fdd6c61d-cni-binary-copy\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-os-release\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-cni-binary-copy\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530593    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-modprobe-d\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysconfig\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-sys\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47776b6a-6004-4f70-a8fc-9339ebba8a9c-dbus\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.530986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-node-log\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-log-socket\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530791    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-cnibin\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530821    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/241b0783-6b39-4256-a74a-91afbd1950f1-konnectivity-ca\") pod \"konnectivity-agent-rxwdf\" (UID: \"241b0783-6b39-4256-a74a-91afbd1950f1\") " pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530855    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a863c86-f513-4fff-9402-d63252872752-host\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530881    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e121c982-1a32-41ea-ac76-4188c86516e7-ovn-node-metrics-cert\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-host\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.530997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/46ded035-79e8-4c40-87de-9bab0965336e-hosts-file\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-cni-bin\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-system-cni-dir\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-env-overrides\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-var-lib-kubelet\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l99ht\" (UniqueName: \"kubernetes.io/projected/46ded035-79e8-4c40-87de-9bab0965336e-kube-api-access-l99ht\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-socket-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-var-lib-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.531843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531280    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-multus-certs\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysctl-conf\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531320    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-lib-modules\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-run-netns\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531433    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-device-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531466    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysconfig\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531478    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-sys\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-ovn\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-iptables-alerter-script\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.531555    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-tuned\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-registration-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.531656    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:04.031638632 +0000 UTC m=+3.029558673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r27qz\" (UniqueName: \"kubernetes.io/projected/07fb91f4-a56f-4013-837c-400eb9faeab0-kube-api-access-r27qz\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531691    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-registration-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.532704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531739    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-host\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-netns\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-systemd\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-systemd-units\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-systemd\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531838    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47776b6a-6004-4f70-a8fc-9339ebba8a9c-dbus\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-host-slash\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531947    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-socket-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.531994    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/46ded035-79e8-4c40-87de-9bab0965336e-hosts-file\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-cni-bin\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/241b0783-6b39-4256-a74a-91afbd1950f1-agent-certs\") pod \"konnectivity-agent-rxwdf\" (UID: \"241b0783-6b39-4256-a74a-91afbd1950f1\") " pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532304    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-var-lib-kubelet\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532307    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07fb91f4-a56f-4013-837c-400eb9faeab0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532312    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjnkk\" (UniqueName: \"kubernetes.io/projected/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-kube-api-access-hjnkk\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532451    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-modprobe-d\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532496    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-systemd\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.533590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532503    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysctl-conf\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ded035-79e8-4c40-87de-9bab0965336e-tmp-dir\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-etc-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532807    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-cni-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-cnibin\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.532876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysctl-d\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.533035    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-sysctl-d\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.533084    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ded035-79e8-4c40-87de-9bab0965336e-tmp-dir\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.534598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.533745    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-tmp\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.535000 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.534611    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-etc-tuned\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.537258 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.537212    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/241b0783-6b39-4256-a74a-91afbd1950f1-agent-certs\") pod \"konnectivity-agent-rxwdf\" (UID: \"241b0783-6b39-4256-a74a-91afbd1950f1\") " pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.545380 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.545336    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4r2m\" (UniqueName: \"kubernetes.io/projected/30f563db-dbb7-4fee-bdc7-5d1ebf044a39-kube-api-access-q4r2m\") pod \"tuned-x84mq\" (UID: \"30f563db-dbb7-4fee-bdc7-5d1ebf044a39\") " pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.546578 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.546542    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjnkk\" (UniqueName: \"kubernetes.io/projected/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-kube-api-access-hjnkk\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:03.546685 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.546668    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l99ht\" (UniqueName: \"kubernetes.io/projected/46ded035-79e8-4c40-87de-9bab0965336e-kube-api-access-l99ht\") pod \"node-resolver-bndfl\" (UID: \"46ded035-79e8-4c40-87de-9bab0965336e\") " pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.549374 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.549310    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r27qz\" (UniqueName: \"kubernetes.io/projected/07fb91f4-a56f-4013-837c-400eb9faeab0-kube-api-access-r27qz\") pod \"aws-ebs-csi-driver-node-5gvt5\" (UID: \"07fb91f4-a56f-4013-837c-400eb9faeab0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.611761 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.611700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"47729380b2e6babaaf740e1f7f2eba87","Type":"ContainerStarted","Data":"d51a27069863b9bd5b25482d3ab87293cdda392e60c63cc1995bd249da6f2e2a"}
Jul 02 21:36:03.613764 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.613700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"32ae2d495edd1c172f704b47a293daec","Type":"ContainerStarted","Data":"d3e6dcbf641a39e19ccfabb6f137add69ccaf70babd3217490338f4cf9d9702e"}
Jul 02 21:36:03.633545 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-log-socket\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633545 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-cnibin\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633576    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a863c86-f513-4fff-9402-d63252872752-host\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633593    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e121c982-1a32-41ea-ac76-4188c86516e7-ovn-node-metrics-cert\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-cni-bin\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-system-cni-dir\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-env-overrides\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-var-lib-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-multus-certs\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-run-netns\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-ovn\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-iptables-alerter-script\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.633804 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-netns\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-systemd-units\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-systemd\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-host-slash\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-cni-bin\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-etc-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.633999    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-cni-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-cnibin\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4dp5\" (UniqueName: \"kubernetes.io/projected/2a863c86-f513-4fff-9402-d63252872752-kube-api-access-t4dp5\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-ovnkube-config\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634086    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-run-netns\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-os-release\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-socket-dir-parent\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634158    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-hostroot\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634177    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-log-socket\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5pf\" (UniqueName: \"kubernetes.io/projected/d164b23f-6290-4f3e-9199-b583850e1d39-kube-api-access-zq5pf\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.634498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634249    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-cnibin\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-ovnkube-script-lib\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-system-cni-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-cni-multus\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634365    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kktpg\" (UniqueName: \"kubernetes.io/projected/e121c982-1a32-41ea-ac76-4188c86516e7-kube-api-access-kktpg\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-etc-kubernetes\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a863c86-f513-4fff-9402-d63252872752-serviceca\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-slash\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgcdk\" (UniqueName: \"kubernetes.io/projected/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-kube-api-access-lgcdk\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634521    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634581    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a863c86-f513-4fff-9402-d63252872752-host\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634585    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-k8s-cni-cncf-io\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634663    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634712    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-netns\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634758    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-systemd-units\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634803    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-systemd\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634849    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-host-slash\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.635359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634889    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-cni-bin\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634534    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-k8s-cni-cncf-io\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634909    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-ovnkube-script-lib\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634965    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-cni-multus\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.635572    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-conf-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.635655    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-cni-bin\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.635661    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-etc-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.635732    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-cnibin\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.635805    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-cni-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.635988    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636058    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-os-release\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636145    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-socket-dir-parent\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636224 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636203    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-hostroot\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636808 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636334    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-etc-kubernetes\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636808 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636386    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-ovnkube-config\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.636808 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636459    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-slash\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.636808 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.634964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-conf-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.636808 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.636768    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a863c86-f513-4fff-9402-d63252872752-serviceca\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.637045 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637026    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-run-ovn\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637165 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637140    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-system-cni-dir\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.637259 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:03.637317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-kubelet\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-kubelet\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.637413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637311    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-iptables-alerter-script\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.637413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-daemon-config\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.637413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6sln\" (UniqueName: \"kubernetes.io/projected/2aef917f-6420-4954-816a-ef85fdd6c61d-kube-api-access-s6sln\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.637413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-cni-netd\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637601 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2aef917f-6420-4954-816a-ef85fdd6c61d-cni-binary-copy\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.637601 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-os-release\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.637601 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-cni-binary-copy\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.637601 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637540    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.637601 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637558    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e121c982-1a32-41ea-ac76-4188c86516e7-env-overrides\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637601 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.637876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637621    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-node-log\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637653    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-var-lib-openvswitch\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637739    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.637876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637798    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-run-multus-certs\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.637876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637816    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e121c982-1a32-41ea-ac76-4188c86516e7-ovn-node-metrics-cert\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.637876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637857    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-cni-netd\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.638202 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.637898    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-host-var-lib-kubelet\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.638202 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638043    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-node-log\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.638202 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638113    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2aef917f-6420-4954-816a-ef85fdd6c61d-system-cni-dir\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.638387 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638358    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.638555 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638397    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-cni-binary-copy\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.638555 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d164b23f-6290-4f3e-9199-b583850e1d39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.638719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638583    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d164b23f-6290-4f3e-9199-b583850e1d39-os-release\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.638719 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638600    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e121c982-1a32-41ea-ac76-4188c86516e7-host-kubelet\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.638868 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638732    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2aef917f-6420-4954-816a-ef85fdd6c61d-cni-binary-copy\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.638942 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.638863    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2aef917f-6420-4954-816a-ef85fdd6c61d-multus-daemon-config\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.645598 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.645573    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:03.645598 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.645601    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:03.645800 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.645616    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:03.645800 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:03.645691    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:04.145671568 +0000 UTC m=+3.143591610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:03.649855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.649784    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6sln\" (UniqueName: \"kubernetes.io/projected/2aef917f-6420-4954-816a-ef85fdd6c61d-kube-api-access-s6sln\") pod \"multus-wn2p8\" (UID: \"2aef917f-6420-4954-816a-ef85fdd6c61d\") " pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.650045 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.650018    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5pf\" (UniqueName: \"kubernetes.io/projected/d164b23f-6290-4f3e-9199-b583850e1d39-kube-api-access-zq5pf\") pod \"multus-additional-cni-plugins-tx4kd\" (UID: \"d164b23f-6290-4f3e-9199-b583850e1d39\") " pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.652893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.652228    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4dp5\" (UniqueName: \"kubernetes.io/projected/2a863c86-f513-4fff-9402-d63252872752-kube-api-access-t4dp5\") pod \"node-ca-rmmlm\" (UID: \"2a863c86-f513-4fff-9402-d63252872752\") " pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.652893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.652377    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kktpg\" (UniqueName: \"kubernetes.io/projected/e121c982-1a32-41ea-ac76-4188c86516e7-kube-api-access-kktpg\") pod \"ovnkube-node-p4k2z\" (UID: \"e121c982-1a32-41ea-ac76-4188c86516e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.653410 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.653386    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgcdk\" (UniqueName: \"kubernetes.io/projected/06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3-kube-api-access-lgcdk\") pod \"iptables-alerter-klc95\" (UID: \"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3\") " pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.721038 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.721000    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bndfl"
Jul 02 21:36:03.729333 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.729305    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5"
Jul 02 21:36:03.731204 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.731183    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ded035_79e8_4c40_87de_9bab0965336e.slice/crio-4da1af2555c8b10f5b3f26df7b9bd676193872e2381799eda71322deba90eb19 WatchSource:0}: Error finding container 4da1af2555c8b10f5b3f26df7b9bd676193872e2381799eda71322deba90eb19: Status 404 returned error can't find the container with id 4da1af2555c8b10f5b3f26df7b9bd676193872e2381799eda71322deba90eb19
Jul 02 21:36:03.739668 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.739638    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fb91f4_a56f_4013_837c_400eb9faeab0.slice/crio-e75098391ce329d1fb7c0773b4da9a33dc5c32edd67ab9c8396b6212cdbbc5f1 WatchSource:0}: Error finding container e75098391ce329d1fb7c0773b4da9a33dc5c32edd67ab9c8396b6212cdbbc5f1: Status 404 returned error can't find the container with id e75098391ce329d1fb7c0773b4da9a33dc5c32edd67ab9c8396b6212cdbbc5f1
Jul 02 21:36:03.743783 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.743759    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:03.749277 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.749209    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x84mq"
Jul 02 21:36:03.754269 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.754240    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241b0783_6b39_4256_a74a_91afbd1950f1.slice/crio-db266ad0ae9abe758fd1aa72eb567a6dfcaeac2b24f0700990e36678c9702f1d WatchSource:0}: Error finding container db266ad0ae9abe758fd1aa72eb567a6dfcaeac2b24f0700990e36678c9702f1d: Status 404 returned error can't find the container with id db266ad0ae9abe758fd1aa72eb567a6dfcaeac2b24f0700990e36678c9702f1d
Jul 02 21:36:03.758465 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.758444    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wn2p8"
Jul 02 21:36:03.758863 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.758830    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f563db_dbb7_4fee_bdc7_5d1ebf044a39.slice/crio-d967a96678162b2ffdcfbc8ea723dfa4fe6c86eb407516de1f81ab344015436c WatchSource:0}: Error finding container d967a96678162b2ffdcfbc8ea723dfa4fe6c86eb407516de1f81ab344015436c: Status 404 returned error can't find the container with id d967a96678162b2ffdcfbc8ea723dfa4fe6c86eb407516de1f81ab344015436c
Jul 02 21:36:03.766748 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.766721    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tx4kd"
Jul 02 21:36:03.769420 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.769392    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aef917f_6420_4954_816a_ef85fdd6c61d.slice/crio-3626aa1323621b088947cfed35dc5f4a57a1191e1b5176f3e6306ddd41d9dc14 WatchSource:0}: Error finding container 3626aa1323621b088947cfed35dc5f4a57a1191e1b5176f3e6306ddd41d9dc14: Status 404 returned error can't find the container with id 3626aa1323621b088947cfed35dc5f4a57a1191e1b5176f3e6306ddd41d9dc14
Jul 02 21:36:03.777321 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.777289    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:03.777639 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.777614    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd164b23f_6290_4f3e_9199_b583850e1d39.slice/crio-fa205029c635a1568351fe93cb77c621640cdd3de1f3f886a8eb2c2e34c8c956 WatchSource:0}: Error finding container fa205029c635a1568351fe93cb77c621640cdd3de1f3f886a8eb2c2e34c8c956: Status 404 returned error can't find the container with id fa205029c635a1568351fe93cb77c621640cdd3de1f3f886a8eb2c2e34c8c956
Jul 02 21:36:03.787692 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.787663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klc95"
Jul 02 21:36:03.790002 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.789968    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode121c982_1a32_41ea_ac76_4188c86516e7.slice/crio-5f462a833e93b90ac96202add06a8965a6fc2e9ecdd8010f463b53f6c8e68176 WatchSource:0}: Error finding container 5f462a833e93b90ac96202add06a8965a6fc2e9ecdd8010f463b53f6c8e68176: Status 404 returned error can't find the container with id 5f462a833e93b90ac96202add06a8965a6fc2e9ecdd8010f463b53f6c8e68176
Jul 02 21:36:03.796747 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:03.796717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rmmlm"
Jul 02 21:36:03.799923 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.799898    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bff8ec_f05b_4d51_b9f4_ad6c98eea6a3.slice/crio-de231f71d0799c2a35e96950c6be36eeacc4158aade92799b769a130ab87c81b WatchSource:0}: Error finding container de231f71d0799c2a35e96950c6be36eeacc4158aade92799b769a130ab87c81b: Status 404 returned error can't find the container with id de231f71d0799c2a35e96950c6be36eeacc4158aade92799b769a130ab87c81b
Jul 02 21:36:03.807274 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:03.807238    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a863c86_f513_4fff_9402_d63252872752.slice/crio-e51c122283ce89958ddef3d07094ce7415d1cddeda7f525c4db4fec23191d9ea WatchSource:0}: Error finding container e51c122283ce89958ddef3d07094ce7415d1cddeda7f525c4db4fec23191d9ea: Status 404 returned error can't find the container with id e51c122283ce89958ddef3d07094ce7415d1cddeda7f525c4db4fec23191d9ea
Jul 02 21:36:04.040714 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.040626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:04.040714 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.040697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:04.040933 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.040832    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:04.040933 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.040916    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:05.04089488 +0000 UTC m=+4.038814918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:04.041060 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.040835    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:04.041060 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.040999    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:36:05.040985138 +0000 UTC m=+4.038905174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:04.242436 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.242393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:04.242652 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.242627    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:04.242730 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.242664    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:04.242730 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.242679    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:04.242871 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.242753    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:05.242731586 +0000 UTC m=+4.240651637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:04.498155 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.498060    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:31:03 +0000 UTC" deadline="2028-02-29 15:46:04.27691363 +0000 UTC"
Jul 02 21:36:04.498155 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.498103    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14562h9m59.77881603s"
Jul 02 21:36:04.606560 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.606526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:04.606761 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.606580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:04.606761 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.606674    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:04.606878 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:04.606838    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:04.618666 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.618580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerStarted","Data":"fa205029c635a1568351fe93cb77c621640cdd3de1f3f886a8eb2c2e34c8c956"}
Jul 02 21:36:04.620385 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.620287    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wn2p8" event={"ID":"2aef917f-6420-4954-816a-ef85fdd6c61d","Type":"ContainerStarted","Data":"3626aa1323621b088947cfed35dc5f4a57a1191e1b5176f3e6306ddd41d9dc14"}
Jul 02 21:36:04.622332 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.622303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x84mq" event={"ID":"30f563db-dbb7-4fee-bdc7-5d1ebf044a39","Type":"ContainerStarted","Data":"d967a96678162b2ffdcfbc8ea723dfa4fe6c86eb407516de1f81ab344015436c"}
Jul 02 21:36:04.623905 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.623843    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxwdf" event={"ID":"241b0783-6b39-4256-a74a-91afbd1950f1","Type":"ContainerStarted","Data":"db266ad0ae9abe758fd1aa72eb567a6dfcaeac2b24f0700990e36678c9702f1d"}
Jul 02 21:36:04.627182 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.627128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bndfl" event={"ID":"46ded035-79e8-4c40-87de-9bab0965336e","Type":"ContainerStarted","Data":"4da1af2555c8b10f5b3f26df7b9bd676193872e2381799eda71322deba90eb19"}
Jul 02 21:36:04.628754 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.628671    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rmmlm" event={"ID":"2a863c86-f513-4fff-9402-d63252872752","Type":"ContainerStarted","Data":"e51c122283ce89958ddef3d07094ce7415d1cddeda7f525c4db4fec23191d9ea"}
Jul 02 21:36:04.630730 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.630703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klc95" event={"ID":"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3","Type":"ContainerStarted","Data":"de231f71d0799c2a35e96950c6be36eeacc4158aade92799b769a130ab87c81b"}
Jul 02 21:36:04.632784 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.632759    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"5f462a833e93b90ac96202add06a8965a6fc2e9ecdd8010f463b53f6c8e68176"}
Jul 02 21:36:04.636128 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:04.636103    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5" event={"ID":"07fb91f4-a56f-4013-837c-400eb9faeab0","Type":"ContainerStarted","Data":"e75098391ce329d1fb7c0773b4da9a33dc5c32edd67ab9c8396b6212cdbbc5f1"}
Jul 02 21:36:05.048796 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:05.048748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:05.049013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:05.048882    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:05.049086 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.049031    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:05.049145 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.049096    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:07.049077536 +0000 UTC m=+6.046997574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:05.049682 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.049539    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:05.049682 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.049595    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:36:07.049579123 +0000 UTC m=+6.047499174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:05.250888 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:05.250841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:05.251098 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.251077    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:05.251199 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.251104    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:05.251199 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.251119    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:05.251199 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.251182    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:07.25116253 +0000 UTC m=+6.249082569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:05.498834 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:05.498740    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:31:03 +0000 UTC" deadline="2028-03-22 19:24:49.162841322 +0000 UTC"
Jul 02 21:36:05.498834 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:05.498776    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15093h48m43.66406966s"
Jul 02 21:36:05.608705 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:05.608177    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:05.608705 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:05.608337    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:06.606143 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:06.606089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:06.606714 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:06.606259    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:06.606780 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:06.606716    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:06.606837 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:06.606806    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:07.072478 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:07.072392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:07.072651 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:07.072486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:07.072734 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.072663    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:07.072933 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.072812    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:07.072933 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.072825    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:11.072713845 +0000 UTC m=+10.070633884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:07.072933 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.072897    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:36:11.072878024 +0000 UTC m=+10.070798069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:07.275308 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:07.274394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:07.275308 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.274586    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:07.275308 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.274613    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:07.275308 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.274629    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:07.275308 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.274693    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:11.274671681 +0000 UTC m=+10.272591717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:07.609473 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:07.608812    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:07.609473 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:07.608946    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:08.605788 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:08.605497    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:08.606039 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:08.605921    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:08.606398 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:08.605421    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:08.606518 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:08.606424    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:09.606356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:09.606318    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:09.606751 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:09.606453    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:10.605780 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:10.605743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:10.605968 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:10.605743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:10.605968 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:10.605914    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:10.606087 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:10.605958    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:11.108894 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:11.108855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:11.109350 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:11.108942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:11.109350 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.109032    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:11.109350 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.109045    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:11.109350 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.109113    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:36:19.109090093 +0000 UTC m=+18.107010145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:11.109350 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.109134    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:19.109123257 +0000 UTC m=+18.107043292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:11.310460 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:11.310411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:11.310650 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.310603    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:11.310650 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.310628    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:11.310650 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.310642    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:11.310792 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.310700    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:19.310682907 +0000 UTC m=+18.308602956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:11.607388 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:11.607305    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:11.607592 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:11.607561    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:12.606120 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:12.606038    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:12.606562 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:12.606193    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:12.606562 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:12.606235    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:12.606562 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:12.606314    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:13.605989 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:13.605957    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:13.606172 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:13.606091    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:14.606468 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:14.606435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:14.606828 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:14.606439    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:14.606828 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:14.606545    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:14.606828 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:14.606631    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:15.609086 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:15.609057    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:15.609457 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:15.609167    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:16.606117 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:16.606077    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:16.606117 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:16.606096    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:16.606358 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:16.606205    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:16.606358 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:16.606326    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:17.605988 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:17.605960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:17.606382 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:17.606059    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:18.606226 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:18.606195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:18.606731 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:18.606316    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:18.606731 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:18.606381    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:18.606731 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:18.606501    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:19.170446 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:19.170409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:19.170646 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:19.170487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:19.170646 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.170584    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:19.170745 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.170673    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:36:35.170650883 +0000 UTC m=+34.168570921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:19.170745 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.170594    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:19.170829 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.170755    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:35.170736576 +0000 UTC m=+34.168656626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:19.372494 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:19.372460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:19.372638 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.372601    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:19.372638 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.372631    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:19.372737 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.372643    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:19.372737 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.372699    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:35.372684215 +0000 UTC m=+34.370604248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:19.609099 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:19.609020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:19.609524 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:19.609137    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:20.605503 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:20.605460    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:20.605503 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:20.605500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:20.605750 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:20.605614    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:20.605750 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:20.605711    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:21.606986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:21.606950    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:21.607446 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:21.607062    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:22.606216 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:22.606180    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:22.606416 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:22.606180    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:22.606416 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:22.606315    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:22.606416 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:22.606360    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:23.607177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.606467    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:23.607177 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:23.607100    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:23.680049 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.680009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wn2p8" event={"ID":"2aef917f-6420-4954-816a-ef85fdd6c61d","Type":"ContainerStarted","Data":"79d3605107a741109e1e7c2e72274adc81bfed5188c45769b65ca753abd5c0fe"}
Jul 02 21:36:23.684606 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.684576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x84mq" event={"ID":"30f563db-dbb7-4fee-bdc7-5d1ebf044a39","Type":"ContainerStarted","Data":"a35fb1a0afc4cfb62bd97e5e12b3c5646da92280630b3ef5e73fd5c087eaaccf"}
Jul 02 21:36:23.686828 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.686806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"32ae2d495edd1c172f704b47a293daec","Type":"ContainerStarted","Data":"d7432cf8a327ce96b11bf81eb1b530949659fc4598980618a52af3add4361465"}
Jul 02 21:36:23.688993 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.688934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"c62fb3fceb6ea385fc0be9f1ec4b273ed7209abf394d187b8da03998db68470d"}
Jul 02 21:36:23.689085 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.689018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"cbc5468bf4227be3a3ca8dc844eef0cee5fcbcfb572e0debc04a26b29ec6b494"}
Jul 02 21:36:23.689085 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.689069    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"9e1d1385bc683e3565f925a5bac1a2000d43235646749077f96ed3235c32a621"}
Jul 02 21:36:23.695674 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.695577    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wn2p8" podStartSLOduration=2.2732621760000002 podStartE2EDuration="21.695556557s" totalImagesPullingTime="19.422294381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:23.695254829 +0000 UTC m=+22.693174913" watchObservedRunningTime="2026-07-02 21:36:23.695556557 +0000 UTC m=+22.693476612"
Jul 02 21:36:23.727875 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.727829    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" podStartSLOduration=20.727810818000002 podStartE2EDuration="20.727810818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:23.708296905 +0000 UTC m=+22.706216962" watchObservedRunningTime="2026-07-02 21:36:23.727810818 +0000 UTC m=+22.725730877"
Jul 02 21:36:23.727977 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:23.727893    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x84mq" podStartSLOduration=2.295079624 podStartE2EDuration="21.727889163s" totalImagesPullingTime="19.432809539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:23.727748023 +0000 UTC m=+22.725668107" watchObservedRunningTime="2026-07-02 21:36:23.727889163 +0000 UTC m=+22.725809217"
Jul 02 21:36:24.606468 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.606255    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:24.606710 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.606271    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:24.606710 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:24.606585    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:24.606710 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:24.606615    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:24.692988 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.692953    2571 generic.go:356] "Generic (PLEG): container finished" podID="d164b23f-6290-4f3e-9199-b583850e1d39" containerID="462193664f1f3f114b06f433d45d9375e3088f566cadc525440dc3ac062fdeb9" exitCode=0
Jul 02 21:36:24.693544 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.693042    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerDied","Data":"462193664f1f3f114b06f433d45d9375e3088f566cadc525440dc3ac062fdeb9"}
Jul 02 21:36:24.694570 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.694546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxwdf" event={"ID":"241b0783-6b39-4256-a74a-91afbd1950f1","Type":"ContainerStarted","Data":"8d9d8dd6c45c3a5d8ece26f5d606db83ebff57f425b823ae747f9e106131aece"}
Jul 02 21:36:24.695925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.695903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bndfl" event={"ID":"46ded035-79e8-4c40-87de-9bab0965336e","Type":"ContainerStarted","Data":"605622f7efe14db209f7ec32883515097db38c46a4169bc06ee8fb0256b8869c"}
Jul 02 21:36:24.697443 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.697421    2571 generic.go:356] "Generic (PLEG): container finished" podID="47729380b2e6babaaf740e1f7f2eba87" containerID="fa02162e8f6102c91e12fe7a55bcddd3c9a1408c5706edf5d6b9bc245b7b7fe7" exitCode=0
Jul 02 21:36:24.697528 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.697492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"47729380b2e6babaaf740e1f7f2eba87","Type":"ContainerDied","Data":"fa02162e8f6102c91e12fe7a55bcddd3c9a1408c5706edf5d6b9bc245b7b7fe7"}
Jul 02 21:36:24.699058 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.699033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rmmlm" event={"ID":"2a863c86-f513-4fff-9402-d63252872752","Type":"ContainerStarted","Data":"1616c5333dacf7bb3f3dcc92a17007b9913a3e7112d43732722e8c57be206f01"}
Jul 02 21:36:24.702523 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.702494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"878d201b4ecc61845e1b0ab5b7a98a4dec8020d5584d4dbf223d088f8a44475e"}
Jul 02 21:36:24.702610 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.702568    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"bdabb6655ab4803a0138769865c1e8f037daafec16fd55663b7f3c66b6fd4e48"}
Jul 02 21:36:24.702676 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.702619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"5eead6ad8d1833345680ca373c288b04f1db7d943836d2c05a81cce854181db0"}
Jul 02 21:36:24.705573 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.705546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5" event={"ID":"07fb91f4-a56f-4013-837c-400eb9faeab0","Type":"ContainerStarted","Data":"d9c4168b1b22dc9c972f6864e635cd8ed2f4be7a23541e304d648b4a90d34bc8"}
Jul 02 21:36:24.746977 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.746706    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bndfl" podStartSLOduration=3.28681509 podStartE2EDuration="22.746684721s" totalImagesPullingTime="19.459869631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:24.746673954 +0000 UTC m=+23.744594038" watchObservedRunningTime="2026-07-02 21:36:24.746684721 +0000 UTC m=+23.744604787"
Jul 02 21:36:24.762842 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.762790    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rxwdf" podStartSLOduration=3.526118954 podStartE2EDuration="22.762774283s" totalImagesPullingTime="19.236655329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:24.761947797 +0000 UTC m=+23.759867868" watchObservedRunningTime="2026-07-02 21:36:24.762774283 +0000 UTC m=+23.760694382"
Jul 02 21:36:24.776837 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:24.776311    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rmmlm" podStartSLOduration=3.395118943 podStartE2EDuration="22.776295057s" totalImagesPullingTime="19.381176114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:24.77592541 +0000 UTC m=+23.773845477" watchObservedRunningTime="2026-07-02 21:36:24.776295057 +0000 UTC m=+23.774215111"
Jul 02 21:36:25.477846 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.477738    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 21:36:25.490460 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.490335    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:36:25.477751304Z","UUID":"08c35f95-3720-41cb-8555-d3e7adaa684f","Handler":null,"Name":"","Endpoint":""}
Jul 02 21:36:25.492020 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.491999    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 21:36:25.492117 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.492039    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 21:36:25.568366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.568325    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:25.568953 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.568932    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:25.606573 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.606498    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:25.606731 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:25.606617    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:25.709742 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.709712    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"47729380b2e6babaaf740e1f7f2eba87","Type":"ContainerStarted","Data":"2fca0f5aec9a3b273ad351b1373b54c12de31c4614bda6a75a5c7fbd0044b586"}
Jul 02 21:36:25.711175 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.711132    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klc95" event={"ID":"06bff8ec-f05b-4d51-b9f4-ad6c98eea6a3","Type":"ContainerStarted","Data":"9508687eb0bc82b944f1098dde2eb5195581dcefe51cca708203ce23cbd26e74"}
Jul 02 21:36:25.712784 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.712760    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5" event={"ID":"07fb91f4-a56f-4013-837c-400eb9faeab0","Type":"ContainerStarted","Data":"26df5a97538993be73adf5a480841237d0c5db4c2e2df9691c4033ef84b90d58"}
Jul 02 21:36:25.713116 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.713089    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:25.713453 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.713432    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rxwdf"
Jul 02 21:36:25.737113 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.737069    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" podStartSLOduration=22.737054387 podStartE2EDuration="22.737054387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:25.723560676 +0000 UTC m=+24.721480731" watchObservedRunningTime="2026-07-02 21:36:25.737054387 +0000 UTC m=+24.734974443"
Jul 02 21:36:25.737262 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:25.737242    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-klc95" podStartSLOduration=4.346870514 podStartE2EDuration="23.737236897s" totalImagesPullingTime="19.390366383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:25.736800082 +0000 UTC m=+24.734720138" watchObservedRunningTime="2026-07-02 21:36:25.737236897 +0000 UTC m=+24.735156952"
Jul 02 21:36:26.606018 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:26.605983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:26.606222 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:26.606111    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:26.606222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:26.606176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:26.606341 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:26.606291    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:26.718568 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:26.718526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"eecc1b478931d797f837adfd511e1e5477dbeae24fef91e4992450bc3d63552a"}
Jul 02 21:36:27.605526 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:27.605492    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:27.605721 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:27.605620    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:27.724737 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:27.724695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5" event={"ID":"07fb91f4-a56f-4013-837c-400eb9faeab0","Type":"ContainerStarted","Data":"69bbe7f2170f1ed7b493f742122c5860a6cadd69f57a52b1d8d611836003767d"}
Jul 02 21:36:27.742352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:27.742305    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gvt5" podStartSLOduration=3.521572862 podStartE2EDuration="25.742290806s" totalImagesPullingTime="22.220717944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:27.741827274 +0000 UTC m=+26.739747330" watchObservedRunningTime="2026-07-02 21:36:27.742290806 +0000 UTC m=+26.740210857"
Jul 02 21:36:28.606581 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:28.606372    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:28.606742 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:28.606417    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:28.606742 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:28.606686    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:28.606846 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:28.606757    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:28.731250 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:28.731145    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" event={"ID":"e121c982-1a32-41ea-ac76-4188c86516e7","Type":"ContainerStarted","Data":"1680707d6766d719a5576a6065b254f7ad31440db26d5e506ad5335c4d095a90"}
Jul 02 21:36:28.762573 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:28.762491    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" podStartSLOduration=7.195890915 podStartE2EDuration="26.76247043s" totalImagesPullingTime="19.566579515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:28.7620293 +0000 UTC m=+27.759949355" watchObservedRunningTime="2026-07-02 21:36:28.76247043 +0000 UTC m=+27.760390494"
Jul 02 21:36:29.605984 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:29.605954    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:29.606136 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:29.606080    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:29.733760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:29.733729    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 21:36:29.734247 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:29.734111    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:29.734247 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:29.734216    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:29.750944 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:29.750914    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:29.751104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:29.751049    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:30.301586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.301368    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xm9s"]
Jul 02 21:36:30.301744 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.301687    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:30.301829 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:30.301806    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:30.304778 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.304753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wwfp"]
Jul 02 21:36:30.304966 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.304875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:30.305034 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:30.304969    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:30.305412 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.305383    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zc8td"]
Jul 02 21:36:30.305523 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.305470    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:30.305609 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:30.305586    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:30.737801 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.737725    2571 generic.go:356] "Generic (PLEG): container finished" podID="d164b23f-6290-4f3e-9199-b583850e1d39" containerID="c6ec4e2af9987d83338a18ccfc849f4dbe1b94bdb9821a1baa3bf154aa365dcf" exitCode=0
Jul 02 21:36:30.738300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.737806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerDied","Data":"c6ec4e2af9987d83338a18ccfc849f4dbe1b94bdb9821a1baa3bf154aa365dcf"}
Jul 02 21:36:30.738300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:30.737906    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 21:36:31.606788 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:31.606751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:31.606948 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:31.606821    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:31.606948 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:31.606834    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:31.606948 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:31.606914    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:31.742193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:31.742098    2571 generic.go:356] "Generic (PLEG): container finished" podID="d164b23f-6290-4f3e-9199-b583850e1d39" containerID="e7917350459861bddd1f78fd7998a4dbc4b4c3a1917b37a1138ab3dd61c565ce" exitCode=0
Jul 02 21:36:31.742193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:31.742181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerDied","Data":"e7917350459861bddd1f78fd7998a4dbc4b4c3a1917b37a1138ab3dd61c565ce"}
Jul 02 21:36:31.742596 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:31.742264    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 21:36:32.606346 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:32.606314    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:32.606483 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:32.606421    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:32.747213 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:32.747129    2571 generic.go:356] "Generic (PLEG): container finished" podID="d164b23f-6290-4f3e-9199-b583850e1d39" containerID="03e7134bf32c82aa9706e3227c95a74b6e06cfa14db7af2b3d30314752b3bd1e" exitCode=0
Jul 02 21:36:32.747213 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:32.747187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerDied","Data":"03e7134bf32c82aa9706e3227c95a74b6e06cfa14db7af2b3d30314752b3bd1e"}
Jul 02 21:36:33.242903 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:33.242859    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:36:33.243125 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:33.243110    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 21:36:33.254308 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:33.254272    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" podUID="e121c982-1a32-41ea-ac76-4188c86516e7" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 02 21:36:33.264078 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:33.264054    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z" podUID="e121c982-1a32-41ea-ac76-4188c86516e7" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 02 21:36:33.605874 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:33.605841    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:33.606022 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:33.605973    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:33.606093 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:33.606032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:33.606191 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:33.606169    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:34.606048 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:34.606012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:34.606497 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:34.606150    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xm9s" podUID="47776b6a-6004-4f70-a8fc-9339ebba8a9c"
Jul 02 21:36:35.197146 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:35.197116    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:35.197336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:35.197198    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:35.197336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.197274    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:35.197336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.197301    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:35.197483 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.197348    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs podName:7d380bb8-4c0e-4be3-9ebd-f27a7a869037 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:07.197328039 +0000 UTC m=+66.195248083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs") pod "network-metrics-daemon-zc8td" (UID: "7d380bb8-4c0e-4be3-9ebd-f27a7a869037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:36:35.197483 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.197367    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret podName:47776b6a-6004-4f70-a8fc-9339ebba8a9c nodeName:}" failed. No retries permitted until 2026-07-02 21:37:07.197357628 +0000 UTC m=+66.195277672 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret") pod "global-pull-secret-syncer-6xm9s" (UID: "47776b6a-6004-4f70-a8fc-9339ebba8a9c") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:36:35.398483 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:35.398452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:35.398648 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.398631    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:36:35.398684 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.398652    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:36:35.398684 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.398662    2571 projected.go:196] Error preparing data for projected volume kube-api-access-jbh4k for pod openshift-network-diagnostics/network-check-target-2wwfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:35.398766 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.398710    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k podName:7a46896c-0377-4ffd-811e-e1e299242000 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:07.398694964 +0000 UTC m=+66.396615001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jbh4k" (UniqueName: "kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k") pod "network-check-target-2wwfp" (UID: "7a46896c-0377-4ffd-811e-e1e299242000") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:36:35.605850 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:35.605780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:35.605984 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.605887    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wwfp" podUID="7a46896c-0377-4ffd-811e-e1e299242000"
Jul 02 21:36:35.605984 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:35.605967    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:35.606100 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:35.606078    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zc8td" podUID="7d380bb8-4c0e-4be3-9ebd-f27a7a869037"
Jul 02 21:36:36.075638 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.075360    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeReady"
Jul 02 21:36:36.075830 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.075740    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 21:36:36.108102 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.108077    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"]
Jul 02 21:36:36.110715 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.110660    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.111492 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.111274    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"]
Jul 02 21:36:36.113124 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.113096    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.113124 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.113102    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kd4ch\""
Jul 02 21:36:36.113300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.113124    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.113445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.113432    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 21:36:36.114043 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.114023    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d7df65677-9q4tk"]
Jul 02 21:36:36.114167 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.114139    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"
Jul 02 21:36:36.116971 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.116956    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.117816 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.117796    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.117926 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.117821    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 21:36:36.117926 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.117821    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.117926 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.117804    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-92dlq\""
Jul 02 21:36:36.119145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.119125    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 21:36:36.119373 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.119358    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 21:36:36.119445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.119383    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 21:36:36.119445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.119406    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzgxn\""
Jul 02 21:36:36.123208 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.123188    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-f9x65"]
Jul 02 21:36:36.126250 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.126018    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 21:36:36.126250 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.126035    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p8zln"]
Jul 02 21:36:36.126250 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.126215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.130690 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.130398    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"]
Jul 02 21:36:36.130690 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.130489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.131207 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.131184    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 21:36:36.132130 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.131823    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.132130 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.131875    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.132130 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.132081    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rzqqg\""
Jul 02 21:36:36.132980 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.132807    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 21:36:36.133317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.133295    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 21:36:36.134018 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.133664    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bv4sq\""
Jul 02 21:36:36.134204 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.134146    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 21:36:36.135029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.135007    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"]
Jul 02 21:36:36.137865 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.136067    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.140309 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.140288    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wf92v\""
Jul 02 21:36:36.140445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.140426    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.140614 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.140310    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.140854 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.140718    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 21:36:36.142236 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.142219    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 21:36:36.142673 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.142656    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"]
Jul 02 21:36:36.142899 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.142825    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"]
Jul 02 21:36:36.143046 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.142991    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.143188 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.143134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d7df65677-9q4tk"]
Jul 02 21:36:36.143277 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.143207    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-f9x65"]
Jul 02 21:36:36.145128 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.145105    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"]
Jul 02 21:36:36.145369 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.145279    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 21:36:36.145920 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.145895    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 21:36:36.146113 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.146086    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.146294 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.146100    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.148280 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.148259    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nb8pq\""
Jul 02 21:36:36.154427 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.154104    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"]
Jul 02 21:36:36.156788 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.156772    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"]
Jul 02 21:36:36.160132 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.160117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p8zln"]
Jul 02 21:36:36.160241 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.160212    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85b98f7769-6nglb"]
Jul 02 21:36:36.160423 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.160388    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.162703 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.162684    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 21:36:36.162703 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.162699    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 21:36:36.162995 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.162977    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x4dzt\""
Jul 02 21:36:36.163106 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.163019    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.163180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.163099    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.163235 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.163216    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ldwg6"]
Jul 02 21:36:36.163433 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.163416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.165987 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.165969    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 21:36:36.166150 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166131    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 21:36:36.166305 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166286    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 21:36:36.166392 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.166392 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166368    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.166501 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166205    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.166606 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166046    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pkggz\""
Jul 02 21:36:36.167549 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.165994    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 21:36:36.167549 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.166298    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ljhv8"]
Jul 02 21:36:36.168481 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.168461    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.168703 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.168686    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.168783 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.168714    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nsr8n\""
Jul 02 21:36:36.168850 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.168831    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 21:36:36.170058 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.170038    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"]
Jul 02 21:36:36.172760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.172742    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.175030 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.175014    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldwg6"]
Jul 02 21:36:36.175142 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.175044    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"]
Jul 02 21:36:36.175142 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.175071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85b98f7769-6nglb"]
Jul 02 21:36:36.175142 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.175135    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"
Jul 02 21:36:36.176048 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.176032    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.176282 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.176260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zthsw\""
Jul 02 21:36:36.176358 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.176291    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 21:36:36.176453 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.176242    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 21:36:36.177384 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.177353    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 21:36:36.177627 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.177598    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.177708 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.177623    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 21:36:36.177997 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.177982    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bgcwq\""
Jul 02 21:36:36.181432 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.181408    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"]
Jul 02 21:36:36.182138 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.182118    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 21:36:36.184355 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.184325    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ljhv8"]
Jul 02 21:36:36.306507 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-bound-sa-token\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.306507 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.306507 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-default-certificate\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53580e86-54c5-4b81-afb5-82a247fd9caa-serving-cert\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-stats-auth\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-tmp\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ea5b680-7b01-4262-9fb7-1aa02a08abad-cert\") pod \"ingress-canary-ldwg6\" (UID: \"2ea5b680-7b01-4262-9fb7-1aa02a08abad\") " pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvcn\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-kube-api-access-9rvcn\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b7e92c-b1f9-46b7-8113-3854077820e8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj57r\" (UniqueName: \"kubernetes.io/projected/1da23408-506e-47cc-841d-c449810a2b17-kube-api-access-zj57r\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306768    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e287e55b-7f42-4df7-aa9f-071f35197b40-ca-trust-extracted\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5fcbb2-24f9-434f-9e14-a032498123db-tmp-dir\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.306855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306855    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbwrt\" (UniqueName: \"kubernetes.io/projected/2ea5b680-7b01-4262-9fb7-1aa02a08abad-kube-api-access-bbwrt\") pod \"ingress-canary-ldwg6\" (UID: \"2ea5b680-7b01-4262-9fb7-1aa02a08abad\") " pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306884    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d55d228-b865-407d-a043-43847600e36e-config\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klbr4\" (UniqueName: \"kubernetes.io/projected/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-kube-api-access-klbr4\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-installation-pull-secrets\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1da23408-506e-47cc-841d-c449810a2b17-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.306989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qgcw\" (UniqueName: \"kubernetes.io/projected/82fd403a-1b97-4828-82b4-a0ccc90d21c5-kube-api-access-4qgcw\") pod \"network-check-source-989f8b8dc-pqb49\" (UID: \"82fd403a-1b97-4828-82b4-a0ccc90d21c5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-image-registry-private-configuration\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-trusted-ca\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-snapshots\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skgm\" (UniqueName: \"kubernetes.io/projected/534fa6be-3350-4cf5-b252-362e4e88dddf-kube-api-access-6skgm\") pod \"volume-data-source-validator-5d456fdbcd-dlmd7\" (UID: \"534fa6be-3350-4cf5-b252-362e4e88dddf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307236    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-certificates\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53580e86-54c5-4b81-afb5-82a247fd9caa-trusted-ca\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.307352 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307359    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqm7h\" (UniqueName: \"kubernetes.io/projected/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-kube-api-access-jqm7h\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nlmc\" (UniqueName: \"kubernetes.io/projected/53580e86-54c5-4b81-afb5-82a247fd9caa-kube-api-access-5nlmc\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307421    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8h6\" (UniqueName: \"kubernetes.io/projected/4d55d228-b865-407d-a043-43847600e36e-kube-api-access-bg8h6\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff5fcbb2-24f9-434f-9e14-a032498123db-config-volume\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307489    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvmx\" (UniqueName: \"kubernetes.io/projected/a7b7e92c-b1f9-46b7-8113-3854077820e8-kube-api-access-jmvmx\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b7e92c-b1f9-46b7-8113-3854077820e8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-serving-cert\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6s5q\" (UniqueName: \"kubernetes.io/projected/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-kube-api-access-z6s5q\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307641    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzdp\" (UniqueName: \"kubernetes.io/projected/ff5fcbb2-24f9-434f-9e14-a032498123db-kube-api-access-drzdp\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d55d228-b865-407d-a043-43847600e36e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.307931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.307723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53580e86-54c5-4b81-afb5-82a247fd9caa-config\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.409113 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409022    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.409113 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qgcw\" (UniqueName: \"kubernetes.io/projected/82fd403a-1b97-4828-82b4-a0ccc90d21c5-kube-api-access-4qgcw\") pod \"network-check-source-989f8b8dc-pqb49\" (UID: \"82fd403a-1b97-4828-82b4-a0ccc90d21c5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"
Jul 02 21:36:36.409113 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-image-registry-private-configuration\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-trusted-ca\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-snapshots\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6skgm\" (UniqueName: \"kubernetes.io/projected/534fa6be-3350-4cf5-b252-362e4e88dddf-kube-api-access-6skgm\") pod \"volume-data-source-validator-5d456fdbcd-dlmd7\" (UID: \"534fa6be-3350-4cf5-b252-362e4e88dddf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.409246    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:36.909224551 +0000 UTC m=+35.907144599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : configmap references non-existent config key: service-ca.crt
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-certificates\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53580e86-54c5-4b81-afb5-82a247fd9caa-trusted-ca\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.409331    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqm7h\" (UniqueName: \"kubernetes.io/projected/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-kube-api-access-jqm7h\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.409403 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.409381    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:36.909368421 +0000 UTC m=+35.907288473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : secret "router-metrics-certs-default" not found
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nlmc\" (UniqueName: \"kubernetes.io/projected/53580e86-54c5-4b81-afb5-82a247fd9caa-kube-api-access-5nlmc\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8h6\" (UniqueName: \"kubernetes.io/projected/4d55d228-b865-407d-a043-43847600e36e-kube-api-access-bg8h6\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff5fcbb2-24f9-434f-9e14-a032498123db-config-volume\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvmx\" (UniqueName: \"kubernetes.io/projected/a7b7e92c-b1f9-46b7-8113-3854077820e8-kube-api-access-jmvmx\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b7e92c-b1f9-46b7-8113-3854077820e8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-serving-cert\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6s5q\" (UniqueName: \"kubernetes.io/projected/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-kube-api-access-z6s5q\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.409740 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzdp\" (UniqueName: \"kubernetes.io/projected/ff5fcbb2-24f9-434f-9e14-a032498123db-kube-api-access-drzdp\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d55d228-b865-407d-a043-43847600e36e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53580e86-54c5-4b81-afb5-82a247fd9caa-config\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.409804    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.409855    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls podName:ff5fcbb2-24f9-434f-9e14-a032498123db nodeName:}" failed. No retries permitted until 2026-07-02 21:36:36.909839212 +0000 UTC m=+35.907759248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls") pod "dns-default-p8zln" (UID: "ff5fcbb2-24f9-434f-9e14-a032498123db") : secret "dns-default-metrics-tls" not found
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-bound-sa-token\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409904    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-snapshots\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409924    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-default-certificate\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.409996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53580e86-54c5-4b81-afb5-82a247fd9caa-serving-cert\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-stats-auth\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-tmp\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ea5b680-7b01-4262-9fb7-1aa02a08abad-cert\") pod \"ingress-canary-ldwg6\" (UID: \"2ea5b680-7b01-4262-9fb7-1aa02a08abad\") " pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvcn\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-kube-api-access-9rvcn\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.410145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b7e92c-b1f9-46b7-8113-3854077820e8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410174    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-certificates\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410304    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-trusted-ca\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410472    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-tmp\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj57r\" (UniqueName: \"kubernetes.io/projected/1da23408-506e-47cc-841d-c449810a2b17-kube-api-access-zj57r\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410489    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410513    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e287e55b-7f42-4df7-aa9f-071f35197b40-ca-trust-extracted\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.410610    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.410678    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls podName:1da23408-506e-47cc-841d-c449810a2b17 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:36.910661446 +0000 UTC m=+35.908581481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j8zkd" (UID: "1da23408-506e-47cc-841d-c449810a2b17") : secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410716    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff5fcbb2-24f9-434f-9e14-a032498123db-config-volume\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410729    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53580e86-54c5-4b81-afb5-82a247fd9caa-trusted-ca\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.410881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.410767    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e287e55b-7f42-4df7-aa9f-071f35197b40-ca-trust-extracted\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.411438 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411038    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7b7e92c-b1f9-46b7-8113-3854077820e8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.411438 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411397    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53580e86-54c5-4b81-afb5-82a247fd9caa-config\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.411438 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.411586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5fcbb2-24f9-434f-9e14-a032498123db-tmp-dir\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.411586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbwrt\" (UniqueName: \"kubernetes.io/projected/2ea5b680-7b01-4262-9fb7-1aa02a08abad-kube-api-access-bbwrt\") pod \"ingress-canary-ldwg6\" (UID: \"2ea5b680-7b01-4262-9fb7-1aa02a08abad\") " pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.411586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d55d228-b865-407d-a043-43847600e36e-config\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.411586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klbr4\" (UniqueName: \"kubernetes.io/projected/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-kube-api-access-klbr4\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.411586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.411580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-installation-pull-secrets\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.412129 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.412091    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.412481 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.412313    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5fcbb2-24f9-434f-9e14-a032498123db-tmp-dir\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.412481 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.412361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1da23408-506e-47cc-841d-c449810a2b17-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.412481 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.412392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.412642 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.412507    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 21:36:36.412642 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.412557    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls podName:e5cfef61-1fbb-4f29-82ff-42ecdf62bb85 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:36.912540161 +0000 UTC m=+35.910460207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fflrm" (UID: "e5cfef61-1fbb-4f29-82ff-42ecdf62bb85") : secret "samples-operator-tls" not found
Jul 02 21:36:36.412642 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.412621    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d55d228-b865-407d-a043-43847600e36e-config\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.413167 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.413111    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:36:36.413167 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.413130    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7df65677-9q4tk: secret "image-registry-tls" not found
Jul 02 21:36:36.413298 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.413227    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls podName:e287e55b-7f42-4df7-aa9f-071f35197b40 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:36.91321065 +0000 UTC m=+35.911130703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls") pod "image-registry-d7df65677-9q4tk" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40") : secret "image-registry-tls" not found
Jul 02 21:36:36.413990 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.413893    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1da23408-506e-47cc-841d-c449810a2b17-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.414831 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.414802    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-serving-cert\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.414932 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.414841    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-installation-pull-secrets\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.415259 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.414981    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-image-registry-private-configuration\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.415259 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.415186    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-default-certificate\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.415385 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.415313    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d55d228-b865-407d-a043-43847600e36e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.415563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.415539    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b7e92c-b1f9-46b7-8113-3854077820e8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.416466 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.416448    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-stats-auth\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.417049 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.417031    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53580e86-54c5-4b81-afb5-82a247fd9caa-serving-cert\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.417149 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.417073    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ea5b680-7b01-4262-9fb7-1aa02a08abad-cert\") pod \"ingress-canary-ldwg6\" (UID: \"2ea5b680-7b01-4262-9fb7-1aa02a08abad\") " pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.420584 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.420556    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8h6\" (UniqueName: \"kubernetes.io/projected/4d55d228-b865-407d-a043-43847600e36e-kube-api-access-bg8h6\") pod \"service-ca-operator-5d46d9ffd4-n568s\" (UID: \"4d55d228-b865-407d-a043-43847600e36e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.421116 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.421070    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzdp\" (UniqueName: \"kubernetes.io/projected/ff5fcbb2-24f9-434f-9e14-a032498123db-kube-api-access-drzdp\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.423442 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.421883    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj57r\" (UniqueName: \"kubernetes.io/projected/1da23408-506e-47cc-841d-c449810a2b17-kube-api-access-zj57r\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.423442 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.422424    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nlmc\" (UniqueName: \"kubernetes.io/projected/53580e86-54c5-4b81-afb5-82a247fd9caa-kube-api-access-5nlmc\") pod \"console-operator-68b757fb67-ljhv8\" (UID: \"53580e86-54c5-4b81-afb5-82a247fd9caa\") " pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.423442 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.422953    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqm7h\" (UniqueName: \"kubernetes.io/projected/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-kube-api-access-jqm7h\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.423442 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.423385    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-bound-sa-token\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.424056 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.423812    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvcn\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-kube-api-access-9rvcn\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.424487 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.424465    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klbr4\" (UniqueName: \"kubernetes.io/projected/d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6-kube-api-access-klbr4\") pod \"insights-operator-5c847dcfc4-f9x65\" (UID: \"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.424705 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.424683    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skgm\" (UniqueName: \"kubernetes.io/projected/534fa6be-3350-4cf5-b252-362e4e88dddf-kube-api-access-6skgm\") pod \"volume-data-source-validator-5d456fdbcd-dlmd7\" (UID: \"534fa6be-3350-4cf5-b252-362e4e88dddf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"
Jul 02 21:36:36.424807 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.424743    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qgcw\" (UniqueName: \"kubernetes.io/projected/82fd403a-1b97-4828-82b4-a0ccc90d21c5-kube-api-access-4qgcw\") pod \"network-check-source-989f8b8dc-pqb49\" (UID: \"82fd403a-1b97-4828-82b4-a0ccc90d21c5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"
Jul 02 21:36:36.424876 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.424855    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvmx\" (UniqueName: \"kubernetes.io/projected/a7b7e92c-b1f9-46b7-8113-3854077820e8-kube-api-access-jmvmx\") pod \"kube-storage-version-migrator-operator-846bf668f7-z6wv4\" (UID: \"a7b7e92c-b1f9-46b7-8113-3854077820e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.424969 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.424953    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6s5q\" (UniqueName: \"kubernetes.io/projected/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-kube-api-access-z6s5q\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.426837 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.426805    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbwrt\" (UniqueName: \"kubernetes.io/projected/2ea5b680-7b01-4262-9fb7-1aa02a08abad-kube-api-access-bbwrt\") pod \"ingress-canary-ldwg6\" (UID: \"2ea5b680-7b01-4262-9fb7-1aa02a08abad\") " pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.439231 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.439209    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"
Jul 02 21:36:36.464535 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.464509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65"
Jul 02 21:36:36.484267 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.484244    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"
Jul 02 21:36:36.491125 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.491104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"
Jul 02 21:36:36.506040 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.506017    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldwg6"
Jul 02 21:36:36.511946 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.511924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:36.516847 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.516828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"
Jul 02 21:36:36.606146 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.606114    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:36:36.608807 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.608783    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 21:36:36.916251 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.916202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.916435 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.916273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:36.916435 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.916338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:36.916435 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916348    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 21:36:36.916590 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916443    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:37.916426882 +0000 UTC m=+36.914346934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : secret "router-metrics-certs-default" not found
Jul 02 21:36:36.916590 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916453    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:36:36.916590 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916464    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:36.916590 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916519    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls podName:ff5fcbb2-24f9-434f-9e14-a032498123db nodeName:}" failed. No retries permitted until 2026-07-02 21:36:37.916502303 +0000 UTC m=+36.914422340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls") pod "dns-default-p8zln" (UID: "ff5fcbb2-24f9-434f-9e14-a032498123db") : secret "dns-default-metrics-tls" not found
Jul 02 21:36:36.916590 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916539    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls podName:1da23408-506e-47cc-841d-c449810a2b17 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:37.916529644 +0000 UTC m=+36.914449682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j8zkd" (UID: "1da23408-506e-47cc-841d-c449810a2b17") : secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:36.916590 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.916575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.916629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:36.916659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916709    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916723    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7df65677-9q4tk: secret "image-registry-tls" not found
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916752    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916765    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls podName:e287e55b-7f42-4df7-aa9f-071f35197b40 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:37.916750848 +0000 UTC m=+36.914670906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls") pod "image-registry-d7df65677-9q4tk" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40") : secret "image-registry-tls" not found
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916782    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:37.916772583 +0000 UTC m=+36.914692623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : configmap references non-existent config key: service-ca.crt
Jul 02 21:36:36.916904 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:36.916810    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls podName:e5cfef61-1fbb-4f29-82ff-42ecdf62bb85 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:37.916796255 +0000 UTC m=+36.914716298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fflrm" (UID: "e5cfef61-1fbb-4f29-82ff-42ecdf62bb85") : secret "samples-operator-tls" not found
Jul 02 21:36:37.605598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.605562    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:36:37.605776 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.605562    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:36:37.609968 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.609822    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dkhhs\""
Jul 02 21:36:37.609968 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.609850    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 21:36:37.609968 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.609896    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ckjxv\""
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.926191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.926277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.926317    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.926374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.926495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:37.926558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.926692    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.926767    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls podName:e5cfef61-1fbb-4f29-82ff-42ecdf62bb85 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:39.926748217 +0000 UTC m=+38.924668252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fflrm" (UID: "e5cfef61-1fbb-4f29-82ff-42ecdf62bb85") : secret "samples-operator-tls" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927303    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:39.927285595 +0000 UTC m=+38.925205635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : configmap references non-existent config key: service-ca.crt
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927387    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927424    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:39.927413382 +0000 UTC m=+38.925333430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : secret "router-metrics-certs-default" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927485    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927513    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls podName:ff5fcbb2-24f9-434f-9e14-a032498123db nodeName:}" failed. No retries permitted until 2026-07-02 21:36:39.927503759 +0000 UTC m=+38.925423792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls") pod "dns-default-p8zln" (UID: "ff5fcbb2-24f9-434f-9e14-a032498123db") : secret "dns-default-metrics-tls" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927568    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:37.927736 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927601    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls podName:1da23408-506e-47cc-841d-c449810a2b17 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:39.927589214 +0000 UTC m=+38.925509262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j8zkd" (UID: "1da23408-506e-47cc-841d-c449810a2b17") : secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:37.928618 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927664    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:36:37.928618 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927675    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7df65677-9q4tk: secret "image-registry-tls" not found
Jul 02 21:36:37.928618 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:37.927706    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls podName:e287e55b-7f42-4df7-aa9f-071f35197b40 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:39.92769513 +0000 UTC m=+38.925615178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls") pod "image-registry-d7df65677-9q4tk" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40") : secret "image-registry-tls" not found
Jul 02 21:36:38.169260 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.169017    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7"]
Jul 02 21:36:38.172614 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.172581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49"]
Jul 02 21:36:38.176045 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.176024    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4"]
Jul 02 21:36:38.180014 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:38.179988    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fd403a_1b97_4828_82b4_a0ccc90d21c5.slice/crio-796b390f4265de9831b5f07ff120a4db110335637ce33604b383d200557c0885 WatchSource:0}: Error finding container 796b390f4265de9831b5f07ff120a4db110335637ce33604b383d200557c0885: Status 404 returned error can't find the container with id 796b390f4265de9831b5f07ff120a4db110335637ce33604b383d200557c0885
Jul 02 21:36:38.182365 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:38.182335    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b7e92c_b1f9_46b7_8113_3854077820e8.slice/crio-c23e0d46298f986f043088814d357ea779f17ab54cdf9912d551db36bf9577b9 WatchSource:0}: Error finding container c23e0d46298f986f043088814d357ea779f17ab54cdf9912d551db36bf9577b9: Status 404 returned error can't find the container with id c23e0d46298f986f043088814d357ea779f17ab54cdf9912d551db36bf9577b9
Jul 02 21:36:38.183805 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.183781    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s"]
Jul 02 21:36:38.186189 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:38.186165    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d55d228_b865_407d_a043_43847600e36e.slice/crio-937aa68afc76f74f912ac2bbed035debbc9d2b038154278b8229017bafde7a15 WatchSource:0}: Error finding container 937aa68afc76f74f912ac2bbed035debbc9d2b038154278b8229017bafde7a15: Status 404 returned error can't find the container with id 937aa68afc76f74f912ac2bbed035debbc9d2b038154278b8229017bafde7a15
Jul 02 21:36:38.189577 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.189556    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ljhv8"]
Jul 02 21:36:38.192317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.192300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-f9x65"]
Jul 02 21:36:38.197635 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:38.197614    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f6fd43_122a_4ed3_ba13_7de3e6a99cb6.slice/crio-0a8e1ac2b8f95757bce991170de23419d4f6374cc49a191e9de4569b5561bd4e WatchSource:0}: Error finding container 0a8e1ac2b8f95757bce991170de23419d4f6374cc49a191e9de4569b5561bd4e: Status 404 returned error can't find the container with id 0a8e1ac2b8f95757bce991170de23419d4f6374cc49a191e9de4569b5561bd4e
Jul 02 21:36:38.200659 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.200638    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldwg6"]
Jul 02 21:36:38.203397 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:36:38.203377    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea5b680_7b01_4262_9fb7_1aa02a08abad.slice/crio-1d1aa5cf9b117cf72c3845f87a6cccc575ba27130b6fdf1ded4432fb6b54a319 WatchSource:0}: Error finding container 1d1aa5cf9b117cf72c3845f87a6cccc575ba27130b6fdf1ded4432fb6b54a319: Status 404 returned error can't find the container with id 1d1aa5cf9b117cf72c3845f87a6cccc575ba27130b6fdf1ded4432fb6b54a319
Jul 02 21:36:38.764920 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.764879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49" event={"ID":"82fd403a-1b97-4828-82b4-a0ccc90d21c5","Type":"ContainerStarted","Data":"796b390f4265de9831b5f07ff120a4db110335637ce33604b383d200557c0885"}
Jul 02 21:36:38.766403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.766367    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7" event={"ID":"534fa6be-3350-4cf5-b252-362e4e88dddf","Type":"ContainerStarted","Data":"5e20a39ddbe87cc92dc136ce02d7e9a405eac81243ebc56296bd4fbd5c2ea554"}
Jul 02 21:36:38.767872 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.767844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4" event={"ID":"a7b7e92c-b1f9-46b7-8113-3854077820e8","Type":"ContainerStarted","Data":"c23e0d46298f986f043088814d357ea779f17ab54cdf9912d551db36bf9577b9"}
Jul 02 21:36:38.769780 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.769748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65" event={"ID":"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6","Type":"ContainerStarted","Data":"0a8e1ac2b8f95757bce991170de23419d4f6374cc49a191e9de4569b5561bd4e"}
Jul 02 21:36:38.770926 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.770897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" event={"ID":"53580e86-54c5-4b81-afb5-82a247fd9caa","Type":"ContainerStarted","Data":"c9c36874448bba0d259a8f10b0095e8eb790a193f74a94b88de4a645a2910987"}
Jul 02 21:36:38.772203 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.772183    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldwg6" event={"ID":"2ea5b680-7b01-4262-9fb7-1aa02a08abad","Type":"ContainerStarted","Data":"1d1aa5cf9b117cf72c3845f87a6cccc575ba27130b6fdf1ded4432fb6b54a319"}
Jul 02 21:36:38.776433 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.776407    2571 generic.go:356] "Generic (PLEG): container finished" podID="d164b23f-6290-4f3e-9199-b583850e1d39" containerID="1d51c8ee833b3879883eac47b0e5df8abc8a0521c0a58be4bbbca29cf571c0f0" exitCode=0
Jul 02 21:36:38.776528 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.776480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerDied","Data":"1d51c8ee833b3879883eac47b0e5df8abc8a0521c0a58be4bbbca29cf571c0f0"}
Jul 02 21:36:38.779557 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:38.779526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s" event={"ID":"4d55d228-b865-407d-a043-43847600e36e","Type":"ContainerStarted","Data":"937aa68afc76f74f912ac2bbed035debbc9d2b038154278b8229017bafde7a15"}
Jul 02 21:36:39.799283 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.798394    2571 generic.go:356] "Generic (PLEG): container finished" podID="d164b23f-6290-4f3e-9199-b583850e1d39" containerID="8d4ed54a6e6d8381ad9af9bfc50ade090616d29fa7d7ca0ab4fc22f1b7e21d38" exitCode=0
Jul 02 21:36:39.799283 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.798447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerDied","Data":"8d4ed54a6e6d8381ad9af9bfc50ade090616d29fa7d7ca0ab4fc22f1b7e21d38"}
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.947062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.947133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.947181    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.947227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.947255    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:39.947298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.947441    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.947504    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls podName:1da23408-506e-47cc-841d-c449810a2b17 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:43.947484066 +0000 UTC m=+42.945404117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j8zkd" (UID: "1da23408-506e-47cc-841d-c449810a2b17") : secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.947906    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.947921    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7df65677-9q4tk: secret "image-registry-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.947963    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls podName:e287e55b-7f42-4df7-aa9f-071f35197b40 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:43.947948991 +0000 UTC m=+42.945869029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls") pod "image-registry-d7df65677-9q4tk" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40") : secret "image-registry-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948022    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948056    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls podName:e5cfef61-1fbb-4f29-82ff-42ecdf62bb85 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:43.948044633 +0000 UTC m=+42.945964683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fflrm" (UID: "e5cfef61-1fbb-4f29-82ff-42ecdf62bb85") : secret "samples-operator-tls" not found
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948115    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:43.948104824 +0000 UTC m=+42.946024864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : configmap references non-existent config key: service-ca.crt
Jul 02 21:36:39.948336 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948186    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 21:36:39.949252 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948216    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:43.948205653 +0000 UTC m=+42.946125688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : secret "router-metrics-certs-default" not found
Jul 02 21:36:39.949252 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948269    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:36:39.949252 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:39.948298    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls podName:ff5fcbb2-24f9-434f-9e14-a032498123db nodeName:}" failed. No retries permitted until 2026-07-02 21:36:43.9482886 +0000 UTC m=+42.946208636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls") pod "dns-default-p8zln" (UID: "ff5fcbb2-24f9-434f-9e14-a032498123db") : secret "dns-default-metrics-tls" not found
Jul 02 21:36:43.984502 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:43.984461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:43.984538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:43.984569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984631    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984657    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7df65677-9q4tk: secret "image-registry-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984686    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.984668372 +0000 UTC m=+50.982588428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : configmap references non-existent config key: service-ca.crt
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984687    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984711    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls podName:e287e55b-7f42-4df7-aa9f-071f35197b40 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.984694001 +0000 UTC m=+50.982614054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls") pod "image-registry-d7df65677-9q4tk" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40") : secret "image-registry-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984730    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls podName:e5cfef61-1fbb-4f29-82ff-42ecdf62bb85 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.984718299 +0000 UTC m=+50.982638338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fflrm" (UID: "e5cfef61-1fbb-4f29-82ff-42ecdf62bb85") : secret "samples-operator-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:43.984769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:43.984799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:43.984841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984869    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984912    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.98489917 +0000 UTC m=+50.982819207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : secret "router-metrics-certs-default" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984919    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984955    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls podName:1da23408-506e-47cc-841d-c449810a2b17 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.984945078 +0000 UTC m=+50.982865133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j8zkd" (UID: "1da23408-506e-47cc-841d-c449810a2b17") : secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:43.985013 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.984973    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:36:43.985664 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:43.985003    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls podName:ff5fcbb2-24f9-434f-9e14-a032498123db nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.984992886 +0000 UTC m=+50.982912922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls") pod "dns-default-p8zln" (UID: "ff5fcbb2-24f9-434f-9e14-a032498123db") : secret "dns-default-metrics-tls" not found
Jul 02 21:36:46.821558 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.821490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4" event={"ID":"a7b7e92c-b1f9-46b7-8113-3854077820e8","Type":"ContainerStarted","Data":"aa2e0df3701f2ae4810309df5a02f3460cf6b0ea18e42dacc6f13932505bc2aa"}
Jul 02 21:36:46.823313 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.823285    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65" event={"ID":"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6","Type":"ContainerStarted","Data":"beba1860548a9c884a82fd38afc26e6eff7526e8a282dadd7a9cbcb2da91e0b8"}
Jul 02 21:36:46.825266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.825233    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/0.log"
Jul 02 21:36:46.825366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.825273    2571 generic.go:356] "Generic (PLEG): container finished" podID="53580e86-54c5-4b81-afb5-82a247fd9caa" containerID="9520ea5d708b72e611861f31d36a9468696917e9ee4170ddd13f60c45a54f704" exitCode=255
Jul 02 21:36:46.825366 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.825351    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" event={"ID":"53580e86-54c5-4b81-afb5-82a247fd9caa","Type":"ContainerDied","Data":"9520ea5d708b72e611861f31d36a9468696917e9ee4170ddd13f60c45a54f704"}
Jul 02 21:36:46.825557 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.825541    2571 scope.go:117] "RemoveContainer" containerID="9520ea5d708b72e611861f31d36a9468696917e9ee4170ddd13f60c45a54f704"
Jul 02 21:36:46.831976 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.831737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldwg6" event={"ID":"2ea5b680-7b01-4262-9fb7-1aa02a08abad","Type":"ContainerStarted","Data":"d8ddeb95b936fcc6d2c30d305b912624f319863221d20450c3d3d3babcc1e451"}
Jul 02 21:36:46.837981 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.835919    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" event={"ID":"d164b23f-6290-4f3e-9199-b583850e1d39","Type":"ContainerStarted","Data":"1876fb6074298360123e874002643d57f6069540c0898ec9f62c8e9bcf8f5616"}
Jul 02 21:36:46.837981 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.837544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s" event={"ID":"4d55d228-b865-407d-a043-43847600e36e","Type":"ContainerStarted","Data":"d658f013cacddad0c4adae07b5112f6a69ffb034313b3672717e2c3c82ef107d"}
Jul 02 21:36:46.837981 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.837867    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4" podStartSLOduration=20.94502357 podStartE2EDuration="28.837850634s" totalImagesPullingTime="7.892827064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.837085268 +0000 UTC m=+45.835005345" watchObservedRunningTime="2026-07-02 21:36:46.837850634 +0000 UTC m=+45.835770690"
Jul 02 21:36:46.839692 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.839663    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49" event={"ID":"82fd403a-1b97-4828-82b4-a0ccc90d21c5","Type":"ContainerStarted","Data":"684df1433268f12e70b4a39600bd2ddd0ded6e626e78e930f049769496cb00d6"}
Jul 02 21:36:46.842647 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.842618    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7" event={"ID":"534fa6be-3350-4cf5-b252-362e4e88dddf","Type":"ContainerStarted","Data":"6b386332ea7baa2087a7c225d44eca3bfc04dbb3f2f8648ae8bef586f5d504c7"}
Jul 02 21:36:46.873203 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.872838    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tx4kd" podStartSLOduration=13.280796338 podStartE2EDuration="44.872819388s" totalImagesPullingTime="31.59202305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.858591612 +0000 UTC m=+45.856511686" watchObservedRunningTime="2026-07-02 21:36:46.872819388 +0000 UTC m=+45.870739444"
Jul 02 21:36:46.893103 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.892613    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ldwg6" podStartSLOduration=3.019632814 podStartE2EDuration="10.892591478s" totalImagesPullingTime="7.872958664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.874399644 +0000 UTC m=+45.872319726" watchObservedRunningTime="2026-07-02 21:36:46.892591478 +0000 UTC m=+45.890511533"
Jul 02 21:36:46.912006 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.911945    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65" podStartSLOduration=21.035265162 podStartE2EDuration="28.911923233s" totalImagesPullingTime="7.876658071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.909949525 +0000 UTC m=+45.907869608" watchObservedRunningTime="2026-07-02 21:36:46.911923233 +0000 UTC m=+45.909843289"
Jul 02 21:36:46.926445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.926393    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pqb49" podStartSLOduration=21.018262196 podStartE2EDuration="28.926378148s" totalImagesPullingTime="7.908115952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.925262346 +0000 UTC m=+45.923182394" watchObservedRunningTime="2026-07-02 21:36:46.926378148 +0000 UTC m=+45.924298204"
Jul 02 21:36:46.964665 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.964605    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-dlmd7" podStartSLOduration=21.101383355 podStartE2EDuration="28.964584645s" totalImagesPullingTime="7.86320129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.963503241 +0000 UTC m=+45.961423288" watchObservedRunningTime="2026-07-02 21:36:46.964584645 +0000 UTC m=+45.962504701"
Jul 02 21:36:46.965413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:46.965364    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s" podStartSLOduration=20.07600146 podStartE2EDuration="27.965354043s" totalImagesPullingTime="7.889352583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:46.943216324 +0000 UTC m=+45.941136380" watchObservedRunningTime="2026-07-02 21:36:46.965354043 +0000 UTC m=+45.963274100"
Jul 02 21:36:47.585356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.585324    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cct6d"]
Jul 02 21:36:47.606681 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.606628    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cct6d"]
Jul 02 21:36:47.607206 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.607180    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.609504 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.609477    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 21:36:47.609837 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.609817    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 21:36:47.610346 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.610327    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pbj6p\""
Jul 02 21:36:47.723517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.723483    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56b2355d-7f8a-477d-b7db-f350914e34b6-crio-socket\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.723517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.723523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tt97\" (UniqueName: \"kubernetes.io/projected/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-api-access-9tt97\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.723701 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.723559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.723701 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.723677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56b2355d-7f8a-477d-b7db-f350914e34b6-data-volume\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.723818 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.723747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.824645 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.824613    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56b2355d-7f8a-477d-b7db-f350914e34b6-data-volume\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.824682    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:47.824813    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.824854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56b2355d-7f8a-477d-b7db-f350914e34b6-crio-socket\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:47.824885    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:48.324864505 +0000 UTC m=+47.322784537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : configmap "kube-rbac-proxy" not found
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.824914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tt97\" (UniqueName: \"kubernetes.io/projected/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-api-access-9tt97\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.824953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.824989    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56b2355d-7f8a-477d-b7db-f350914e34b6-data-volume\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.825029    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56b2355d-7f8a-477d-b7db-f350914e34b6-crio-socket\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.825392 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:47.825067    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:47.825392 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:47.825110    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:48.325097803 +0000 UTC m=+47.323017869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:47.833862 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.833838    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tt97\" (UniqueName: \"kubernetes.io/projected/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-api-access-9tt97\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:47.847485 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.847434    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:36:47.847847 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.847834    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/0.log"
Jul 02 21:36:47.847896 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.847866    2571 generic.go:356] "Generic (PLEG): container finished" podID="53580e86-54c5-4b81-afb5-82a247fd9caa" containerID="97be0d09e2ff3630978978bd83fa167468a90701c581264ae5bba6619331d622" exitCode=255
Jul 02 21:36:47.847966 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.847941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" event={"ID":"53580e86-54c5-4b81-afb5-82a247fd9caa","Type":"ContainerDied","Data":"97be0d09e2ff3630978978bd83fa167468a90701c581264ae5bba6619331d622"}
Jul 02 21:36:47.848085 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.848029    2571 scope.go:117] "RemoveContainer" containerID="9520ea5d708b72e611861f31d36a9468696917e9ee4170ddd13f60c45a54f704"
Jul 02 21:36:47.848250 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:47.848234    2571 scope.go:117] "RemoveContainer" containerID="97be0d09e2ff3630978978bd83fa167468a90701c581264ae5bba6619331d622"
Jul 02 21:36:47.848429 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:47.848404    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ljhv8_openshift-console-operator(53580e86-54c5-4b81-afb5-82a247fd9caa)\"" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" podUID="53580e86-54c5-4b81-afb5-82a247fd9caa"
Jul 02 21:36:48.331014 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:48.330983    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:48.331192 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:48.331114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:48.331192 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:48.331146    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:48.331295 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:48.331208    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:36:48.331295 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:48.331253    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:49.331237326 +0000 UTC m=+48.329157364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:48.331295 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:48.331294    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:49.331279208 +0000 UTC m=+48.329199242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : configmap "kube-rbac-proxy" not found
Jul 02 21:36:48.852847 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:48.852816    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:36:48.853276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:48.853108    2571 scope.go:117] "RemoveContainer" containerID="97be0d09e2ff3630978978bd83fa167468a90701c581264ae5bba6619331d622"
Jul 02 21:36:48.853337 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:48.853269    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ljhv8_openshift-console-operator(53580e86-54c5-4b81-afb5-82a247fd9caa)\"" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" podUID="53580e86-54c5-4b81-afb5-82a247fd9caa"
Jul 02 21:36:49.341325 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:49.341285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:49.341513 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:49.341410    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:36:49.341513 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:49.341409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:49.341513 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:49.341476    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.341458145 +0000 UTC m=+50.339378179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : configmap "kube-rbac-proxy" not found
Jul 02 21:36:49.341513 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:49.341497    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:49.341703 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:49.341570    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:51.341553869 +0000 UTC m=+50.339473918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:49.548000 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:49.547974    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bndfl_46ded035-79e8-4c40-87de-9bab0965336e/dns-node-resolver/0.log"
Jul 02 21:36:50.749208 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:50.749151    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rmmlm_2a863c86-f513-4fff-9402-d63252872752/node-ca/0.log"
Jul 02 21:36:51.151641 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:51.151612    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ldwg6_2ea5b680-7b01-4262-9fb7-1aa02a08abad/serve-healthcheck-canary/0.log"
Jul 02 21:36:51.357642 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:51.357610    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:51.357800 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:51.357779    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:51.357842 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:51.357816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:51.357876 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:51.357849    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:55.357830086 +0000 UTC m=+54.355750141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:51.357876 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:51.357871    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:36:51.357944 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:51.357926    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:55.35791461 +0000 UTC m=+54.355834659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : configmap "kube-rbac-proxy" not found
Jul 02 21:36:52.063925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:52.063888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:36:52.063925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:52.063929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:52.063982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:52.064009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064049    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:52.064053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064112    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls podName:e5cfef61-1fbb-4f29-82ff-42ecdf62bb85 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:08.064094237 +0000 UTC m=+67.062014293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fflrm" (UID: "e5cfef61-1fbb-4f29-82ff-42ecdf62bb85") : secret "samples-operator-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064122    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064172    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064122    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:52.064189    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064210    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls podName:1da23408-506e-47cc-841d-c449810a2b17 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:08.064198413 +0000 UTC m=+67.062118463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j8zkd" (UID: "1da23408-506e-47cc-841d-c449810a2b17") : secret "cluster-monitoring-operator-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064228    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:08.064219846 +0000 UTC m=+67.062139883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : secret "router-metrics-certs-default" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064243    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls podName:ff5fcbb2-24f9-434f-9e14-a032498123db nodeName:}" failed. No retries permitted until 2026-07-02 21:37:08.064236115 +0000 UTC m=+67.062156148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls") pod "dns-default-p8zln" (UID: "ff5fcbb2-24f9-434f-9e14-a032498123db") : secret "dns-default-metrics-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064256    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064261    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle podName:7eb2a04b-cf88-4bce-8ead-1d077a6b8474 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:08.064251417 +0000 UTC m=+67.062171454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle") pod "router-default-85b98f7769-6nglb" (UID: "7eb2a04b-cf88-4bce-8ead-1d077a6b8474") : configmap references non-existent config key: service-ca.crt
Jul 02 21:36:52.064386 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064268    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7df65677-9q4tk: secret "image-registry-tls" not found
Jul 02 21:36:52.064847 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:52.064305    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls podName:e287e55b-7f42-4df7-aa9f-071f35197b40 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:08.06429666 +0000 UTC m=+67.062216711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls") pod "image-registry-d7df65677-9q4tk" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40") : secret "image-registry-tls" not found
Jul 02 21:36:55.395059 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:55.395024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:55.395519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:55.395120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:55.395519 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:55.395200    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:55.395519 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:55.395267    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls podName:56b2355d-7f8a-477d-b7db-f350914e34b6 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:03.395251245 +0000 UTC m=+62.393171280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cct6d" (UID: "56b2355d-7f8a-477d-b7db-f350914e34b6") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:36:55.395629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:55.395612    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56b2355d-7f8a-477d-b7db-f350914e34b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:36:56.512235 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:56.512207    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:56.512681 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:56.512253    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:36:56.512681 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:36:56.512566    2571 scope.go:117] "RemoveContainer" containerID="97be0d09e2ff3630978978bd83fa167468a90701c581264ae5bba6619331d622"
Jul 02 21:36:56.512754 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:36:56.512702    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ljhv8_openshift-console-operator(53580e86-54c5-4b81-afb5-82a247fd9caa)\"" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" podUID="53580e86-54c5-4b81-afb5-82a247fd9caa"
Jul 02 21:37:03.264314 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.264283    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4k2z"
Jul 02 21:37:03.458871 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.458826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:37:03.461029 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.461009    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56b2355d-7f8a-477d-b7db-f350914e34b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cct6d\" (UID: \"56b2355d-7f8a-477d-b7db-f350914e34b6\") " pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:37:03.524334 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.524256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pbj6p\""
Jul 02 21:37:03.532511 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.532492    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cct6d"
Jul 02 21:37:03.657552 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.657436    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cct6d"]
Jul 02 21:37:03.660004 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:03.659975    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b2355d_7f8a_477d_b7db_f350914e34b6.slice/crio-dac2f521d8aea110c94494b73f182c2ec603307f1d68711059d8b23797a3add1 WatchSource:0}: Error finding container dac2f521d8aea110c94494b73f182c2ec603307f1d68711059d8b23797a3add1: Status 404 returned error can't find the container with id dac2f521d8aea110c94494b73f182c2ec603307f1d68711059d8b23797a3add1
Jul 02 21:37:03.900019 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:03.899982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cct6d" event={"ID":"56b2355d-7f8a-477d-b7db-f350914e34b6","Type":"ContainerStarted","Data":"dac2f521d8aea110c94494b73f182c2ec603307f1d68711059d8b23797a3add1"}
Jul 02 21:37:07.297256 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.297226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:37:07.297614 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.297449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:37:07.302044 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.300078    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 21:37:07.302044 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.300091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 21:37:07.309797 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.309772    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47776b6a-6004-4f70-a8fc-9339ebba8a9c-original-pull-secret\") pod \"global-pull-secret-syncer-6xm9s\" (UID: \"47776b6a-6004-4f70-a8fc-9339ebba8a9c\") " pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:37:07.309893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.309800    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d380bb8-4c0e-4be3-9ebd-f27a7a869037-metrics-certs\") pod \"network-metrics-daemon-zc8td\" (UID: \"7d380bb8-4c0e-4be3-9ebd-f27a7a869037\") " pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:37:07.319712 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.319688    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dkhhs\""
Jul 02 21:37:07.327758 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.327741    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zc8td"
Jul 02 21:37:07.452707 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.452614    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zc8td"]
Jul 02 21:37:07.455316 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:07.455290    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d380bb8_4c0e_4be3_9ebd_f27a7a869037.slice/crio-397515c7740f7f715574554c516d0feca9a80b1e5ac16fe489346acacfeb32c8 WatchSource:0}: Error finding container 397515c7740f7f715574554c516d0feca9a80b1e5ac16fe489346acacfeb32c8: Status 404 returned error can't find the container with id 397515c7740f7f715574554c516d0feca9a80b1e5ac16fe489346acacfeb32c8
Jul 02 21:37:07.498853 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.498824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:37:07.501753 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.501732    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbh4k\" (UniqueName: \"kubernetes.io/projected/7a46896c-0377-4ffd-811e-e1e299242000-kube-api-access-jbh4k\") pod \"network-check-target-2wwfp\" (UID: \"7a46896c-0377-4ffd-811e-e1e299242000\") " pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:37:07.516387 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.516370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xm9s"
Jul 02 21:37:07.625327 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.625302    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ckjxv\""
Jul 02 21:37:07.633625 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.633601    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:37:07.635170 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.635130    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xm9s"]
Jul 02 21:37:07.637945 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:07.637926    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47776b6a_6004_4f70_a8fc_9339ebba8a9c.slice/crio-45665757d59289cdf875e6d17c3ecb0c9049818e5187c4f894e371bdf82f8eb9 WatchSource:0}: Error finding container 45665757d59289cdf875e6d17c3ecb0c9049818e5187c4f894e371bdf82f8eb9: Status 404 returned error can't find the container with id 45665757d59289cdf875e6d17c3ecb0c9049818e5187c4f894e371bdf82f8eb9
Jul 02 21:37:07.754067 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.753984    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wwfp"]
Jul 02 21:37:07.758425 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:07.758396    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a46896c_0377_4ffd_811e_e1e299242000.slice/crio-1ea12d3bea8eb3e6bed8aefc80e93099b170b6de51980059a9d60c5d3cf17a8c WatchSource:0}: Error finding container 1ea12d3bea8eb3e6bed8aefc80e93099b170b6de51980059a9d60c5d3cf17a8c: Status 404 returned error can't find the container with id 1ea12d3bea8eb3e6bed8aefc80e93099b170b6de51980059a9d60c5d3cf17a8c
Jul 02 21:37:07.916843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.916803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xm9s" event={"ID":"47776b6a-6004-4f70-a8fc-9339ebba8a9c","Type":"ContainerStarted","Data":"45665757d59289cdf875e6d17c3ecb0c9049818e5187c4f894e371bdf82f8eb9"}
Jul 02 21:37:07.919130 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.919097    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wwfp" event={"ID":"7a46896c-0377-4ffd-811e-e1e299242000","Type":"ContainerStarted","Data":"480c05a8fee59578515b503d617d78a6b6ae5776023bf8e0dcbbe740f897188e"}
Jul 02 21:37:07.919283 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.919144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wwfp" event={"ID":"7a46896c-0377-4ffd-811e-e1e299242000","Type":"ContainerStarted","Data":"1ea12d3bea8eb3e6bed8aefc80e93099b170b6de51980059a9d60c5d3cf17a8c"}
Jul 02 21:37:07.919283 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.919242    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:37:07.920887 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.920861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zc8td" event={"ID":"7d380bb8-4c0e-4be3-9ebd-f27a7a869037","Type":"ContainerStarted","Data":"397515c7740f7f715574554c516d0feca9a80b1e5ac16fe489346acacfeb32c8"}
Jul 02 21:37:07.922458 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.922438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cct6d" event={"ID":"56b2355d-7f8a-477d-b7db-f350914e34b6","Type":"ContainerStarted","Data":"2a2feb0e3a4f8b1bceac7ae941d3b772ab5c0c985773a517cabb26a4375e0e28"}
Jul 02 21:37:07.936056 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:07.936012    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2wwfp" podStartSLOduration=65.935998549 podStartE2EDuration="1m5.935998549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:07.934391405 +0000 UTC m=+66.932311462" watchObservedRunningTime="2026-07-02 21:37:07.935998549 +0000 UTC m=+66.933918637"
Jul 02 21:37:08.104994 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.104957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:08.105193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.105015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:37:08.105193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.105034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:08.105193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.105055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:08.105193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.105080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:37:08.105193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.105120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:37:08.105800 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.105752    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-service-ca-bundle\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:08.108198 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.108173    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"image-registry-d7df65677-9q4tk\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") " pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:08.108318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.108179    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7eb2a04b-cf88-4bce-8ead-1d077a6b8474-metrics-certs\") pod \"router-default-85b98f7769-6nglb\" (UID: \"7eb2a04b-cf88-4bce-8ead-1d077a6b8474\") " pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:08.108318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.108245    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5cfef61-1fbb-4f29-82ff-42ecdf62bb85-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fflrm\" (UID: \"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:37:08.108425 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.108410    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1da23408-506e-47cc-841d-c449810a2b17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j8zkd\" (UID: \"1da23408-506e-47cc-841d-c449810a2b17\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:37:08.108481 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.108442    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff5fcbb2-24f9-434f-9e14-a032498123db-metrics-tls\") pod \"dns-default-p8zln\" (UID: \"ff5fcbb2-24f9-434f-9e14-a032498123db\") " pod="openshift-dns/dns-default-p8zln"
Jul 02 21:37:08.228331 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.228281    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kd4ch\""
Jul 02 21:37:08.236436 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.236411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"
Jul 02 21:37:08.251754 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.251697    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzgxn\""
Jul 02 21:37:08.259990 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.259963    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:08.260939 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.260914    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wf92v\""
Jul 02 21:37:08.269899 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.269844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"
Jul 02 21:37:08.278491 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.278399    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bv4sq\""
Jul 02 21:37:08.286347 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.286190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p8zln"
Jul 02 21:37:08.301274 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.301254    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pkggz\""
Jul 02 21:37:08.308867 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.308842    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:08.551749 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.551721    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd"]
Jul 02 21:37:08.567556 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.566659    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d7df65677-9q4tk"]
Jul 02 21:37:08.607255 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:08.607221    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da23408_506e_47cc_841d_c449810a2b17.slice/crio-872a3f1b3865997845d2799433b7429a225789d24d5d9f949358e38803dacae6 WatchSource:0}: Error finding container 872a3f1b3865997845d2799433b7429a225789d24d5d9f949358e38803dacae6: Status 404 returned error can't find the container with id 872a3f1b3865997845d2799433b7429a225789d24d5d9f949358e38803dacae6
Jul 02 21:37:08.608024 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:08.607999    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode287e55b_7f42_4df7_aa9f_071f35197b40.slice/crio-26e1132ae02752f513c58145df22a5034b9e7fddb2af0bd6e164df3191d07348 WatchSource:0}: Error finding container 26e1132ae02752f513c58145df22a5034b9e7fddb2af0bd6e164df3191d07348: Status 404 returned error can't find the container with id 26e1132ae02752f513c58145df22a5034b9e7fddb2af0bd6e164df3191d07348
Jul 02 21:37:08.613701 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.613678    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm"]
Jul 02 21:37:08.792303 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.792273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p8zln"]
Jul 02 21:37:08.794843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.794818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85b98f7769-6nglb"]
Jul 02 21:37:08.797317 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:08.797284    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5fcbb2_24f9_434f_9e14_a032498123db.slice/crio-d0755e7cd3763f4408a96666f7e25bcc16c7afe2c5a92052e5610c32deb673c4 WatchSource:0}: Error finding container d0755e7cd3763f4408a96666f7e25bcc16c7afe2c5a92052e5610c32deb673c4: Status 404 returned error can't find the container with id d0755e7cd3763f4408a96666f7e25bcc16c7afe2c5a92052e5610c32deb673c4
Jul 02 21:37:08.798924 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:08.798896    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb2a04b_cf88_4bce_8ead_1d077a6b8474.slice/crio-df9920e750b25c48d6590d72726f0fdc5f4ffb47215c8ea16b2565b9a7727357 WatchSource:0}: Error finding container df9920e750b25c48d6590d72726f0fdc5f4ffb47215c8ea16b2565b9a7727357: Status 404 returned error can't find the container with id df9920e750b25c48d6590d72726f0fdc5f4ffb47215c8ea16b2565b9a7727357
Jul 02 21:37:08.928129 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.928046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm" event={"ID":"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85","Type":"ContainerStarted","Data":"93ed025a90dd4741a0046a90cb195f828a039614bd54368dcddaa27c943b92a4"}
Jul 02 21:37:08.929711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.929655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p8zln" event={"ID":"ff5fcbb2-24f9-434f-9e14-a032498123db","Type":"ContainerStarted","Data":"d0755e7cd3763f4408a96666f7e25bcc16c7afe2c5a92052e5610c32deb673c4"}
Jul 02 21:37:08.931281 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.931247    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd" event={"ID":"1da23408-506e-47cc-841d-c449810a2b17","Type":"ContainerStarted","Data":"872a3f1b3865997845d2799433b7429a225789d24d5d9f949358e38803dacae6"}
Jul 02 21:37:08.933240 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.933214    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85b98f7769-6nglb" event={"ID":"7eb2a04b-cf88-4bce-8ead-1d077a6b8474","Type":"ContainerStarted","Data":"96abfce08b6d3e2afabb3945070438b16ee4ba0c79444f2c345dd6fbaaf7168e"}
Jul 02 21:37:08.933334 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.933257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85b98f7769-6nglb" event={"ID":"7eb2a04b-cf88-4bce-8ead-1d077a6b8474","Type":"ContainerStarted","Data":"df9920e750b25c48d6590d72726f0fdc5f4ffb47215c8ea16b2565b9a7727357"}
Jul 02 21:37:08.935572 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.935548    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zc8td" event={"ID":"7d380bb8-4c0e-4be3-9ebd-f27a7a869037","Type":"ContainerStarted","Data":"1f2c6a9da3968799347427bba37d84b3c763d20cd68018895e5afbddb4f627be"}
Jul 02 21:37:08.938868 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.938747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" event={"ID":"e287e55b-7f42-4df7-aa9f-071f35197b40","Type":"ContainerStarted","Data":"6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127"}
Jul 02 21:37:08.938868 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.938784    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" event={"ID":"e287e55b-7f42-4df7-aa9f-071f35197b40","Type":"ContainerStarted","Data":"26e1132ae02752f513c58145df22a5034b9e7fddb2af0bd6e164df3191d07348"}
Jul 02 21:37:08.938868 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.938811    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:08.941605 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.941542    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cct6d" event={"ID":"56b2355d-7f8a-477d-b7db-f350914e34b6","Type":"ContainerStarted","Data":"c054d177bf637fcc681fc0235f9f398fc821f600017548b4a4f9891b1315519f"}
Jul 02 21:37:08.952005 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.951939    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85b98f7769-6nglb" podStartSLOduration=50.951924861 podStartE2EDuration="50.951924861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:08.951499457 +0000 UTC m=+67.949419553" watchObservedRunningTime="2026-07-02 21:37:08.951924861 +0000 UTC m=+67.949844916"
Jul 02 21:37:08.973685 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:08.973116    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" podStartSLOduration=67.973095267 podStartE2EDuration="1m7.973095267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:08.972995652 +0000 UTC m=+67.970915710" watchObservedRunningTime="2026-07-02 21:37:08.973095267 +0000 UTC m=+67.971015323"
Jul 02 21:37:09.309480 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:09.309312    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:09.312903 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:09.312874    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:09.951504 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:09.950981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zc8td" event={"ID":"7d380bb8-4c0e-4be3-9ebd-f27a7a869037","Type":"ContainerStarted","Data":"d916bce6bdcd72fb19b8e02f506d7e5e74ecb3dd53042768353d8c3a82471f5c"}
Jul 02 21:37:09.951504 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:09.951421    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:09.952968 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:09.952908    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85b98f7769-6nglb"
Jul 02 21:37:09.968656 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:09.968360    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zc8td" podStartSLOduration=66.787006658 podStartE2EDuration="1m7.96833749s" totalImagesPullingTime="1.181330832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:09.966617243 +0000 UTC m=+68.964537322" watchObservedRunningTime="2026-07-02 21:37:09.96833749 +0000 UTC m=+68.966257547"
Jul 02 21:37:10.606618 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:10.606263    2571 scope.go:117] "RemoveContainer" containerID="97be0d09e2ff3630978978bd83fa167468a90701c581264ae5bba6619331d622"
Jul 02 21:37:14.970547 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.970511    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:37:14.971040 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.970616    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" event={"ID":"53580e86-54c5-4b81-afb5-82a247fd9caa","Type":"ContainerStarted","Data":"6f2d202270485d7cb95ae50a6c631151edebab0a8c287da169e4ddf5f75e902a"}
Jul 02 21:37:14.971040 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.970922    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:37:14.973068 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.973045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cct6d" event={"ID":"56b2355d-7f8a-477d-b7db-f350914e34b6","Type":"ContainerStarted","Data":"95db6411ed69a695c8717ca8ade6e45e61875b037877980ee5cf688e69c73437"}
Jul 02 21:37:14.974715 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.974682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xm9s" event={"ID":"47776b6a-6004-4f70-a8fc-9339ebba8a9c","Type":"ContainerStarted","Data":"fee224b8b7a391f8a00674870fa854dce4fa8c4595472b5ea758ba1e761ec804"}
Jul 02 21:37:14.976494 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.976467    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm" event={"ID":"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85","Type":"ContainerStarted","Data":"b9fda5c06918fe740054c82edff2b189946915c535a0d9557f1adce7ed9c6de7"}
Jul 02 21:37:14.976606 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.976515    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm" event={"ID":"e5cfef61-1fbb-4f29-82ff-42ecdf62bb85","Type":"ContainerStarted","Data":"5d368c1827239b96e534c3ae1fc1b420118226c33c43e5efc494a9be9d8a2731"}
Jul 02 21:37:14.978304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.978282    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p8zln" event={"ID":"ff5fcbb2-24f9-434f-9e14-a032498123db","Type":"ContainerStarted","Data":"fef90235fc91c42a31f8e56400ae7c73f9f5fddb532856e0b5e1f520cd562ded"}
Jul 02 21:37:14.978390 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.978321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p8zln" event={"ID":"ff5fcbb2-24f9-434f-9e14-a032498123db","Type":"ContainerStarted","Data":"d023c49d8a1f408f8656f22e234141087181c1444418e59edc42a94657a6cad5"}
Jul 02 21:37:14.978390 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.978369    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p8zln"
Jul 02 21:37:14.979789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.979770    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd" event={"ID":"1da23408-506e-47cc-841d-c449810a2b17","Type":"ContainerStarted","Data":"834747b7fe05dac182172e3718aaf2a23118160673f003f4975c9ddce054628e"}
Jul 02 21:37:14.989530 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:14.989482    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8" podStartSLOduration=48.107320159 podStartE2EDuration="55.989464847s" totalImagesPullingTime="7.882144688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:14.987712476 +0000 UTC m=+73.985632531" watchObservedRunningTime="2026-07-02 21:37:14.989464847 +0000 UTC m=+73.987384902"
Jul 02 21:37:15.002246 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:15.002202    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6xm9s" podStartSLOduration=66.334784841 podStartE2EDuration="1m13.002185721s" totalImagesPullingTime="6.66740088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:15.001220503 +0000 UTC m=+73.999140587" watchObservedRunningTime="2026-07-02 21:37:15.002185721 +0000 UTC m=+74.000105780"
Jul 02 21:37:15.017259 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:15.017216    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fflrm" podStartSLOduration=51.39435668 podStartE2EDuration="57.017197439s" totalImagesPullingTime="5.622840759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:15.015571083 +0000 UTC m=+74.013491136" watchObservedRunningTime="2026-07-02 21:37:15.017197439 +0000 UTC m=+74.015117493"
Jul 02 21:37:15.033119 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:15.033082    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cct6d" podStartSLOduration=17.662048562 podStartE2EDuration="28.033067733s" totalImagesPullingTime="10.371019171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:36:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:15.032761776 +0000 UTC m=+74.030681833" watchObservedRunningTime="2026-07-02 21:37:15.033067733 +0000 UTC m=+74.030987787"
Jul 02 21:37:15.048691 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:15.048648    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p8zln" podStartSLOduration=33.553179842 podStartE2EDuration="39.048639183s" totalImagesPullingTime="5.495459341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:15.047674421 +0000 UTC m=+74.045594475" watchObservedRunningTime="2026-07-02 21:37:15.048639183 +0000 UTC m=+74.046559238"
Jul 02 21:37:15.068109 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:15.068068    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j8zkd" podStartSLOduration=51.410364939 podStartE2EDuration="57.068057569s" totalImagesPullingTime="5.65769263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:15.067391639 +0000 UTC m=+74.065311693" watchObservedRunningTime="2026-07-02 21:37:15.068057569 +0000 UTC m=+74.065977628"
Jul 02 21:37:15.176962 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:15.176935    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-ljhv8"
Jul 02 21:37:24.986245 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:24.986098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p8zln"
Jul 02 21:37:25.299253 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.299178    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"]
Jul 02 21:37:25.301851 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.301833    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.304462 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.304424    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 02 21:37:25.304462 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.304426    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 02 21:37:25.305776 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.305755    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 02 21:37:25.305898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.305837    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 21:37:25.305963 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.305950    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fxv84\""
Jul 02 21:37:25.307187 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.307167    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5v472"]
Jul 02 21:37:25.314581 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.314563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.317051 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.317028    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 21:37:25.317191 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.317055    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 21:37:25.317191 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.317058    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 21:37:25.317318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.317188    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p4xt9\""
Jul 02 21:37:25.317564 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.317544    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"]
Jul 02 21:37:25.331424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwm79\" (UniqueName: \"kubernetes.io/projected/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-api-access-hwm79\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.331517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-root\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.331517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bafa2f8c-32b7-4d3b-81be-009c8b116360-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.331517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331542    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-textfile\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-metrics-client-ca\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bafa2f8c-32b7-4d3b-81be-009c8b116360-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-tls\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xkb\" (UniqueName: \"kubernetes.io/projected/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-kube-api-access-h6xkb\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331672    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-wtmp\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331930 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-sys\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.331930 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.331713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.432034 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-root\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432238 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432046    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.432238 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bafa2f8c-32b7-4d3b-81be-009c8b116360-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.432238 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.432238 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432132    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-root\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432238 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:25.432210    2571 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-textfile\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:25.432279    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-tls podName:bafa2f8c-32b7-4d3b-81be-009c8b116360 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:25.932259403 +0000 UTC m=+84.930179448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-j6cck" (UID: "bafa2f8c-32b7-4d3b-81be-009c8b116360") : secret "kube-state-metrics-tls" not found
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-metrics-client-ca\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bafa2f8c-32b7-4d3b-81be-009c8b116360-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-tls\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xkb\" (UniqueName: \"kubernetes.io/projected/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-kube-api-access-h6xkb\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432494    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bafa2f8c-32b7-4d3b-81be-009c8b116360-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.432522 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-wtmp\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432567    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-textfile\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-sys\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432612    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-sys\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432636    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-wtmp\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.432659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwm79\" (UniqueName: \"kubernetes.io/projected/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-api-access-hwm79\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:25.432716    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 21:37:25.433012 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:25.432761    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-tls podName:2a6a7fbc-96bc-49d6-a458-1e38bc14989b nodeName:}" failed. No retries permitted until 2026-07-02 21:37:25.932744914 +0000 UTC m=+84.930664956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-tls") pod "node-exporter-5v472" (UID: "2a6a7fbc-96bc-49d6-a458-1e38bc14989b") : secret "node-exporter-tls" not found
Jul 02 21:37:25.433424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.433128    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bafa2f8c-32b7-4d3b-81be-009c8b116360-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.433424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.433220    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-metrics-client-ca\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433547 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.433526    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.433680 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.433660    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.434906 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.434891    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.435185 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.435165    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.443843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.443820    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xkb\" (UniqueName: \"kubernetes.io/projected/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-kube-api-access-h6xkb\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.446139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.446117    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwm79\" (UniqueName: \"kubernetes.io/projected/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-api-access-hwm79\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.482733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.482708    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd69f766c-pdwhz"]
Jul 02 21:37:25.485295 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.485281    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.487756 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.487732    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 21:37:25.487910 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.487761    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 21:37:25.487910 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.487770    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f8fvv\""
Jul 02 21:37:25.487910 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.487771    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 21:37:25.488102 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.487997    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 21:37:25.488102 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.488024    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 21:37:25.488102 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.488081    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 21:37:25.488296 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.488280    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 21:37:25.496039 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.496019    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd69f766c-pdwhz"]
Jul 02 21:37:25.533499 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.533474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-serving-cert\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.533640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.533515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hm8x\" (UniqueName: \"kubernetes.io/projected/61937d39-80f5-44be-b891-402b8b0f6c64-kube-api-access-4hm8x\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.533640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.533541    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-service-ca\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.533640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.533610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-oauth-config\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.533800 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.533675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-console-config\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.533800 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.533725    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-oauth-serving-cert\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634035 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-service-ca\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634212 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-oauth-config\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634212 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634075    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-console-config\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634212 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-oauth-serving-cert\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634212 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-serving-cert\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634212 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634175    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hm8x\" (UniqueName: \"kubernetes.io/projected/61937d39-80f5-44be-b891-402b8b0f6c64-kube-api-access-4hm8x\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634827 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634800    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-service-ca\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634811    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-console-config\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.634938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.634855    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-oauth-serving-cert\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.636500 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.636477    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-oauth-config\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.636584 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.636543    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-serving-cert\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.643604 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.643586    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hm8x\" (UniqueName: \"kubernetes.io/projected/61937d39-80f5-44be-b891-402b8b0f6c64-kube-api-access-4hm8x\") pod \"console-dd69f766c-pdwhz\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") " pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.794997 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.794966    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:25.923106 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.923039    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd69f766c-pdwhz"]
Jul 02 21:37:25.925954 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:25.925934    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61937d39_80f5_44be_b891_402b8b0f6c64.slice/crio-24aa4dd76dc36cf51c7924587f744a0d60e465c3f875cf26f8d5bd485d9ace9a WatchSource:0}: Error finding container 24aa4dd76dc36cf51c7924587f744a0d60e465c3f875cf26f8d5bd485d9ace9a: Status 404 returned error can't find the container with id 24aa4dd76dc36cf51c7924587f744a0d60e465c3f875cf26f8d5bd485d9ace9a
Jul 02 21:37:25.936077 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.936058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:25.936179 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.936100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-tls\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.938394 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.938368    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a6a7fbc-96bc-49d6-a458-1e38bc14989b-node-exporter-tls\") pod \"node-exporter-5v472\" (UID: \"2a6a7fbc-96bc-49d6-a458-1e38bc14989b\") " pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:25.938476 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:25.938405    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bafa2f8c-32b7-4d3b-81be-009c8b116360-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6cck\" (UID: \"bafa2f8c-32b7-4d3b-81be-009c8b116360\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:26.020860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.020832    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd69f766c-pdwhz" event={"ID":"61937d39-80f5-44be-b891-402b8b0f6c64","Type":"ContainerStarted","Data":"24aa4dd76dc36cf51c7924587f744a0d60e465c3f875cf26f8d5bd485d9ace9a"}
Jul 02 21:37:26.212964 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.212890    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"
Jul 02 21:37:26.223785 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.223760    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5v472"
Jul 02 21:37:26.236058 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:26.236030    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6a7fbc_96bc_49d6_a458_1e38bc14989b.slice/crio-e3845f4081310ec0d4976bb2020d9ef0a6ead51e5b933f444fc454fbb8027dbd WatchSource:0}: Error finding container e3845f4081310ec0d4976bb2020d9ef0a6ead51e5b933f444fc454fbb8027dbd: Status 404 returned error can't find the container with id e3845f4081310ec0d4976bb2020d9ef0a6ead51e5b933f444fc454fbb8027dbd
Jul 02 21:37:26.336423 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.336385    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:26.340289 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.340270    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.342793 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.342717    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 21:37:26.343433 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.343411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 21:37:26.343648 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.343630    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 21:37:26.343648 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.343642    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 21:37:26.343887 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.343859    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 21:37:26.344012 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.343933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 21:37:26.344084 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.344017    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 21:37:26.344084 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.344050    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 21:37:26.344210 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.344150    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 21:37:26.344367 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.344334    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kgscs\""
Jul 02 21:37:26.345576 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.345557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck"]
Jul 02 21:37:26.348475 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:26.348453    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafa2f8c_32b7_4d3b_81be_009c8b116360.slice/crio-57bdda7e9c36c92cfa9d639dbd7046c8cbbf0b1fecd3097544d3e76b80c99cd4 WatchSource:0}: Error finding container 57bdda7e9c36c92cfa9d639dbd7046c8cbbf0b1fecd3097544d3e76b80c99cd4: Status 404 returned error can't find the container with id 57bdda7e9c36c92cfa9d639dbd7046c8cbbf0b1fecd3097544d3e76b80c99cd4
Jul 02 21:37:26.358475 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.358455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:26.440430 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-out\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440526    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440732 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440732 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-volume\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440732 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440697    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-web-config\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440732 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440759    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtzt\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-kube-api-access-2xtzt\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.440883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.440845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.541906 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.541820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-web-config\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.541906 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.541859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.541906 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.541892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.541925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtzt\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-kube-api-access-2xtzt\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.541947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.541977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-out\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542184 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542584 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542584 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-volume\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542584 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.542293    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.542856 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:26.542836    2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 21:37:26.542938 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:26.542903    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls podName:547ea22d-7e10-4bbd-92cf-f22309ebfa37 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:27.042885539 +0000 UTC m=+86.040805575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37") : secret "alertmanager-main-tls" not found
Jul 02 21:37:26.543111 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.543087    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.544313 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.544292    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.545386 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.545344    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.545486 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.545391    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-volume\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.545486 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.545395    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.545486 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.545472    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-web-config\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.545884 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.545859    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.546422 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.546400    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.546865 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.546844    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-out\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.547032 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.547013    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:26.560668 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:26.560648    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtzt\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-kube-api-access-2xtzt\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:27.036271 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:27.036190    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck" event={"ID":"bafa2f8c-32b7-4d3b-81be-009c8b116360","Type":"ContainerStarted","Data":"57bdda7e9c36c92cfa9d639dbd7046c8cbbf0b1fecd3097544d3e76b80c99cd4"}
Jul 02 21:37:27.038320 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:27.038291    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v472" event={"ID":"2a6a7fbc-96bc-49d6-a458-1e38bc14989b","Type":"ContainerStarted","Data":"e3845f4081310ec0d4976bb2020d9ef0a6ead51e5b933f444fc454fbb8027dbd"}
Jul 02 21:37:27.046205 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:27.046129    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:27.049270 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:27.049249    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:27.251505 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:27.251466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:27.415010 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:27.414900    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:27.418570 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:27.418538    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547ea22d_7e10_4bbd_92cf_f22309ebfa37.slice/crio-49d6c6decb0e929204a35ca95562ff25ce5f11dadb4caf7962e426f4dd0b4718 WatchSource:0}: Error finding container 49d6c6decb0e929204a35ca95562ff25ce5f11dadb4caf7962e426f4dd0b4718: Status 404 returned error can't find the container with id 49d6c6decb0e929204a35ca95562ff25ce5f11dadb4caf7962e426f4dd0b4718
Jul 02 21:37:28.046640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:28.046611    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a6a7fbc-96bc-49d6-a458-1e38bc14989b" containerID="fc928b5e306c7ffa226474dac5327e96d211da4b14888668362aae025ddd1150" exitCode=0
Jul 02 21:37:28.047080 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:28.046741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v472" event={"ID":"2a6a7fbc-96bc-49d6-a458-1e38bc14989b","Type":"ContainerDied","Data":"fc928b5e306c7ffa226474dac5327e96d211da4b14888668362aae025ddd1150"}
Jul 02 21:37:28.048384 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:28.048349    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"49d6c6decb0e929204a35ca95562ff25ce5f11dadb4caf7962e426f4dd0b4718"}
Jul 02 21:37:28.268390 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:28.268074    2571 patch_prober.go:28] interesting pod/image-registry-d7df65677-9q4tk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 21:37:28.268390 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:28.268136    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" podUID="e287e55b-7f42-4df7-aa9f-071f35197b40" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 21:37:29.057284 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.057115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck" event={"ID":"bafa2f8c-32b7-4d3b-81be-009c8b116360","Type":"ContainerStarted","Data":"5c474b6f9717a616ca86a27affeadc5cca6ea8b298a08f016eb443fe350c1f58"}
Jul 02 21:37:29.057284 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.057197    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck" event={"ID":"bafa2f8c-32b7-4d3b-81be-009c8b116360","Type":"ContainerStarted","Data":"e999c6805772c671a1c339f02d891a78f32d1b59917d5c21abe3e76b6319fab2"}
Jul 02 21:37:29.057284 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.057226    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck" event={"ID":"bafa2f8c-32b7-4d3b-81be-009c8b116360","Type":"ContainerStarted","Data":"ec282b0876ce1d803e82561619c59cbc5f3db4358dd00061bea15de0b8c8c84c"}
Jul 02 21:37:29.059852 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.059814    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v472" event={"ID":"2a6a7fbc-96bc-49d6-a458-1e38bc14989b","Type":"ContainerStarted","Data":"c2e949d9fd5e20d2fcf65018fa4d2b1fe42f036acbee1b1dbc1fe99f34887030"}
Jul 02 21:37:29.060021 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.059870    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v472" event={"ID":"2a6a7fbc-96bc-49d6-a458-1e38bc14989b","Type":"ContainerStarted","Data":"26b1294cc9e5514020f4296358bf69679518cd897ab2a0f3301106fe71181211"}
Jul 02 21:37:29.078108 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.078056    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6cck" podStartSLOduration=2.421627796 podStartE2EDuration="4.07803821s" totalImagesPullingTime="1.656410414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:29.07518671 +0000 UTC m=+88.073106790" watchObservedRunningTime="2026-07-02 21:37:29.07803821 +0000 UTC m=+88.075958266"
Jul 02 21:37:29.095025 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.094966    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5v472" podStartSLOduration=2.989600728 podStartE2EDuration="4.094948101s" totalImagesPullingTime="1.023181994s" totalInitContainerRuntime="82.165379ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:29.093126097 +0000 UTC m=+88.091046195" watchObservedRunningTime="2026-07-02 21:37:29.094948101 +0000 UTC m=+88.092868158"
Jul 02 21:37:29.611878 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.611849    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dcdb95d79-kbmll"]
Jul 02 21:37:29.613991 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.613971    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.618883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.618857    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nngvs\""
Jul 02 21:37:29.619017 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.618882    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 21:37:29.619017 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.618942    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 21:37:29.619123 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.618857    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4g7cuep2bo4su\""
Jul 02 21:37:29.619616 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.619587    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 21:37:29.619724 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.619681    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 21:37:29.626325 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.626296    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcdb95d79-kbmll"]
Jul 02 21:37:29.671282 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671244    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8swb7\" (UniqueName: \"kubernetes.io/projected/8e9d433a-b1c2-445a-b607-7b6770a02503-kube-api-access-8swb7\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.671439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671291    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8e9d433a-b1c2-445a-b607-7b6770a02503-audit-log\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.671439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-secret-metrics-server-tls\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.671439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-secret-metrics-server-client-certs\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.671575 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8e9d433a-b1c2-445a-b607-7b6770a02503-metrics-server-audit-profiles\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.671575 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e9d433a-b1c2-445a-b607-7b6770a02503-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.671575 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.671513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-client-ca-bundle\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-client-ca-bundle\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8swb7\" (UniqueName: \"kubernetes.io/projected/8e9d433a-b1c2-445a-b607-7b6770a02503-kube-api-access-8swb7\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8e9d433a-b1c2-445a-b607-7b6770a02503-audit-log\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-secret-metrics-server-tls\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-secret-metrics-server-client-certs\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8e9d433a-b1c2-445a-b607-7b6770a02503-metrics-server-audit-profiles\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.772944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e9d433a-b1c2-445a-b607-7b6770a02503-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.773476    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8e9d433a-b1c2-445a-b607-7b6770a02503-audit-log\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.773733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.773686    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e9d433a-b1c2-445a-b607-7b6770a02503-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.774402 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.774378    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8e9d433a-b1c2-445a-b607-7b6770a02503-metrics-server-audit-profiles\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.775563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.775538    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-client-ca-bundle\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.776104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.776075    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-secret-metrics-server-tls\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.776705 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.776682    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8e9d433a-b1c2-445a-b607-7b6770a02503-secret-metrics-server-client-certs\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.780258 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.780229    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8swb7\" (UniqueName: \"kubernetes.io/projected/8e9d433a-b1c2-445a-b607-7b6770a02503-kube-api-access-8swb7\") pod \"metrics-server-dcdb95d79-kbmll\" (UID: \"8e9d433a-b1c2-445a-b607-7b6770a02503\") " pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.927542 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.927511    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:29.957574 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:29.957546    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:30.065909 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.065875    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8" exitCode=0
Jul 02 21:37:30.066373 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.065959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"}
Jul 02 21:37:30.068001 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.067973    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd69f766c-pdwhz" event={"ID":"61937d39-80f5-44be-b891-402b8b0f6c64","Type":"ContainerStarted","Data":"ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826"}
Jul 02 21:37:30.070430 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.070409    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcdb95d79-kbmll"]
Jul 02 21:37:30.073985 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:30.073963    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9d433a_b1c2_445a_b607_7b6770a02503.slice/crio-a1091fb940dcebf5d7751b5c3cdbf8aecff8d6908b31ef3cbce40f34be8e5cf4 WatchSource:0}: Error finding container a1091fb940dcebf5d7751b5c3cdbf8aecff8d6908b31ef3cbce40f34be8e5cf4: Status 404 returned error can't find the container with id a1091fb940dcebf5d7751b5c3cdbf8aecff8d6908b31ef3cbce40f34be8e5cf4
Jul 02 21:37:30.115920 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.115861    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd69f766c-pdwhz" podStartSLOduration=1.277030116 podStartE2EDuration="5.115843068s" totalImagesPullingTime="3.838812952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:30.113773837 +0000 UTC m=+89.111693892" watchObservedRunningTime="2026-07-02 21:37:30.115843068 +0000 UTC m=+89.113763123"
Jul 02 21:37:30.490316 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.490280    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c777f7f88-2sbfh"]
Jul 02 21:37:30.494232 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.494203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.496921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.496809    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 02 21:37:30.496921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.496855    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 02 21:37:30.496921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.496817    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 02 21:37:30.496921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.496891    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 02 21:37:30.497231 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.497091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tw2h6\""
Jul 02 21:37:30.497231 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.497204    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 02 21:37:30.502355 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.502330    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 02 21:37:30.522555 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.522523    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c777f7f88-2sbfh"]
Jul 02 21:37:30.581855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.581815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-federate-client-tls\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582046 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.581955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtqg\" (UniqueName: \"kubernetes.io/projected/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-kube-api-access-qqtqg\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582046 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.581997    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-secret-telemeter-client\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.582046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-serving-certs-ca-bundle\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.582081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.582113    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.582195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-metrics-client-ca\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.582416 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.582275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-telemeter-client-tls\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.682928 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.682882    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-serving-certs-ca-bundle\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683148 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.682942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683148 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.682972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.683167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-metrics-client-ca\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.683217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-telemeter-client-tls\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.683274    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-federate-client-tls\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683504 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.683354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtqg\" (UniqueName: \"kubernetes.io/projected/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-kube-api-access-qqtqg\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.683504 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.683394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-secret-telemeter-client\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.684091 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.684027    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.684253 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.684150    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-serving-certs-ca-bundle\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.684323 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.684277    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-metrics-client-ca\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.686449 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.686421    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.686940 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.686896    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-telemeter-client-tls\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.687065 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.686975    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-secret-telemeter-client\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.687733 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.687711    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-federate-client-tls\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.692465 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.692429    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtqg\" (UniqueName: \"kubernetes.io/projected/3366c98c-1305-4c5c-9bc3-3dc113aa4a00-kube-api-access-qqtqg\") pod \"telemeter-client-c777f7f88-2sbfh\" (UID: \"3366c98c-1305-4c5c-9bc3-3dc113aa4a00\") " pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.806653 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.806571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh"
Jul 02 21:37:30.987779 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:30.987739    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c777f7f88-2sbfh"]
Jul 02 21:37:30.990646 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:30.990616    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3366c98c_1305_4c5c_9bc3_3dc113aa4a00.slice/crio-172f9f9b9876f1f0ce307f75f7d472a740019993a664eee7fd1245c990a7d599 WatchSource:0}: Error finding container 172f9f9b9876f1f0ce307f75f7d472a740019993a664eee7fd1245c990a7d599: Status 404 returned error can't find the container with id 172f9f9b9876f1f0ce307f75f7d472a740019993a664eee7fd1245c990a7d599
Jul 02 21:37:31.074018 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:31.073932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh" event={"ID":"3366c98c-1305-4c5c-9bc3-3dc113aa4a00","Type":"ContainerStarted","Data":"172f9f9b9876f1f0ce307f75f7d472a740019993a664eee7fd1245c990a7d599"}
Jul 02 21:37:31.075471 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:31.075441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll" event={"ID":"8e9d433a-b1c2-445a-b607-7b6770a02503","Type":"ContainerStarted","Data":"a1091fb940dcebf5d7751b5c3cdbf8aecff8d6908b31ef3cbce40f34be8e5cf4"}
Jul 02 21:37:32.084249 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:32.084129    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll" event={"ID":"8e9d433a-b1c2-445a-b607-7b6770a02503","Type":"ContainerStarted","Data":"2375028a62b13e30ea2a14a4a262376c72a6645befe98f7398136379486d6d7d"}
Jul 02 21:37:32.088659 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:32.088631    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"}
Jul 02 21:37:32.088776 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:32.088717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"}
Jul 02 21:37:32.088776 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:32.088760    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"}
Jul 02 21:37:32.101480 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:32.101422    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll" podStartSLOduration=1.344374929 podStartE2EDuration="3.101399795s" totalImagesPullingTime="1.757024866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:32.09994756 +0000 UTC m=+91.097867640" watchObservedRunningTime="2026-07-02 21:37:32.101399795 +0000 UTC m=+91.099319851"
Jul 02 21:37:32.374682 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:32.374597    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d7df65677-9q4tk"]
Jul 02 21:37:33.101678 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:33.101638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"}
Jul 02 21:37:33.102136 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:33.101752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"}
Jul 02 21:37:33.104408 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:33.104378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh" event={"ID":"3366c98c-1305-4c5c-9bc3-3dc113aa4a00","Type":"ContainerStarted","Data":"310c911da853e6fe42db38242d0d54141d8a06047d0e8baff7c0296155237f87"}
Jul 02 21:37:33.104532 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:33.104446    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh" event={"ID":"3366c98c-1305-4c5c-9bc3-3dc113aa4a00","Type":"ContainerStarted","Data":"2ca5a4300b635f091dbf315df9ef1dc977de201adff85dc293f81f1a41d27761"}
Jul 02 21:37:33.104532 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:33.104476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh" event={"ID":"3366c98c-1305-4c5c-9bc3-3dc113aa4a00","Type":"ContainerStarted","Data":"7bcdacad05a6f8464a111b3d0880569d7ff699fdebc5ab8407df9f128a0836f1"}
Jul 02 21:37:33.128187 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:33.128116    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c777f7f88-2sbfh" podStartSLOduration=1.478801412 podStartE2EDuration="3.128097788s" totalImagesPullingTime="1.649296376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:33.12571446 +0000 UTC m=+92.123634557" watchObservedRunningTime="2026-07-02 21:37:33.128097788 +0000 UTC m=+92.126017842"
Jul 02 21:37:34.112000 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:34.111966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerStarted","Data":"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"}
Jul 02 21:37:34.141075 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:34.141020    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.313429579 podStartE2EDuration="8.140998886s" totalImagesPullingTime="4.812370775s" totalInitContainerRuntime="15.198532ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:34.139658535 +0000 UTC m=+93.137578589" watchObservedRunningTime="2026-07-02 21:37:34.140998886 +0000 UTC m=+93.138918941"
Jul 02 21:37:35.795617 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:35.795577    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:35.796122 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:35.795650    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:35.800591 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:35.800565    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:36.123338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.123310    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:37:36.293361 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.293326    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d99dc4b67-k2cm7"]
Jul 02 21:37:36.297941 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.297915    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.310799 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.310765    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 21:37:36.315392 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.315366    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d99dc4b67-k2cm7"]
Jul 02 21:37:36.338234 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-config\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.338234 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-serving-cert\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.338492 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338312    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-trusted-ca-bundle\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.338492 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-service-ca\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.338492 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338420    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-oauth-serving-cert\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.338492 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjm2j\" (UniqueName: \"kubernetes.io/projected/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-kube-api-access-sjm2j\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.338492 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.338458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-oauth-config\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.439985 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.439892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-config\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.439985 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.439940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-serving-cert\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440195 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-trusted-ca-bundle\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440195 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440129    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-service-ca\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440195 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-oauth-serving-cert\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440342 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440197    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjm2j\" (UniqueName: \"kubernetes.io/projected/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-kube-api-access-sjm2j\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440342 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-oauth-config\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440758    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-config\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440928 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440825    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-trusted-ca-bundle\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440928 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440873    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-oauth-serving-cert\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.440928 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.440912    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-service-ca\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.442588 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.442567    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-oauth-config\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.442680 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.442654    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-serving-cert\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.447946 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.447922    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjm2j\" (UniqueName: \"kubernetes.io/projected/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-kube-api-access-sjm2j\") pod \"console-d99dc4b67-k2cm7\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") " pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.609641 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.609599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:36.750173 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:36.750130    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d99dc4b67-k2cm7"]
Jul 02 21:37:36.752564 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:37:36.752530    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c0c5eb_400a_4e64_b924_334edb3bc4b1.slice/crio-1514a0d80918baa8ee47dface49132a08c852984432ce690f7088baca9581e32 WatchSource:0}: Error finding container 1514a0d80918baa8ee47dface49132a08c852984432ce690f7088baca9581e32: Status 404 returned error can't find the container with id 1514a0d80918baa8ee47dface49132a08c852984432ce690f7088baca9581e32
Jul 02 21:37:37.125763 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:37.125727    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d99dc4b67-k2cm7" event={"ID":"a3c0c5eb-400a-4e64-b924-334edb3bc4b1","Type":"ContainerStarted","Data":"482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450"}
Jul 02 21:37:37.126277 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:37.125786    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d99dc4b67-k2cm7" event={"ID":"a3c0c5eb-400a-4e64-b924-334edb3bc4b1","Type":"ContainerStarted","Data":"1514a0d80918baa8ee47dface49132a08c852984432ce690f7088baca9581e32"}
Jul 02 21:37:37.146684 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:37.146632    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d99dc4b67-k2cm7" podStartSLOduration=1.146613975 podStartE2EDuration="1.146613975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:37.144824801 +0000 UTC m=+96.142744890" watchObservedRunningTime="2026-07-02 21:37:37.146613975 +0000 UTC m=+96.144534029"
Jul 02 21:37:38.944923 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:38.944874    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2wwfp"
Jul 02 21:37:46.609892 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:46.609849    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:46.610335 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:46.609939    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:46.614790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:46.614768    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:47.175596 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:47.175567    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:37:47.224921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:47.224883    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd69f766c-pdwhz"]
Jul 02 21:37:49.928217 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:49.928183    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:49.928626 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:49.928246    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:37:52.195755 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:52.195716    2571 generic.go:356] "Generic (PLEG): container finished" podID="4d55d228-b865-407d-a043-43847600e36e" containerID="d658f013cacddad0c4adae07b5112f6a69ffb034313b3672717e2c3c82ef107d" exitCode=0
Jul 02 21:37:52.196225 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:52.195788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s" event={"ID":"4d55d228-b865-407d-a043-43847600e36e","Type":"ContainerDied","Data":"d658f013cacddad0c4adae07b5112f6a69ffb034313b3672717e2c3c82ef107d"}
Jul 02 21:37:52.196225 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:52.196141    2571 scope.go:117] "RemoveContainer" containerID="d658f013cacddad0c4adae07b5112f6a69ffb034313b3672717e2c3c82ef107d"
Jul 02 21:37:53.201681 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:53.201645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n568s" event={"ID":"4d55d228-b865-407d-a043-43847600e36e","Type":"ContainerStarted","Data":"11f121a0589da1e382b52f22c79cc8df8b6197652d342c0abbe4c59997929d79"}
Jul 02 21:37:57.219893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.219804    2571 generic.go:356] "Generic (PLEG): container finished" podID="a7b7e92c-b1f9-46b7-8113-3854077820e8" containerID="aa2e0df3701f2ae4810309df5a02f3460cf6b0ea18e42dacc6f13932505bc2aa" exitCode=0
Jul 02 21:37:57.219893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.219875    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4" event={"ID":"a7b7e92c-b1f9-46b7-8113-3854077820e8","Type":"ContainerDied","Data":"aa2e0df3701f2ae4810309df5a02f3460cf6b0ea18e42dacc6f13932505bc2aa"}
Jul 02 21:37:57.220304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.220218    2571 scope.go:117] "RemoveContainer" containerID="aa2e0df3701f2ae4810309df5a02f3460cf6b0ea18e42dacc6f13932505bc2aa"
Jul 02 21:37:57.400027 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.399982    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" podUID="e287e55b-7f42-4df7-aa9f-071f35197b40" containerName="registry" containerID="cri-o://6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127" gracePeriod=30
Jul 02 21:37:57.663471 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.663446    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:57.844078 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844037    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-bound-sa-token\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844315 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844086    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rvcn\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-kube-api-access-9rvcn\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844315 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844216    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e287e55b-7f42-4df7-aa9f-071f35197b40-ca-trust-extracted\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844315 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844300    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844482 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844345    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-image-registry-private-configuration\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844482 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844384    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-trusted-ca\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844482 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844412    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-installation-pull-secrets\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.844482 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.844454    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-certificates\") pod \"e287e55b-7f42-4df7-aa9f-071f35197b40\" (UID: \"e287e55b-7f42-4df7-aa9f-071f35197b40\") "
Jul 02 21:37:57.845196 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.845091    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:57.845196 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.845109    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:57.846779 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.846755    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:57.846965 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.846932    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-kube-api-access-9rvcn" (OuterVolumeSpecName: "kube-api-access-9rvcn") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "kube-api-access-9rvcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:57.847064 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.846966    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:57.847111 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.847089    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:57.847228 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.847146    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:57.852765 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.852741    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e287e55b-7f42-4df7-aa9f-071f35197b40-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e287e55b-7f42-4df7-aa9f-071f35197b40" (UID: "e287e55b-7f42-4df7-aa9f-071f35197b40"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:37:57.945912 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945873    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-trusted-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.945912 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945907    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-installation-pull-secrets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.945912 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945919    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-certificates\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.946137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945928    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-bound-sa-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.946137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945937    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rvcn\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-kube-api-access-9rvcn\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.946137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945945    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e287e55b-7f42-4df7-aa9f-071f35197b40-ca-trust-extracted\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.946137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945952    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e287e55b-7f42-4df7-aa9f-071f35197b40-registry-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:57.946137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:57.945964    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e287e55b-7f42-4df7-aa9f-071f35197b40-image-registry-private-configuration\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:37:58.225256 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.225149    2571 generic.go:356] "Generic (PLEG): container finished" podID="e287e55b-7f42-4df7-aa9f-071f35197b40" containerID="6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127" exitCode=0
Jul 02 21:37:58.225256 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.225209    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7df65677-9q4tk"
Jul 02 21:37:58.225256 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.225246    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" event={"ID":"e287e55b-7f42-4df7-aa9f-071f35197b40","Type":"ContainerDied","Data":"6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127"}
Jul 02 21:37:58.225790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.225298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7df65677-9q4tk" event={"ID":"e287e55b-7f42-4df7-aa9f-071f35197b40","Type":"ContainerDied","Data":"26e1132ae02752f513c58145df22a5034b9e7fddb2af0bd6e164df3191d07348"}
Jul 02 21:37:58.225790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.225321    2571 scope.go:117] "RemoveContainer" containerID="6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127"
Jul 02 21:37:58.227377 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.227355    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z6wv4" event={"ID":"a7b7e92c-b1f9-46b7-8113-3854077820e8","Type":"ContainerStarted","Data":"e5436d497cdef1d133a84fff71dea874f70a8babc1a21fd82f5eb457ea17f72d"}
Jul 02 21:37:58.234499 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.234482    2571 scope.go:117] "RemoveContainer" containerID="6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127"
Jul 02 21:37:58.234792 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:37:58.234772    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127\": container with ID starting with 6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127 not found: ID does not exist" containerID="6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127"
Jul 02 21:37:58.234839 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.234800    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127"} err="failed to get container status \"6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127\": rpc error: code = NotFound desc = could not find container \"6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127\": container with ID starting with 6e245f22fa65b4df66da97ed6f8cfc8ccca4028c98ba564080c3108d20300127 not found: ID does not exist"
Jul 02 21:37:58.264103 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.264074    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d7df65677-9q4tk"]
Jul 02 21:37:58.269528 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:58.269493    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d7df65677-9q4tk"]
Jul 02 21:37:59.611187 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:37:59.611129    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e287e55b-7f42-4df7-aa9f-071f35197b40" path="/var/lib/kubelet/pods/e287e55b-7f42-4df7-aa9f-071f35197b40/volumes"
Jul 02 21:38:09.933656 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:09.933622    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:38:09.937775 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:09.937746    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dcdb95d79-kbmll"
Jul 02 21:38:12.248712 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.248605    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dd69f766c-pdwhz" podUID="61937d39-80f5-44be-b891-402b8b0f6c64" containerName="console" containerID="cri-o://ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826" gracePeriod=15
Jul 02 21:38:12.285124 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.285095    2571 generic.go:356] "Generic (PLEG): container finished" podID="d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6" containerID="beba1860548a9c884a82fd38afc26e6eff7526e8a282dadd7a9cbcb2da91e0b8" exitCode=0
Jul 02 21:38:12.285285 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.285145    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65" event={"ID":"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6","Type":"ContainerDied","Data":"beba1860548a9c884a82fd38afc26e6eff7526e8a282dadd7a9cbcb2da91e0b8"}
Jul 02 21:38:12.285513 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.285497    2571 scope.go:117] "RemoveContainer" containerID="beba1860548a9c884a82fd38afc26e6eff7526e8a282dadd7a9cbcb2da91e0b8"
Jul 02 21:38:12.502877 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.502810    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:38:12.558044 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558011    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-console-config\") pod \"61937d39-80f5-44be-b891-402b8b0f6c64\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") "
Jul 02 21:38:12.558044 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558049    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-oauth-serving-cert\") pod \"61937d39-80f5-44be-b891-402b8b0f6c64\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") "
Jul 02 21:38:12.558317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-serving-cert\") pod \"61937d39-80f5-44be-b891-402b8b0f6c64\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") "
Jul 02 21:38:12.558317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558101    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hm8x\" (UniqueName: \"kubernetes.io/projected/61937d39-80f5-44be-b891-402b8b0f6c64-kube-api-access-4hm8x\") pod \"61937d39-80f5-44be-b891-402b8b0f6c64\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") "
Jul 02 21:38:12.558317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558136    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-oauth-config\") pod \"61937d39-80f5-44be-b891-402b8b0f6c64\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") "
Jul 02 21:38:12.558317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558195    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-service-ca\") pod \"61937d39-80f5-44be-b891-402b8b0f6c64\" (UID: \"61937d39-80f5-44be-b891-402b8b0f6c64\") "
Jul 02 21:38:12.558641 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558531    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-console-config" (OuterVolumeSpecName: "console-config") pod "61937d39-80f5-44be-b891-402b8b0f6c64" (UID: "61937d39-80f5-44be-b891-402b8b0f6c64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:38:12.558746 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558670    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-service-ca" (OuterVolumeSpecName: "service-ca") pod "61937d39-80f5-44be-b891-402b8b0f6c64" (UID: "61937d39-80f5-44be-b891-402b8b0f6c64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:38:12.558746 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.558680    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "61937d39-80f5-44be-b891-402b8b0f6c64" (UID: "61937d39-80f5-44be-b891-402b8b0f6c64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:38:12.560512 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.560487    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "61937d39-80f5-44be-b891-402b8b0f6c64" (UID: "61937d39-80f5-44be-b891-402b8b0f6c64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:12.560757 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.560737    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "61937d39-80f5-44be-b891-402b8b0f6c64" (UID: "61937d39-80f5-44be-b891-402b8b0f6c64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:12.560830 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.560749    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61937d39-80f5-44be-b891-402b8b0f6c64-kube-api-access-4hm8x" (OuterVolumeSpecName: "kube-api-access-4hm8x") pod "61937d39-80f5-44be-b891-402b8b0f6c64" (UID: "61937d39-80f5-44be-b891-402b8b0f6c64"). InnerVolumeSpecName "kube-api-access-4hm8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:38:12.659547 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.659500    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:12.659547 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.659544    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:12.659547 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.659558    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:12.659789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.659571    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hm8x\" (UniqueName: \"kubernetes.io/projected/61937d39-80f5-44be-b891-402b8b0f6c64-kube-api-access-4hm8x\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:12.659789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.659584    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61937d39-80f5-44be-b891-402b8b0f6c64-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:12.659789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:12.659597    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61937d39-80f5-44be-b891-402b8b0f6c64-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:13.291445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.291352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f9x65" event={"ID":"d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6","Type":"ContainerStarted","Data":"acc7d837365f07d4cd60fbd71f40cc15373fc88b2aac460efeffc6f1bcd73c2c"}
Jul 02 21:38:13.292692 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.292667    2571 generic.go:356] "Generic (PLEG): container finished" podID="61937d39-80f5-44be-b891-402b8b0f6c64" containerID="ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826" exitCode=0
Jul 02 21:38:13.292825 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.292698    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd69f766c-pdwhz"
Jul 02 21:38:13.292825 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.292739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd69f766c-pdwhz" event={"ID":"61937d39-80f5-44be-b891-402b8b0f6c64","Type":"ContainerDied","Data":"ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826"}
Jul 02 21:38:13.292825 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.292771    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd69f766c-pdwhz" event={"ID":"61937d39-80f5-44be-b891-402b8b0f6c64","Type":"ContainerDied","Data":"24aa4dd76dc36cf51c7924587f744a0d60e465c3f875cf26f8d5bd485d9ace9a"}
Jul 02 21:38:13.292825 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.292795    2571 scope.go:117] "RemoveContainer" containerID="ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826"
Jul 02 21:38:13.308734 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.308704    2571 scope.go:117] "RemoveContainer" containerID="ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826"
Jul 02 21:38:13.309108 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:13.309085    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826\": container with ID starting with ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826 not found: ID does not exist" containerID="ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826"
Jul 02 21:38:13.309228 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.309116    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826"} err="failed to get container status \"ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826\": rpc error: code = NotFound desc = could not find container \"ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826\": container with ID starting with ef75e23a50a638caadf52302c1e5f1af953aabdcf1eed1939fe67c5e22dfb826 not found: ID does not exist"
Jul 02 21:38:13.328054 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.328021    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd69f766c-pdwhz"]
Jul 02 21:38:13.332716 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.332684    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd69f766c-pdwhz"]
Jul 02 21:38:13.611088 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:13.611039    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61937d39-80f5-44be-b891-402b8b0f6c64" path="/var/lib/kubelet/pods/61937d39-80f5-44be-b891-402b8b0f6c64/volumes"
Jul 02 21:38:45.719564 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:45.719529    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:38:46.433118 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:46.433066    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="alertmanager" containerID="cri-o://a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9" gracePeriod=120
Jul 02 21:38:46.433118 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:46.433106    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy" containerID="cri-o://661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929" gracePeriod=120
Jul 02 21:38:46.433419 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:46.433085    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-metric" containerID="cri-o://da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119" gracePeriod=120
Jul 02 21:38:46.433419 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:46.433139    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-web" containerID="cri-o://fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d" gracePeriod=120
Jul 02 21:38:46.433419 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:46.433176    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="config-reloader" containerID="cri-o://e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50" gracePeriod=120
Jul 02 21:38:46.433419 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:46.433139    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="prom-label-proxy" containerID="cri-o://69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd" gracePeriod=120
Jul 02 21:38:47.440566 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440531    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd" exitCode=0
Jul 02 21:38:47.440566 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440558    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929" exitCode=0
Jul 02 21:38:47.440566 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440566    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50" exitCode=0
Jul 02 21:38:47.440566 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440571    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9" exitCode=0
Jul 02 21:38:47.441104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440602    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"}
Jul 02 21:38:47.441104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"}
Jul 02 21:38:47.441104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440778    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"}
Jul 02 21:38:47.441104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.440820    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"}
Jul 02 21:38:47.683556 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.683532    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:47.780704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780619    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780704 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780695    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780878 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780791    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-tls-assets\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780878 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780840    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-metrics-client-ca\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780878 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780866    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-main-db\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780997 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780901    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xtzt\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-kube-api-access-2xtzt\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780997 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780932    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-trusted-ca-bundle\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.780997 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.780980    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.781144 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781013    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-out\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.781144 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781044    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-volume\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.781144 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781112    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-cluster-tls-config\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.781144 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781136    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-web\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.781384 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-web-config\") pod \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\" (UID: \"547ea22d-7e10-4bbd-92cf-f22309ebfa37\") "
Jul 02 21:38:47.781384 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781297    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:38:47.781516 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781489    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:38:47.781659 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781637    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-metrics-client-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.781729 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.781665    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-main-db\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.782278 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.782214    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:38:47.784809 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.784780    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-out" (OuterVolumeSpecName: "config-out") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:38:47.784915 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.784806    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:38:47.784915 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.784788    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.784915 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.784841    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.784915 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.784874    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.785260 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.785224    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-volume" (OuterVolumeSpecName: "config-volume") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.785375 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.785311    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.785375 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.785314    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-kube-api-access-2xtzt" (OuterVolumeSpecName: "kube-api-access-2xtzt") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "kube-api-access-2xtzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:38:47.788561 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.788539    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.795309 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.795285    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-web-config" (OuterVolumeSpecName: "web-config") pod "547ea22d-7e10-4bbd-92cf-f22309ebfa37" (UID: "547ea22d-7e10-4bbd-92cf-f22309ebfa37"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:38:47.882063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882030    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-cluster-tls-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882057    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882070    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-web-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882079    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882090    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882100    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-tls-assets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882109    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xtzt\" (UniqueName: \"kubernetes.io/projected/547ea22d-7e10-4bbd-92cf-f22309ebfa37-kube-api-access-2xtzt\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882116    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/547ea22d-7e10-4bbd-92cf-f22309ebfa37-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882125    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-secret-alertmanager-main-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882135    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-out\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:47.882302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:47.882143    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/547ea22d-7e10-4bbd-92cf-f22309ebfa37-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:38:48.447860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.447826    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119" exitCode=0
Jul 02 21:38:48.447860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.447859    2571 generic.go:356] "Generic (PLEG): container finished" podID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerID="fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d" exitCode=0
Jul 02 21:38:48.448304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.447896    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.448304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.447896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"}
Jul 02 21:38:48.448304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.448037    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"}
Jul 02 21:38:48.448304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.448066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"547ea22d-7e10-4bbd-92cf-f22309ebfa37","Type":"ContainerDied","Data":"49d6c6decb0e929204a35ca95562ff25ce5f11dadb4caf7962e426f4dd0b4718"}
Jul 02 21:38:48.448304 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.448104    2571 scope.go:117] "RemoveContainer" containerID="69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"
Jul 02 21:38:48.456871 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.456852    2571 scope.go:117] "RemoveContainer" containerID="da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"
Jul 02 21:38:48.464353 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.464334    2571 scope.go:117] "RemoveContainer" containerID="661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"
Jul 02 21:38:48.471920 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.471896    2571 scope.go:117] "RemoveContainer" containerID="fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"
Jul 02 21:38:48.472030 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.471994    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:38:48.477021 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.476997    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:38:48.479859 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.479835    2571 scope.go:117] "RemoveContainer" containerID="e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"
Jul 02 21:38:48.486947 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.486929    2571 scope.go:117] "RemoveContainer" containerID="a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"
Jul 02 21:38:48.494245 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.494225    2571 scope.go:117] "RemoveContainer" containerID="d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"
Jul 02 21:38:48.501534 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.501514    2571 scope.go:117] "RemoveContainer" containerID="69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"
Jul 02 21:38:48.501798 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.501781    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd\": container with ID starting with 69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd not found: ID does not exist" containerID="69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"
Jul 02 21:38:48.501840 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.501812    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"} err="failed to get container status \"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd\": rpc error: code = NotFound desc = could not find container \"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd\": container with ID starting with 69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd not found: ID does not exist"
Jul 02 21:38:48.501840 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.501832    2571 scope.go:117] "RemoveContainer" containerID="da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"
Jul 02 21:38:48.502069 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.502051    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119\": container with ID starting with da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119 not found: ID does not exist" containerID="da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"
Jul 02 21:38:48.502124 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502075    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"} err="failed to get container status \"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119\": rpc error: code = NotFound desc = could not find container \"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119\": container with ID starting with da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119 not found: ID does not exist"
Jul 02 21:38:48.502124 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502091    2571 scope.go:117] "RemoveContainer" containerID="661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"
Jul 02 21:38:48.502374 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.502352    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929\": container with ID starting with 661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929 not found: ID does not exist" containerID="661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"
Jul 02 21:38:48.502426 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502380    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"} err="failed to get container status \"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929\": rpc error: code = NotFound desc = could not find container \"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929\": container with ID starting with 661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929 not found: ID does not exist"
Jul 02 21:38:48.502426 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502396    2571 scope.go:117] "RemoveContainer" containerID="fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"
Jul 02 21:38:48.502625 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.502609    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d\": container with ID starting with fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d not found: ID does not exist" containerID="fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"
Jul 02 21:38:48.502665 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502628    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"} err="failed to get container status \"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d\": rpc error: code = NotFound desc = could not find container \"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d\": container with ID starting with fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d not found: ID does not exist"
Jul 02 21:38:48.502665 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502646    2571 scope.go:117] "RemoveContainer" containerID="e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"
Jul 02 21:38:48.502849 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.502834    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50\": container with ID starting with e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50 not found: ID does not exist" containerID="e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"
Jul 02 21:38:48.502898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502850    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"} err="failed to get container status \"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50\": rpc error: code = NotFound desc = could not find container \"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50\": container with ID starting with e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50 not found: ID does not exist"
Jul 02 21:38:48.502898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.502861    2571 scope.go:117] "RemoveContainer" containerID="a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"
Jul 02 21:38:48.503105 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.503089    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9\": container with ID starting with a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9 not found: ID does not exist" containerID="a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"
Jul 02 21:38:48.503148 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503106    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"} err="failed to get container status \"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9\": rpc error: code = NotFound desc = could not find container \"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9\": container with ID starting with a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9 not found: ID does not exist"
Jul 02 21:38:48.503148 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503117    2571 scope.go:117] "RemoveContainer" containerID="d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"
Jul 02 21:38:48.503358 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:38:48.503342    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8\": container with ID starting with d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8 not found: ID does not exist" containerID="d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"
Jul 02 21:38:48.503400 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503361    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"} err="failed to get container status \"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8\": rpc error: code = NotFound desc = could not find container \"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8\": container with ID starting with d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8 not found: ID does not exist"
Jul 02 21:38:48.503400 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503375    2571 scope.go:117] "RemoveContainer" containerID="69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"
Jul 02 21:38:48.503604 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503584    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd"} err="failed to get container status \"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd\": rpc error: code = NotFound desc = could not find container \"69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd\": container with ID starting with 69d60e8a00f22a1df0d97291a105dd067dc0ff09a8e897679f99c36d6c895bfd not found: ID does not exist"
Jul 02 21:38:48.503659 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503605    2571 scope.go:117] "RemoveContainer" containerID="da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"
Jul 02 21:38:48.503824 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503803    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119"} err="failed to get container status \"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119\": rpc error: code = NotFound desc = could not find container \"da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119\": container with ID starting with da7132873c75dc884ae05393aeeef74a6aa813d2b1590bcfa8b4f851f24c8119 not found: ID does not exist"
Jul 02 21:38:48.503911 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.503827    2571 scope.go:117] "RemoveContainer" containerID="661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"
Jul 02 21:38:48.504063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504035    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929"} err="failed to get container status \"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929\": rpc error: code = NotFound desc = could not find container \"661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929\": container with ID starting with 661dd4cb8e474e6b6b4a9bb2ef7e1de846123f275461aa8f40f69c5bb9492929 not found: ID does not exist"
Jul 02 21:38:48.504063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504058    2571 scope.go:117] "RemoveContainer" containerID="fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"
Jul 02 21:38:48.504298 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504281    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d"} err="failed to get container status \"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d\": rpc error: code = NotFound desc = could not find container \"fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d\": container with ID starting with fa0be09a28b82dd798dacce6379e1f0b7d9561adb713bb74edb9f33ab97ac56d not found: ID does not exist"
Jul 02 21:38:48.504360 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504299    2571 scope.go:117] "RemoveContainer" containerID="e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"
Jul 02 21:38:48.504545 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504524    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50"} err="failed to get container status \"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50\": rpc error: code = NotFound desc = could not find container \"e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50\": container with ID starting with e27ff4aa2aab6d8bda7957824ce1f99486df21fb3cd91a8369028864d76b2b50 not found: ID does not exist"
Jul 02 21:38:48.504602 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504548    2571 scope.go:117] "RemoveContainer" containerID="a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"
Jul 02 21:38:48.504831 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504789    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9"} err="failed to get container status \"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9\": rpc error: code = NotFound desc = could not find container \"a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9\": container with ID starting with a09337083f8cb0bc7e19bbef605e9a8a17902ee1ab423ace1254a0a5679166c9 not found: ID does not exist"
Jul 02 21:38:48.504831 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.504811    2571 scope.go:117] "RemoveContainer" containerID="d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"
Jul 02 21:38:48.505227 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.505198    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8"} err="failed to get container status \"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8\": rpc error: code = NotFound desc = could not find container \"d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8\": container with ID starting with d76e32c16870a08b56c69222b480619d566704c7d64f20994fd43c152bc81af8 not found: ID does not exist"
Jul 02 21:38:48.506558 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506539    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:38:48.506874 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506859    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-web"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506877    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-web"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506889    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506895    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506906    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="config-reloader"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506911    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="config-reloader"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506917    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="prom-label-proxy"
Jul 02 21:38:48.506925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506922    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="prom-label-proxy"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506941    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61937d39-80f5-44be-b891-402b8b0f6c64" containerName="console"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506950    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="61937d39-80f5-44be-b891-402b8b0f6c64" containerName="console"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506957    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e287e55b-7f42-4df7-aa9f-071f35197b40" containerName="registry"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506961    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e287e55b-7f42-4df7-aa9f-071f35197b40" containerName="registry"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506969    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="alertmanager"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506974    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="alertmanager"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506983    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="init-config-reloader"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506988    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="init-config-reloader"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.506994    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-metric"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507000    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-metric"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507049    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="prom-label-proxy"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507056    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="config-reloader"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507063    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="alertmanager"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507070    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="61937d39-80f5-44be-b891-402b8b0f6c64" containerName="console"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507075    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-web"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507080    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e287e55b-7f42-4df7-aa9f-071f35197b40" containerName="registry"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507085    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy-metric"
Jul 02 21:38:48.507121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.507093    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" containerName="kube-rbac-proxy"
Jul 02 21:38:48.510432 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.510416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.512839 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.512820    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 21:38:48.512839 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.512830    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 21:38:48.512983 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.512823    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 21:38:48.512983 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.512833    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 21:38:48.512983 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.512820    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 21:38:48.513122 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.513063    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 21:38:48.513234 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.513177    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 21:38:48.513234 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.513223    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 21:38:48.513339 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.513237    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kgscs\""
Jul 02 21:38:48.519254 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.519235    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 21:38:48.527432 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.527412    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:38:48.689308 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689484 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb894ca-5ba4-407a-bfe3-6060433b3212-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689484 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689484 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cb894ca-5ba4-407a-bfe3-6060433b3212-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689484 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689484 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb894ca-5ba4-407a-bfe3-6060433b3212-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cb894ca-5ba4-407a-bfe3-6060433b3212-config-out\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-web-config\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg5lr\" (UniqueName: \"kubernetes.io/projected/3cb894ca-5ba4-407a-bfe3-6060433b3212-kube-api-access-qg5lr\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689628    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.689811 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.689651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cb894ca-5ba4-407a-bfe3-6060433b3212-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.790660 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.790660 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb894ca-5ba4-407a-bfe3-6060433b3212-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.790860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.790860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cb894ca-5ba4-407a-bfe3-6060433b3212-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.790860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.790860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb894ca-5ba4-407a-bfe3-6060433b3212-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.791043 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790879    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cb894ca-5ba4-407a-bfe3-6060433b3212-config-out\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.791043 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.790906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-web-config\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg5lr\" (UniqueName: \"kubernetes.io/projected/3cb894ca-5ba4-407a-bfe3-6060433b3212-kube-api-access-qg5lr\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791544    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cb894ca-5ba4-407a-bfe3-6060433b3212-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791646    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cb894ca-5ba4-407a-bfe3-6060433b3212-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.791978    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cb894ca-5ba4-407a-bfe3-6060433b3212-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.792276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.792259    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb894ca-5ba4-407a-bfe3-6060433b3212-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.795137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.794852    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.795137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.794964    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.795137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.795075    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cb894ca-5ba4-407a-bfe3-6060433b3212-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.795401 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.795191    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.797433 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.797337    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cb894ca-5ba4-407a-bfe3-6060433b3212-config-out\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.798984 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.797760    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.798984 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.797928    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.798984 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.798015    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.800618 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.800592    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cb894ca-5ba4-407a-bfe3-6060433b3212-web-config\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.803082 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.803061    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg5lr\" (UniqueName: \"kubernetes.io/projected/3cb894ca-5ba4-407a-bfe3-6060433b3212-kube-api-access-qg5lr\") pod \"alertmanager-main-0\" (UID: \"3cb894ca-5ba4-407a-bfe3-6060433b3212\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.819956 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.819928    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:38:48.962496 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:48.962463    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:38:48.965631 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:38:48.965603    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb894ca_5ba4_407a_bfe3_6060433b3212.slice/crio-313e8c58d0429cbecf26d6f409addc0d47a965678725e3637c1a42a235481304 WatchSource:0}: Error finding container 313e8c58d0429cbecf26d6f409addc0d47a965678725e3637c1a42a235481304: Status 404 returned error can't find the container with id 313e8c58d0429cbecf26d6f409addc0d47a965678725e3637c1a42a235481304
Jul 02 21:38:49.454072 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:49.454036    2571 generic.go:356] "Generic (PLEG): container finished" podID="3cb894ca-5ba4-407a-bfe3-6060433b3212" containerID="8704b8c2ef2967ab9ea51e018000c339a2137108e1c7057424ed91898eca0b3f" exitCode=0
Jul 02 21:38:49.454559 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:49.454100    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerDied","Data":"8704b8c2ef2967ab9ea51e018000c339a2137108e1c7057424ed91898eca0b3f"}
Jul 02 21:38:49.454559 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:49.454191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"313e8c58d0429cbecf26d6f409addc0d47a965678725e3637c1a42a235481304"}
Jul 02 21:38:49.611146 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:49.611119    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="547ea22d-7e10-4bbd-92cf-f22309ebfa37" path="/var/lib/kubelet/pods/547ea22d-7e10-4bbd-92cf-f22309ebfa37/volumes"
Jul 02 21:38:50.461404 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.461369    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"2c2df02727b768c78b17184bb98eaa1d4ee254bf940c211fce7f2d7b359bdb8f"}
Jul 02 21:38:50.461772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.461438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"ffe9b7f5762744dce813efa2e70145dee8b41d0be5a78c1454cc26b14833d616"}
Jul 02 21:38:50.461772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.461466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"e1ee4f5dc4814a86e34a36b4e05f53d18b3e402caad8afbcc2589d23a0057aa9"}
Jul 02 21:38:50.461772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.461491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"0cf3d79a07955eea4dedb5d67251de43ce89ad0119d47d11db3f738d489019e2"}
Jul 02 21:38:50.461772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.461516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"976bf4e2aee5190f9410cfff6ff09f25e6cc07d089ec806cd639803af16aa3bb"}
Jul 02 21:38:50.461772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.461540    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cb894ca-5ba4-407a-bfe3-6060433b3212","Type":"ContainerStarted","Data":"f47e149cb14c272a437d4a399b4c4bf842ffb23c05b45db56dfeae67cb66b765"}
Jul 02 21:38:50.491413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:50.491360    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.472243035 podStartE2EDuration="2.4913417s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.098665ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:38:50.48934137 +0000 UTC m=+169.487261449" watchObservedRunningTime="2026-07-02 21:38:50.4913417 +0000 UTC m=+169.489261755"
Jul 02 21:38:55.408930 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.408851    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c5f9d65dc-vz8b2"]
Jul 02 21:38:55.411090 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.411064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.423249 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.423223    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5f9d65dc-vz8b2"]
Jul 02 21:38:55.450180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-serving-cert\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.450338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-trusted-ca-bundle\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.450338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-service-ca\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.450338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450285    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-oauth-serving-cert\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.450439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450338    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-oauth-config\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.450439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-console-config\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.450439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.450429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fr58\" (UniqueName: \"kubernetes.io/projected/26fa9149-ab92-4829-996b-eb94c78d545c-kube-api-access-7fr58\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551127 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-service-ca\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551127 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-oauth-serving-cert\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551415 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-oauth-config\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551415 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551209    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-console-config\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551415 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fr58\" (UniqueName: \"kubernetes.io/projected/26fa9149-ab92-4829-996b-eb94c78d545c-kube-api-access-7fr58\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551415 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551274    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-serving-cert\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.551415 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-trusted-ca-bundle\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.552010 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.551980    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-service-ca\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.552131 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.552040    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-oauth-serving-cert\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.552226 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.552129    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-console-config\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.552284 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.552262    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-trusted-ca-bundle\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.553785 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.553762    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-oauth-config\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.553928 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.553906    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-serving-cert\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.563553 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.563529    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fr58\" (UniqueName: \"kubernetes.io/projected/26fa9149-ab92-4829-996b-eb94c78d545c-kube-api-access-7fr58\") pod \"console-c5f9d65dc-vz8b2\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") " pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.722381 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.722285    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:38:55.855086 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:55.855059    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5f9d65dc-vz8b2"]
Jul 02 21:38:55.857645 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:38:55.857617    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fa9149_ab92_4829_996b_eb94c78d545c.slice/crio-64d6d4741ce046e9b4a14450fa5b7a6d34abf4fa683c3ea0a2753a980d27a08a WatchSource:0}: Error finding container 64d6d4741ce046e9b4a14450fa5b7a6d34abf4fa683c3ea0a2753a980d27a08a: Status 404 returned error can't find the container with id 64d6d4741ce046e9b4a14450fa5b7a6d34abf4fa683c3ea0a2753a980d27a08a
Jul 02 21:38:56.488674 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:56.488634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5f9d65dc-vz8b2" event={"ID":"26fa9149-ab92-4829-996b-eb94c78d545c","Type":"ContainerStarted","Data":"4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe"}
Jul 02 21:38:56.489038 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:56.488695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5f9d65dc-vz8b2" event={"ID":"26fa9149-ab92-4829-996b-eb94c78d545c","Type":"ContainerStarted","Data":"64d6d4741ce046e9b4a14450fa5b7a6d34abf4fa683c3ea0a2753a980d27a08a"}
Jul 02 21:38:56.506732 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:38:56.506677    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c5f9d65dc-vz8b2" podStartSLOduration=1.506657842 podStartE2EDuration="1.506657842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:38:56.504496545 +0000 UTC m=+175.502416601" watchObservedRunningTime="2026-07-02 21:38:56.506657842 +0000 UTC m=+175.504577896"
Jul 02 21:39:05.722684 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:05.722649    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:39:05.723086 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:05.722942    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:39:05.727826 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:05.727805    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:39:06.537907 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:06.537877    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:39:06.577354 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:06.577322    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d99dc4b67-k2cm7"]
Jul 02 21:39:31.602060 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.601995    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d99dc4b67-k2cm7" podUID="a3c0c5eb-400a-4e64-b924-334edb3bc4b1" containerName="console" containerID="cri-o://482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450" gracePeriod=15
Jul 02 21:39:31.853645 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.853577    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:39:31.956396 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956355    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-oauth-config\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.956568 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956467    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjm2j\" (UniqueName: \"kubernetes.io/projected/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-kube-api-access-sjm2j\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.956568 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956537    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-service-ca\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.956640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956585    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-trusted-ca-bundle\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.956640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956608    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-oauth-serving-cert\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.956711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956646    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-config\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.956711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956700    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-serving-cert\") pod \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\" (UID: \"a3c0c5eb-400a-4e64-b924-334edb3bc4b1\") "
Jul 02 21:39:31.957024 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956973    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:39:31.957024 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.956990    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:39:31.957222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.957043    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:39:31.957222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.957051    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-config" (OuterVolumeSpecName: "console-config") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:39:31.958650 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.958620    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:39:31.958772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.958736    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-kube-api-access-sjm2j" (OuterVolumeSpecName: "kube-api-access-sjm2j") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "kube-api-access-sjm2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:39:31.958897 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:31.958877    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3c0c5eb-400a-4e64-b924-334edb3bc4b1" (UID: "a3c0c5eb-400a-4e64-b924-334edb3bc4b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:39:32.057563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057525    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.057563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057560    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.057760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057576    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjm2j\" (UniqueName: \"kubernetes.io/projected/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-kube-api-access-sjm2j\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.057760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057591    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.057760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057606    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.057760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057621    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.057760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.057635    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3c0c5eb-400a-4e64-b924-334edb3bc4b1-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:32.640355 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.640321    2571 generic.go:356] "Generic (PLEG): container finished" podID="a3c0c5eb-400a-4e64-b924-334edb3bc4b1" containerID="482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450" exitCode=0
Jul 02 21:39:32.640775 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.640363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d99dc4b67-k2cm7" event={"ID":"a3c0c5eb-400a-4e64-b924-334edb3bc4b1","Type":"ContainerDied","Data":"482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450"}
Jul 02 21:39:32.640775 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.640382    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d99dc4b67-k2cm7"
Jul 02 21:39:32.640775 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.640400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d99dc4b67-k2cm7" event={"ID":"a3c0c5eb-400a-4e64-b924-334edb3bc4b1","Type":"ContainerDied","Data":"1514a0d80918baa8ee47dface49132a08c852984432ce690f7088baca9581e32"}
Jul 02 21:39:32.640775 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.640420    2571 scope.go:117] "RemoveContainer" containerID="482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450"
Jul 02 21:39:32.651277 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.651252    2571 scope.go:117] "RemoveContainer" containerID="482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450"
Jul 02 21:39:32.651575 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:39:32.651556    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450\": container with ID starting with 482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450 not found: ID does not exist" containerID="482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450"
Jul 02 21:39:32.651629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.651583    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450"} err="failed to get container status \"482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450\": rpc error: code = NotFound desc = could not find container \"482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450\": container with ID starting with 482f2bdf57f8b18c142aff085021286807d6c91c2d09a6cbdcc5a360d95f8450 not found: ID does not exist"
Jul 02 21:39:32.668377 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.668349    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d99dc4b67-k2cm7"]
Jul 02 21:39:32.674179 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:32.674140    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d99dc4b67-k2cm7"]
Jul 02 21:39:33.614877 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:33.611989    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3c0c5eb-400a-4e64-b924-334edb3bc4b1" path="/var/lib/kubelet/pods/a3c0c5eb-400a-4e64-b924-334edb3bc4b1/volumes"
Jul 02 21:39:36.945330 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.945295    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"]
Jul 02 21:39:36.945706 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.945605    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3c0c5eb-400a-4e64-b924-334edb3bc4b1" containerName="console"
Jul 02 21:39:36.945706 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.945616    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3c0c5eb-400a-4e64-b924-334edb3bc4b1" containerName="console"
Jul 02 21:39:36.945706 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.945687    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3c0c5eb-400a-4e64-b924-334edb3bc4b1" containerName="console"
Jul 02 21:39:36.950064 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.950045    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:36.952866 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.952838    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 21:39:36.953671 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.953654    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 21:39:36.953764 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.953657    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x4w5p\""
Jul 02 21:39:36.960451 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:36.960425    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"]
Jul 02 21:39:37.103050 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.103012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.103262 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.103104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-kube-api-access-rxnls\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.103262 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.103136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.204370 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.204272    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.204370 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.204343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.204564 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.204418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-kube-api-access-rxnls\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.204749 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.204728    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.204841 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.204738    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.214915 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.214886    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-kube-api-access-rxnls\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.260487 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.260452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:37.400132 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.400099    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"]
Jul 02 21:39:37.403525 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:39:37.403496    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bfac99_1dfd_49f4_bc59_2e2aa520afdd.slice/crio-8a582d87d819baf4e9207e2dd940002560a4b0a5046e79b31350bab5b80a68be WatchSource:0}: Error finding container 8a582d87d819baf4e9207e2dd940002560a4b0a5046e79b31350bab5b80a68be: Status 404 returned error can't find the container with id 8a582d87d819baf4e9207e2dd940002560a4b0a5046e79b31350bab5b80a68be
Jul 02 21:39:37.662185 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:37.662137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq" event={"ID":"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd","Type":"ContainerStarted","Data":"8a582d87d819baf4e9207e2dd940002560a4b0a5046e79b31350bab5b80a68be"}
Jul 02 21:39:44.697320 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:44.697282    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerID="b8b0935cca5b9ab28dbdd927b80e68ea62145404e1a2624bd2b6e9d3fb015d1c" exitCode=0
Jul 02 21:39:44.697715 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:44.697367    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq" event={"ID":"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd","Type":"ContainerDied","Data":"b8b0935cca5b9ab28dbdd927b80e68ea62145404e1a2624bd2b6e9d3fb015d1c"}
Jul 02 21:39:47.711748 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:47.711707    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerID="81ff414ee8d31a52c07d7e94907e6e223362f43e6c7ad7ee14f8659c4001a487" exitCode=0
Jul 02 21:39:47.712134 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:47.711789    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq" event={"ID":"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd","Type":"ContainerDied","Data":"81ff414ee8d31a52c07d7e94907e6e223362f43e6c7ad7ee14f8659c4001a487"}
Jul 02 21:39:54.750097 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:54.750007    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerID="f196266482c2061e804264886e153a70fc8220eb0b6561719b19b6b4f95ff31f" exitCode=0
Jul 02 21:39:54.750475 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:54.750088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq" event={"ID":"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd","Type":"ContainerDied","Data":"f196266482c2061e804264886e153a70fc8220eb0b6561719b19b6b4f95ff31f"}
Jul 02 21:39:55.886149 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.886120    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:55.970661 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.970627    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-bundle\") pod \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") "
Jul 02 21:39:55.970862 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.970671    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-util\") pod \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") "
Jul 02 21:39:55.970862 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.970777    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-kube-api-access-rxnls\") pod \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\" (UID: \"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd\") "
Jul 02 21:39:55.971363 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.971339    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-bundle" (OuterVolumeSpecName: "bundle") pod "a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" (UID: "a0bfac99-1dfd-49f4-bc59-2e2aa520afdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:39:55.972910 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.972888    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-kube-api-access-rxnls" (OuterVolumeSpecName: "kube-api-access-rxnls") pod "a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" (UID: "a0bfac99-1dfd-49f4-bc59-2e2aa520afdd"). InnerVolumeSpecName "kube-api-access-rxnls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:39:55.974885 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:55.974860    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-util" (OuterVolumeSpecName: "util") pod "a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" (UID: "a0bfac99-1dfd-49f4-bc59-2e2aa520afdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:39:56.072180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:56.072122    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:56.072180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:56.072151    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:56.072365 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:56.072190    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxnls\" (UniqueName: \"kubernetes.io/projected/a0bfac99-1dfd-49f4-bc59-2e2aa520afdd-kube-api-access-rxnls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:39:56.761310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:56.761279    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq"
Jul 02 21:39:56.761450 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:56.761305    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lnhzq" event={"ID":"a0bfac99-1dfd-49f4-bc59-2e2aa520afdd","Type":"ContainerDied","Data":"8a582d87d819baf4e9207e2dd940002560a4b0a5046e79b31350bab5b80a68be"}
Jul 02 21:39:56.761450 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:39:56.761375    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a582d87d819baf4e9207e2dd940002560a4b0a5046e79b31350bab5b80a68be"
Jul 02 21:40:00.520957 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.520926    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"]
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521254    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="util"
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521266    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="util"
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521283    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="pull"
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521289    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="pull"
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521294    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="extract"
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521299    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="extract"
Jul 02 21:40:00.521356 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.521350    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bfac99-1dfd-49f4-bc59-2e2aa520afdd" containerName="extract"
Jul 02 21:40:00.557512 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.557478    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"]
Jul 02 21:40:00.557680 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.557598    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.566782 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.566760    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 21:40:00.566922 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.566799    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:40:00.567353 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.567336    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6s62g\""
Jul 02 21:40:00.617928 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.617887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f46f14d8-2126-4632-afe6-8b1ac91cdd04-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vfs6s\" (UID: \"f46f14d8-2126-4632-afe6-8b1ac91cdd04\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.618101 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.617985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6v5g\" (UniqueName: \"kubernetes.io/projected/f46f14d8-2126-4632-afe6-8b1ac91cdd04-kube-api-access-v6v5g\") pod \"cert-manager-operator-controller-manager-55c444bf86-vfs6s\" (UID: \"f46f14d8-2126-4632-afe6-8b1ac91cdd04\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.719116 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.719076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6v5g\" (UniqueName: \"kubernetes.io/projected/f46f14d8-2126-4632-afe6-8b1ac91cdd04-kube-api-access-v6v5g\") pod \"cert-manager-operator-controller-manager-55c444bf86-vfs6s\" (UID: \"f46f14d8-2126-4632-afe6-8b1ac91cdd04\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.719266 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.719128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f46f14d8-2126-4632-afe6-8b1ac91cdd04-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vfs6s\" (UID: \"f46f14d8-2126-4632-afe6-8b1ac91cdd04\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.719533 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.719517    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f46f14d8-2126-4632-afe6-8b1ac91cdd04-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vfs6s\" (UID: \"f46f14d8-2126-4632-afe6-8b1ac91cdd04\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.739072 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.739044    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6v5g\" (UniqueName: \"kubernetes.io/projected/f46f14d8-2126-4632-afe6-8b1ac91cdd04-kube-api-access-v6v5g\") pod \"cert-manager-operator-controller-manager-55c444bf86-vfs6s\" (UID: \"f46f14d8-2126-4632-afe6-8b1ac91cdd04\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:00.866664 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:00.866627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"
Jul 02 21:40:01.039823 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:01.039792    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s"]
Jul 02 21:40:01.043607 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:01.043579    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46f14d8_2126_4632_afe6_8b1ac91cdd04.slice/crio-92517c46b68b27ec0511c394370ba8e8421e3e3c9b886231168ed8916c29e0c1 WatchSource:0}: Error finding container 92517c46b68b27ec0511c394370ba8e8421e3e3c9b886231168ed8916c29e0c1: Status 404 returned error can't find the container with id 92517c46b68b27ec0511c394370ba8e8421e3e3c9b886231168ed8916c29e0c1
Jul 02 21:40:01.784137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:01.784053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s" event={"ID":"f46f14d8-2126-4632-afe6-8b1ac91cdd04","Type":"ContainerStarted","Data":"92517c46b68b27ec0511c394370ba8e8421e3e3c9b886231168ed8916c29e0c1"}
Jul 02 21:40:03.796255 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:03.796210    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s" event={"ID":"f46f14d8-2126-4632-afe6-8b1ac91cdd04","Type":"ContainerStarted","Data":"12316cefd3e278783a537f8289f77213751b75e3fd88f504dd3dd603f5c1b7a4"}
Jul 02 21:40:03.841138 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:03.841075    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vfs6s" podStartSLOduration=1.255464157 podStartE2EDuration="3.841050189s" totalImagesPullingTime="2.585586032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:40:03.837991965 +0000 UTC m=+242.835912052" watchObservedRunningTime="2026-07-02 21:40:03.841050189 +0000 UTC m=+242.838970245"
Jul 02 21:40:04.553385 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.553343    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"]
Jul 02 21:40:04.570413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.570386    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.575357 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.575322    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 21:40:04.575357 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.575338    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 21:40:04.575606 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.575375    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x4w5p\""
Jul 02 21:40:04.585595 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.585568    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"]
Jul 02 21:40:04.655985 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.655949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.656145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.655989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzqkh\" (UniqueName: \"kubernetes.io/projected/84d7492f-c94b-468c-988d-0deca428df61-kube-api-access-bzqkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.656145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.656022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.757548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.757508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.757548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.757551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzqkh\" (UniqueName: \"kubernetes.io/projected/84d7492f-c94b-468c-988d-0deca428df61-kube-api-access-bzqkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.757756 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.757583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.757899 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.757882    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.757937 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.757926    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.786752 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.786715    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzqkh\" (UniqueName: \"kubernetes.io/projected/84d7492f-c94b-468c-988d-0deca428df61-kube-api-access-bzqkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:04.882916 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:04.882883    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:05.094777 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:05.094744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"]
Jul 02 21:40:05.097791 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:05.097759    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d7492f_c94b_468c_988d_0deca428df61.slice/crio-0e14d8154acb942e162ef836f2bb620300b6f2f411c50a4aab840eda9a81daee WatchSource:0}: Error finding container 0e14d8154acb942e162ef836f2bb620300b6f2f411c50a4aab840eda9a81daee: Status 404 returned error can't find the container with id 0e14d8154acb942e162ef836f2bb620300b6f2f411c50a4aab840eda9a81daee
Jul 02 21:40:05.807096 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:05.807064    2571 generic.go:356] "Generic (PLEG): container finished" podID="84d7492f-c94b-468c-988d-0deca428df61" containerID="0af4075d51c43c5ace826e58203d61bd0fc327c35df5d1abc8983d641075e7b3" exitCode=0
Jul 02 21:40:05.807290 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:05.807175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l" event={"ID":"84d7492f-c94b-468c-988d-0deca428df61","Type":"ContainerDied","Data":"0af4075d51c43c5ace826e58203d61bd0fc327c35df5d1abc8983d641075e7b3"}
Jul 02 21:40:05.807290 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:05.807251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l" event={"ID":"84d7492f-c94b-468c-988d-0deca428df61","Type":"ContainerStarted","Data":"0e14d8154acb942e162ef836f2bb620300b6f2f411c50a4aab840eda9a81daee"}
Jul 02 21:40:07.856125 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.856089    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"]
Jul 02 21:40:07.858359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.858342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:07.860883 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.860858    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 21:40:07.861076 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.861063    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 21:40:07.861802 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.861787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bcgpf\""
Jul 02 21:40:07.873762 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.873735    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"]
Jul 02 21:40:07.984638 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.984602    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6wz8\" (UniqueName: \"kubernetes.io/projected/72bae35e-67d4-4563-947a-72f2c7e5ade2-kube-api-access-l6wz8\") pod \"cert-manager-cainjector-559cdd8c87-ccfwg\" (UID: \"72bae35e-67d4-4563-947a-72f2c7e5ade2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:07.984817 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:07.984650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bae35e-67d4-4563-947a-72f2c7e5ade2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ccfwg\" (UID: \"72bae35e-67d4-4563-947a-72f2c7e5ade2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:08.085539 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.085496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6wz8\" (UniqueName: \"kubernetes.io/projected/72bae35e-67d4-4563-947a-72f2c7e5ade2-kube-api-access-l6wz8\") pod \"cert-manager-cainjector-559cdd8c87-ccfwg\" (UID: \"72bae35e-67d4-4563-947a-72f2c7e5ade2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:08.085749 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.085551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bae35e-67d4-4563-947a-72f2c7e5ade2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ccfwg\" (UID: \"72bae35e-67d4-4563-947a-72f2c7e5ade2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:08.095049 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.095020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6wz8\" (UniqueName: \"kubernetes.io/projected/72bae35e-67d4-4563-947a-72f2c7e5ade2-kube-api-access-l6wz8\") pod \"cert-manager-cainjector-559cdd8c87-ccfwg\" (UID: \"72bae35e-67d4-4563-947a-72f2c7e5ade2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:08.095297 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.095278    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bae35e-67d4-4563-947a-72f2c7e5ade2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ccfwg\" (UID: \"72bae35e-67d4-4563-947a-72f2c7e5ade2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:08.182099 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.181994    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"
Jul 02 21:40:08.317514 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.317486    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg"]
Jul 02 21:40:08.320302 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:08.320273    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72bae35e_67d4_4563_947a_72f2c7e5ade2.slice/crio-b12a560a3b5ba1ae0f535d30183bfd7f5278249b79f8bf931ec7aacd14749c5e WatchSource:0}: Error finding container b12a560a3b5ba1ae0f535d30183bfd7f5278249b79f8bf931ec7aacd14749c5e: Status 404 returned error can't find the container with id b12a560a3b5ba1ae0f535d30183bfd7f5278249b79f8bf931ec7aacd14749c5e
Jul 02 21:40:08.821717 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:08.821678    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg" event={"ID":"72bae35e-67d4-4563-947a-72f2c7e5ade2","Type":"ContainerStarted","Data":"b12a560a3b5ba1ae0f535d30183bfd7f5278249b79f8bf931ec7aacd14749c5e"}
Jul 02 21:40:12.059995 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.059957    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m22jt"]
Jul 02 21:40:12.064075 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.064051    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.066789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.066771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ns6fm\""
Jul 02 21:40:12.076070 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.076046    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m22jt"]
Jul 02 21:40:12.124335 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.124296    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbh54\" (UniqueName: \"kubernetes.io/projected/20e3cdde-22d0-4037-85f0-80de8beb779c-kube-api-access-bbh54\") pod \"cert-manager-webhook-6486ffd997-m22jt\" (UID: \"20e3cdde-22d0-4037-85f0-80de8beb779c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.124518 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.124382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20e3cdde-22d0-4037-85f0-80de8beb779c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m22jt\" (UID: \"20e3cdde-22d0-4037-85f0-80de8beb779c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.224958 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.224896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbh54\" (UniqueName: \"kubernetes.io/projected/20e3cdde-22d0-4037-85f0-80de8beb779c-kube-api-access-bbh54\") pod \"cert-manager-webhook-6486ffd997-m22jt\" (UID: \"20e3cdde-22d0-4037-85f0-80de8beb779c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.225174 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.225044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20e3cdde-22d0-4037-85f0-80de8beb779c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m22jt\" (UID: \"20e3cdde-22d0-4037-85f0-80de8beb779c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.237708 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.237672    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20e3cdde-22d0-4037-85f0-80de8beb779c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m22jt\" (UID: \"20e3cdde-22d0-4037-85f0-80de8beb779c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.237708 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.237706    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbh54\" (UniqueName: \"kubernetes.io/projected/20e3cdde-22d0-4037-85f0-80de8beb779c-kube-api-access-bbh54\") pod \"cert-manager-webhook-6486ffd997-m22jt\" (UID: \"20e3cdde-22d0-4037-85f0-80de8beb779c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.372857 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.372804    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:12.524757 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.524660    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m22jt"]
Jul 02 21:40:12.528088 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:12.528054    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20e3cdde_22d0_4037_85f0_80de8beb779c.slice/crio-930232cef45f08739873b71be2946facabcd73f16196b7fddea543e3c1bd4f75 WatchSource:0}: Error finding container 930232cef45f08739873b71be2946facabcd73f16196b7fddea543e3c1bd4f75: Status 404 returned error can't find the container with id 930232cef45f08739873b71be2946facabcd73f16196b7fddea543e3c1bd4f75
Jul 02 21:40:12.840358 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:12.840322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt" event={"ID":"20e3cdde-22d0-4037-85f0-80de8beb779c","Type":"ContainerStarted","Data":"930232cef45f08739873b71be2946facabcd73f16196b7fddea543e3c1bd4f75"}
Jul 02 21:40:14.853243 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:14.853200    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt" event={"ID":"20e3cdde-22d0-4037-85f0-80de8beb779c","Type":"ContainerStarted","Data":"cbc132cd44da1831efc6fad827787a2185af7c85ebd1d5ac835c1b45c835624a"}
Jul 02 21:40:14.853781 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:14.853312    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:14.855375 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:14.855337    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg" event={"ID":"72bae35e-67d4-4563-947a-72f2c7e5ade2","Type":"ContainerStarted","Data":"b48de6c9b73a10cd0ebebf6d000cd816acd28f861723e72a92bd2a58df9bd807"}
Jul 02 21:40:14.876261 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:14.876200    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt" podStartSLOduration=1.022132588 podStartE2EDuration="2.876175765s" totalImagesPullingTime="1.854043177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:40:14.873599929 +0000 UTC m=+253.871519987" watchObservedRunningTime="2026-07-02 21:40:14.876175765 +0000 UTC m=+253.874095819"
Jul 02 21:40:14.894607 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:14.894542    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ccfwg" podStartSLOduration=2.244817683 podStartE2EDuration="7.89451996s" totalImagesPullingTime="5.649702277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:40:14.893841206 +0000 UTC m=+253.891761300" watchObservedRunningTime="2026-07-02 21:40:14.89451996 +0000 UTC m=+253.892440018"
Jul 02 21:40:16.866856 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:16.866823    2571 generic.go:356] "Generic (PLEG): container finished" podID="84d7492f-c94b-468c-988d-0deca428df61" containerID="cd39aa89bfff9c0be0a094be59da686e93dd9e67b376eb981e4e6cec29e05e65" exitCode=0
Jul 02 21:40:16.867299 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:16.866921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l" event={"ID":"84d7492f-c94b-468c-988d-0deca428df61","Type":"ContainerDied","Data":"cd39aa89bfff9c0be0a094be59da686e93dd9e67b376eb981e4e6cec29e05e65"}
Jul 02 21:40:17.874403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:17.874365    2571 generic.go:356] "Generic (PLEG): container finished" podID="84d7492f-c94b-468c-988d-0deca428df61" containerID="27bbc45f17b7ce58adfd5afc2107c7afa34931e69ad15c65d9d7db2e5961ca5b" exitCode=0
Jul 02 21:40:17.874812 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:17.874422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l" event={"ID":"84d7492f-c94b-468c-988d-0deca428df61","Type":"ContainerDied","Data":"27bbc45f17b7ce58adfd5afc2107c7afa34931e69ad15c65d9d7db2e5961ca5b"}
Jul 02 21:40:19.006959 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.006934    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:19.088989 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.088946    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-util\") pod \"84d7492f-c94b-468c-988d-0deca428df61\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") "
Jul 02 21:40:19.089232 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.089001    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzqkh\" (UniqueName: \"kubernetes.io/projected/84d7492f-c94b-468c-988d-0deca428df61-kube-api-access-bzqkh\") pod \"84d7492f-c94b-468c-988d-0deca428df61\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") "
Jul 02 21:40:19.089232 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.089052    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-bundle\") pod \"84d7492f-c94b-468c-988d-0deca428df61\" (UID: \"84d7492f-c94b-468c-988d-0deca428df61\") "
Jul 02 21:40:19.089472 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.089437    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-bundle" (OuterVolumeSpecName: "bundle") pod "84d7492f-c94b-468c-988d-0deca428df61" (UID: "84d7492f-c94b-468c-988d-0deca428df61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:40:19.091221 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.091193    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d7492f-c94b-468c-988d-0deca428df61-kube-api-access-bzqkh" (OuterVolumeSpecName: "kube-api-access-bzqkh") pod "84d7492f-c94b-468c-988d-0deca428df61" (UID: "84d7492f-c94b-468c-988d-0deca428df61"). InnerVolumeSpecName "kube-api-access-bzqkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:40:19.093121 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.093100    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-util" (OuterVolumeSpecName: "util") pod "84d7492f-c94b-468c-988d-0deca428df61" (UID: "84d7492f-c94b-468c-988d-0deca428df61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:40:19.190858 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.190766    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:40:19.190858 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.190798    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzqkh\" (UniqueName: \"kubernetes.io/projected/84d7492f-c94b-468c-988d-0deca428df61-kube-api-access-bzqkh\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:40:19.190858 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.190809    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d7492f-c94b-468c-988d-0deca428df61-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:40:19.885518 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.885435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l" event={"ID":"84d7492f-c94b-468c-988d-0deca428df61","Type":"ContainerDied","Data":"0e14d8154acb942e162ef836f2bb620300b6f2f411c50a4aab840eda9a81daee"}
Jul 02 21:40:19.885518 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.885482    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e14d8154acb942e162ef836f2bb620300b6f2f411c50a4aab840eda9a81daee"
Jul 02 21:40:19.885518 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:19.885486    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx4m6l"
Jul 02 21:40:20.863015 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:20.862983    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m22jt"
Jul 02 21:40:31.844400 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844316    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"]
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844649    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="extract"
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844660    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="extract"
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844672    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="util"
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844679    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="util"
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844685    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="pull"
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844690    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="pull"
Jul 02 21:40:31.844774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.844755    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="84d7492f-c94b-468c-988d-0deca428df61" containerName="extract"
Jul 02 21:40:31.847027 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.847008    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:31.849783 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.849762    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 21:40:31.849783 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.849775    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 21:40:31.850631 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.850615    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x4w5p\""
Jul 02 21:40:31.857478 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:31.857448    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"]
Jul 02 21:40:32.005405 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.005365    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.005558 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.005427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.005558 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.005532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmq86\" (UniqueName: \"kubernetes.io/projected/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-kube-api-access-kmq86\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.106586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.106492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.106586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.106547    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmq86\" (UniqueName: \"kubernetes.io/projected/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-kube-api-access-kmq86\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.106774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.106596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.106927 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.106899    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.106968 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.106923    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.115177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.115120    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmq86\" (UniqueName: \"kubernetes.io/projected/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-kube-api-access-kmq86\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.157182 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.157123    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:32.297724 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.297679    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"]
Jul 02 21:40:32.301644 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:32.301619    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533cc0cf_e4f3_4844_a9fc_caec1db23bfc.slice/crio-926396e4d05dcd1dd68043c7662e5538558159f6c214a8b119b23d8b03d383b6 WatchSource:0}: Error finding container 926396e4d05dcd1dd68043c7662e5538558159f6c214a8b119b23d8b03d383b6: Status 404 returned error can't find the container with id 926396e4d05dcd1dd68043c7662e5538558159f6c214a8b119b23d8b03d383b6
Jul 02 21:40:32.946893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.946856    2571 generic.go:356] "Generic (PLEG): container finished" podID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerID="1a4e4ec6c2eeda7d912b1178b350504f86f704098506af7bdb9207b1d8684f3e" exitCode=0
Jul 02 21:40:32.947298 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.946947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5" event={"ID":"533cc0cf-e4f3-4844-a9fc-caec1db23bfc","Type":"ContainerDied","Data":"1a4e4ec6c2eeda7d912b1178b350504f86f704098506af7bdb9207b1d8684f3e"}
Jul 02 21:40:32.947298 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:32.947008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5" event={"ID":"533cc0cf-e4f3-4844-a9fc-caec1db23bfc","Type":"ContainerStarted","Data":"926396e4d05dcd1dd68043c7662e5538558159f6c214a8b119b23d8b03d383b6"}
Jul 02 21:40:33.953336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:33.953306    2571 generic.go:356] "Generic (PLEG): container finished" podID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerID="cbdef64f017c93ed787354571c966e83c2ded4839b72145f17dc00c8ef2dd878" exitCode=0
Jul 02 21:40:33.953723 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:33.953389    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5" event={"ID":"533cc0cf-e4f3-4844-a9fc-caec1db23bfc","Type":"ContainerDied","Data":"cbdef64f017c93ed787354571c966e83c2ded4839b72145f17dc00c8ef2dd878"}
Jul 02 21:40:34.960773 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:34.960728    2571 generic.go:356] "Generic (PLEG): container finished" podID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerID="dcde4798e97f2a4725c98ad58a0e8e09345241977547bc1c7a10c64c88196b7a" exitCode=0
Jul 02 21:40:34.961185 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:34.960846    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5" event={"ID":"533cc0cf-e4f3-4844-a9fc-caec1db23bfc","Type":"ContainerDied","Data":"dcde4798e97f2a4725c98ad58a0e8e09345241977547bc1c7a10c64c88196b7a"}
Jul 02 21:40:36.101367 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.101341    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:36.244072 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.243974    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmq86\" (UniqueName: \"kubernetes.io/projected/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-kube-api-access-kmq86\") pod \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") "
Jul 02 21:40:36.244243 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.244095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-util\") pod \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") "
Jul 02 21:40:36.244243 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.244134    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-bundle\") pod \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\" (UID: \"533cc0cf-e4f3-4844-a9fc-caec1db23bfc\") "
Jul 02 21:40:36.244992 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.244962    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-bundle" (OuterVolumeSpecName: "bundle") pod "533cc0cf-e4f3-4844-a9fc-caec1db23bfc" (UID: "533cc0cf-e4f3-4844-a9fc-caec1db23bfc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:40:36.246169 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.246133    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-kube-api-access-kmq86" (OuterVolumeSpecName: "kube-api-access-kmq86") pod "533cc0cf-e4f3-4844-a9fc-caec1db23bfc" (UID: "533cc0cf-e4f3-4844-a9fc-caec1db23bfc"). InnerVolumeSpecName "kube-api-access-kmq86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:40:36.249798 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.249764    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-util" (OuterVolumeSpecName: "util") pod "533cc0cf-e4f3-4844-a9fc-caec1db23bfc" (UID: "533cc0cf-e4f3-4844-a9fc-caec1db23bfc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:40:36.345045 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.345007    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:40:36.345045 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.345042    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmq86\" (UniqueName: \"kubernetes.io/projected/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-kube-api-access-kmq86\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:40:36.345045 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.345053    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/533cc0cf-e4f3-4844-a9fc-caec1db23bfc-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:40:36.971812 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.971780    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5"
Jul 02 21:40:36.971812 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.971800    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affrpl5" event={"ID":"533cc0cf-e4f3-4844-a9fc-caec1db23bfc","Type":"ContainerDied","Data":"926396e4d05dcd1dd68043c7662e5538558159f6c214a8b119b23d8b03d383b6"}
Jul 02 21:40:36.972027 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:36.971845    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="926396e4d05dcd1dd68043c7662e5538558159f6c214a8b119b23d8b03d383b6"
Jul 02 21:40:38.240243 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240203    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"]
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240540    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="extract"
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240550    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="extract"
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240561    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="util"
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240566    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="util"
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240576    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="pull"
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240581    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="pull"
Jul 02 21:40:38.240629 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.240632    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="533cc0cf-e4f3-4844-a9fc-caec1db23bfc" containerName="extract"
Jul 02 21:40:38.243042 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.243026    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.246099 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.246074    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 21:40:38.246439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.246074    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 21:40:38.246439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.246418    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 21:40:38.247052 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.247037    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 21:40:38.247052 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.247045    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:40:38.247180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.247133    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kv67n\""
Jul 02 21:40:38.264325 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.264291    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"]
Jul 02 21:40:38.264545 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.264521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/784a19e5-09b7-4dce-8f6a-ce3a5865e720-manager-config\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.264608 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.264567    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784a19e5-09b7-4dce-8f6a-ce3a5865e720-cert\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.264696 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.264680    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/784a19e5-09b7-4dce-8f6a-ce3a5865e720-metrics-cert\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.264752 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.264709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln2jm\" (UniqueName: \"kubernetes.io/projected/784a19e5-09b7-4dce-8f6a-ce3a5865e720-kube-api-access-ln2jm\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.366019 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.365981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/784a19e5-09b7-4dce-8f6a-ce3a5865e720-manager-config\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.366019 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.366023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784a19e5-09b7-4dce-8f6a-ce3a5865e720-cert\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.366268 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.366061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/784a19e5-09b7-4dce-8f6a-ce3a5865e720-metrics-cert\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.366268 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.366078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln2jm\" (UniqueName: \"kubernetes.io/projected/784a19e5-09b7-4dce-8f6a-ce3a5865e720-kube-api-access-ln2jm\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.366793 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.366765    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/784a19e5-09b7-4dce-8f6a-ce3a5865e720-manager-config\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.368695 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.368674    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/784a19e5-09b7-4dce-8f6a-ce3a5865e720-metrics-cert\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.368789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.368723    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784a19e5-09b7-4dce-8f6a-ce3a5865e720-cert\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.375864 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.375837    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln2jm\" (UniqueName: \"kubernetes.io/projected/784a19e5-09b7-4dce-8f6a-ce3a5865e720-kube-api-access-ln2jm\") pod \"lws-controller-manager-8677d7b8dc-7tz7p\" (UID: \"784a19e5-09b7-4dce-8f6a-ce3a5865e720\") " pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.553083 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.552991    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:38.716215 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.716106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"]
Jul 02 21:40:38.718474 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:38.718448    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784a19e5_09b7_4dce_8f6a_ce3a5865e720.slice/crio-7a84a2121a28a4837dc1855facd59fd63a93db25dd1a67b91633010b68ebae2b WatchSource:0}: Error finding container 7a84a2121a28a4837dc1855facd59fd63a93db25dd1a67b91633010b68ebae2b: Status 404 returned error can't find the container with id 7a84a2121a28a4837dc1855facd59fd63a93db25dd1a67b91633010b68ebae2b
Jul 02 21:40:38.983128 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:38.983091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p" event={"ID":"784a19e5-09b7-4dce-8f6a-ce3a5865e720","Type":"ContainerStarted","Data":"7a84a2121a28a4837dc1855facd59fd63a93db25dd1a67b91633010b68ebae2b"}
Jul 02 21:40:40.994528 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:40.994485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p" event={"ID":"784a19e5-09b7-4dce-8f6a-ce3a5865e720","Type":"ContainerStarted","Data":"a0bb08a4086e453d8619e3c0901f4b4f11ba8e53260bda948d90e10b0e7c73d3"}
Jul 02 21:40:40.994961 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:40.994638    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:41.014432 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:41.014375    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p" podStartSLOduration=1.480229484 podStartE2EDuration="3.014355927s" totalImagesPullingTime="1.534126443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:40:41.012058315 +0000 UTC m=+280.009978394" watchObservedRunningTime="2026-07-02 21:40:41.014355927 +0000 UTC m=+280.012275982"
Jul 02 21:40:49.344374 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.344337    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"]
Jul 02 21:40:49.348773 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.348750    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.351270 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.351247    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 21:40:49.352005 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.351985    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 21:40:49.352272 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.352260    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 21:40:49.353209 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.353192    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 21:40:49.353335 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.353319    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gm24m\""
Jul 02 21:40:49.369301 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.369267    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"]
Jul 02 21:40:49.448479 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.448447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-webhook-cert\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.448657 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.448491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.448657 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.448549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-tmp\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.448657 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.448600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x676m\" (UniqueName: \"kubernetes.io/projected/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-kube-api-access-x676m\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.448772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.448687    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-manifests\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.549206 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.549116    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x676m\" (UniqueName: \"kubernetes.io/projected/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-kube-api-access-x676m\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.549443 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.549232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-manifests\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.549443 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.549273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-webhook-cert\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.549443 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.549310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.549443 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.549335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-tmp\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.549738 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.549681    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-manifests\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.551851 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.551823    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-tmp\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.551986 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.551968    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-webhook-cert\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.552246 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.552222    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.558975 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.558945    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x676m\" (UniqueName: \"kubernetes.io/projected/f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5-kube-api-access-x676m\") pod \"opendatahub-operator-controller-manager-bcc4b86cc-8bhpd\" (UID: \"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5\") " pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.659351 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.659263    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:49.808361 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:49.808335    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"]
Jul 02 21:40:49.811362 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:40:49.811326    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6eb6db2_637e_40f3_b3ea_d9da2c8c2da5.slice/crio-8fc0e3ea4e6374400c0ab19f6163841537d3d27a857726475ef0613adeb1e18b WatchSource:0}: Error finding container 8fc0e3ea4e6374400c0ab19f6163841537d3d27a857726475ef0613adeb1e18b: Status 404 returned error can't find the container with id 8fc0e3ea4e6374400c0ab19f6163841537d3d27a857726475ef0613adeb1e18b
Jul 02 21:40:50.044534 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:50.044438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd" event={"ID":"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5","Type":"ContainerStarted","Data":"8fc0e3ea4e6374400c0ab19f6163841537d3d27a857726475ef0613adeb1e18b"}
Jul 02 21:40:52.001683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:52.001649    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8677d7b8dc-7tz7p"
Jul 02 21:40:53.064047 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:53.063950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd" event={"ID":"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5","Type":"ContainerStarted","Data":"1e54c389e3a3adeca68711b0814d53ff3140d7cce788d7d47d61b288fa1fdbbb"}
Jul 02 21:40:54.070090 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:54.070055    2571 generic.go:356] "Generic (PLEG): container finished" podID="f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5" containerID="1e54c389e3a3adeca68711b0814d53ff3140d7cce788d7d47d61b288fa1fdbbb" exitCode=0
Jul 02 21:40:54.070497 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:54.070145    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd" event={"ID":"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5","Type":"ContainerDied","Data":"1e54c389e3a3adeca68711b0814d53ff3140d7cce788d7d47d61b288fa1fdbbb"}
Jul 02 21:40:55.078596 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:55.078562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd" event={"ID":"f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5","Type":"ContainerStarted","Data":"58fa4deff13b6ff2e924ad1d5b8ebf1469dec60f2d24ce38cf5c744a1359d54a"}
Jul 02 21:40:55.079035 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:55.078682    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:40:55.103206 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:40:55.103139    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd" podStartSLOduration=1.710714324 podStartE2EDuration="6.103122305s" totalImagesPullingTime="3.302278755s" totalInitContainerRuntime="1.090129226s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:40:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:40:55.101759887 +0000 UTC m=+294.099679941" watchObservedRunningTime="2026-07-02 21:40:55.103122305 +0000 UTC m=+294.101042361"
Jul 02 21:41:01.432080 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:01.432052    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:41:01.434707 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:01.434675    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:41:01.442910 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:01.442886    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 21:41:06.085762 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:06.085730    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bcc4b86cc-8bhpd"
Jul 02 21:41:09.025429 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.025396    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"]
Jul 02 21:41:09.038573 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.038536    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.041145 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.041117    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 21:41:09.041311 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.041191    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 21:41:09.041458 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.041339    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tkjpv\""
Jul 02 21:41:09.049871 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.049844    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"]
Jul 02 21:41:09.135921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.135872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-tls-certs\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.135921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.135929    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-tmp\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.136216 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.136050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbqsc\" (UniqueName: \"kubernetes.io/projected/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-kube-api-access-tbqsc\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.237424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.237373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-tls-certs\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.237618 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.237448    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-tmp\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.237618 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.237520    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqsc\" (UniqueName: \"kubernetes.io/projected/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-kube-api-access-tbqsc\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.240276 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.240248    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-tmp\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.240557 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.240528    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-tls-certs\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.263362 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.263330    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqsc\" (UniqueName: \"kubernetes.io/projected/c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71-kube-api-access-tbqsc\") pod \"kube-auth-proxy-8697fd7f55-4cdr5\" (UID: \"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71\") " pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.350567 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.350518    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"
Jul 02 21:41:09.507089 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.507062    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5"]
Jul 02 21:41:09.509254 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:41:09.509229    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81538c7_32ce_4dd2_92ef_d9d0d1a4ad71.slice/crio-3cf73a8b204d1b854b7a352e5c0bc9de13f02c796a83a79a2eb4bd9909f2b209 WatchSource:0}: Error finding container 3cf73a8b204d1b854b7a352e5c0bc9de13f02c796a83a79a2eb4bd9909f2b209: Status 404 returned error can't find the container with id 3cf73a8b204d1b854b7a352e5c0bc9de13f02c796a83a79a2eb4bd9909f2b209
Jul 02 21:41:09.511038 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:09.511024    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:41:10.156006 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:10.155962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5" event={"ID":"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71","Type":"ContainerStarted","Data":"3cf73a8b204d1b854b7a352e5c0bc9de13f02c796a83a79a2eb4bd9909f2b209"}
Jul 02 21:41:13.176736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:13.176697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5" event={"ID":"c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71","Type":"ContainerStarted","Data":"694c19231a888e747bea7ed745bb223adf22cf680c16a85c950d9d8759e8d141"}
Jul 02 21:41:13.194031 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:41:13.193972    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8697fd7f55-4cdr5" podStartSLOduration=1.068340128 podStartE2EDuration="4.193951972s" totalImagesPullingTime="3.125611844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:41:13.192214062 +0000 UTC m=+312.190134139" watchObservedRunningTime="2026-07-02 21:41:13.193951972 +0000 UTC m=+312.191872026"
Jul 02 21:42:26.068790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.068703    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"]
Jul 02 21:42:26.071409 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.071388    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.074242 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.074222    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 21:42:26.074363 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.074245    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zzx2n\""
Jul 02 21:42:26.075130 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.075113    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 21:42:26.085392 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.085367    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"]
Jul 02 21:42:26.141734 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.141690    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltddc\" (UniqueName: \"kubernetes.io/projected/df942e3b-7345-4a54-a141-f893f0583811-kube-api-access-ltddc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.141929 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.141751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.141929 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.141783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.242772 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.242731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltddc\" (UniqueName: \"kubernetes.io/projected/df942e3b-7345-4a54-a141-f893f0583811-kube-api-access-ltddc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.242973 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.242887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.242973 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.242912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.243350 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.243331    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.243425 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.243403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.251784 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.251761    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltddc\" (UniqueName: \"kubernetes.io/projected/df942e3b-7345-4a54-a141-f893f0583811-kube-api-access-ltddc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.381231 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.381120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:26.546086 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.546058    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"]
Jul 02 21:42:26.548055 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:42:26.548032    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf942e3b_7345_4a54_a141_f893f0583811.slice/crio-5d7c9fa969c9cde807ab8df43a137cafe05b22b7b0d6ec949efdb4cd87c9e814 WatchSource:0}: Error finding container 5d7c9fa969c9cde807ab8df43a137cafe05b22b7b0d6ec949efdb4cd87c9e814: Status 404 returned error can't find the container with id 5d7c9fa969c9cde807ab8df43a137cafe05b22b7b0d6ec949efdb4cd87c9e814
Jul 02 21:42:26.646310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.646226    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"]
Jul 02 21:42:26.648802 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.648780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.659091 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.659064    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"]
Jul 02 21:42:26.746817 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.746782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.746988 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.746839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.746988 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.746883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh5kr\" (UniqueName: \"kubernetes.io/projected/e1895ab2-d0f8-4477-b898-bb6e233c91a1-kube-api-access-kh5kr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.848468 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.848428    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.848640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.848479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.848640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.848509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh5kr\" (UniqueName: \"kubernetes.io/projected/e1895ab2-d0f8-4477-b898-bb6e233c91a1-kube-api-access-kh5kr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.848859 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.848837    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.848896 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.848865    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:26.857871 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:26.857847    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh5kr\" (UniqueName: \"kubernetes.io/projected/e1895ab2-d0f8-4477-b898-bb6e233c91a1-kube-api-access-kh5kr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:27.014037 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.013951    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:27.148335 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.148309    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"]
Jul 02 21:42:27.150024 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:42:27.149990    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1895ab2_d0f8_4477_b898_bb6e233c91a1.slice/crio-ed782d3effa754c836cb6253ed02193d6d8636999223ab8454df36b458f821b7 WatchSource:0}: Error finding container ed782d3effa754c836cb6253ed02193d6d8636999223ab8454df36b458f821b7: Status 404 returned error can't find the container with id ed782d3effa754c836cb6253ed02193d6d8636999223ab8454df36b458f821b7
Jul 02 21:42:27.233262 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.233223    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"]
Jul 02 21:42:27.235932 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.235911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.246512 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.246484    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"]
Jul 02 21:42:27.353002 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.352961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9r5k\" (UniqueName: \"kubernetes.io/projected/50b5b528-9141-4d5e-b6ee-c36472eb2360-kube-api-access-b9r5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.353208 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.353029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.353208 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.353054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.454497 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.454458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9r5k\" (UniqueName: \"kubernetes.io/projected/50b5b528-9141-4d5e-b6ee-c36472eb2360-kube-api-access-b9r5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.454678 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.454517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.454678 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.454533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.454921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.454901    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.454969 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.454917    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.463945 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.463920    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9r5k\" (UniqueName: \"kubernetes.io/projected/50b5b528-9141-4d5e-b6ee-c36472eb2360-kube-api-access-b9r5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.542607 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.542572    2571 generic.go:356] "Generic (PLEG): container finished" podID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerID="576312ea6f0fe91bba321d145cd9a5cafcd29d13d2ccdd39911340042c12910e" exitCode=0
Jul 02 21:42:27.542785 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.542656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4" event={"ID":"e1895ab2-d0f8-4477-b898-bb6e233c91a1","Type":"ContainerDied","Data":"576312ea6f0fe91bba321d145cd9a5cafcd29d13d2ccdd39911340042c12910e"}
Jul 02 21:42:27.542785 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.542704    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4" event={"ID":"e1895ab2-d0f8-4477-b898-bb6e233c91a1","Type":"ContainerStarted","Data":"ed782d3effa754c836cb6253ed02193d6d8636999223ab8454df36b458f821b7"}
Jul 02 21:42:27.544405 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.544381    2571 generic.go:356] "Generic (PLEG): container finished" podID="df942e3b-7345-4a54-a141-f893f0583811" containerID="401f6bfdbb7963d2de6ab1a2296f28c6f8fdf8873fd895d695fb4aa5e9201405" exitCode=0
Jul 02 21:42:27.544526 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.544414    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9" event={"ID":"df942e3b-7345-4a54-a141-f893f0583811","Type":"ContainerDied","Data":"401f6bfdbb7963d2de6ab1a2296f28c6f8fdf8873fd895d695fb4aa5e9201405"}
Jul 02 21:42:27.544526 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.544444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9" event={"ID":"df942e3b-7345-4a54-a141-f893f0583811","Type":"ContainerStarted","Data":"5d7c9fa969c9cde807ab8df43a137cafe05b22b7b0d6ec949efdb4cd87c9e814"}
Jul 02 21:42:27.546528 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.546510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:27.681236 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.681209    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"]
Jul 02 21:42:27.683401 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:42:27.683373    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b5b528_9141_4d5e_b6ee_c36472eb2360.slice/crio-cd2e4507abaf6dd04f64855dace065a8f6dba634b7fae110992cdbc8e0ae5828 WatchSource:0}: Error finding container cd2e4507abaf6dd04f64855dace065a8f6dba634b7fae110992cdbc8e0ae5828: Status 404 returned error can't find the container with id cd2e4507abaf6dd04f64855dace065a8f6dba634b7fae110992cdbc8e0ae5828
Jul 02 21:42:27.835190 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.835142    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"]
Jul 02 21:42:27.837656 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.837639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:27.851938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.851909    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"]
Jul 02 21:42:27.959683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.959647    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82zvm\" (UniqueName: \"kubernetes.io/projected/b58cdfaa-bc61-4361-92a6-abe382e6468c-kube-api-access-82zvm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:27.959683 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.959688    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:27.959921 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:27.959798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.060543 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.060511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82zvm\" (UniqueName: \"kubernetes.io/projected/b58cdfaa-bc61-4361-92a6-abe382e6468c-kube-api-access-82zvm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.060708 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.060558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.060708 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.060639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.060980 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.060961    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.061061 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.061007    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.069056 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.069028    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82zvm\" (UniqueName: \"kubernetes.io/projected/b58cdfaa-bc61-4361-92a6-abe382e6468c-kube-api-access-82zvm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.167310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.167234    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:28.449879 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.449783    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"]
Jul 02 21:42:28.529999 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:42:28.529965    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58cdfaa_bc61_4361_92a6_abe382e6468c.slice/crio-9d73f0570c7c0f5036fbf03cdaac3f23975ed385f37a839f459617bb2a9c08bf WatchSource:0}: Error finding container 9d73f0570c7c0f5036fbf03cdaac3f23975ed385f37a839f459617bb2a9c08bf: Status 404 returned error can't find the container with id 9d73f0570c7c0f5036fbf03cdaac3f23975ed385f37a839f459617bb2a9c08bf
Jul 02 21:42:28.551599 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.551571    2571 generic.go:356] "Generic (PLEG): container finished" podID="df942e3b-7345-4a54-a141-f893f0583811" containerID="86f4cf75a47df1bacb0064de685d45f1563618c4ce1f69f6c02b04953e465ccf" exitCode=0
Jul 02 21:42:28.551694 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.551650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9" event={"ID":"df942e3b-7345-4a54-a141-f893f0583811","Type":"ContainerDied","Data":"86f4cf75a47df1bacb0064de685d45f1563618c4ce1f69f6c02b04953e465ccf"}
Jul 02 21:42:28.553513 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.553483    2571 generic.go:356] "Generic (PLEG): container finished" podID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerID="309a816f17583666798a21e88ac15a0a3c2ff4a6c9d1bf8c808366435278f3f7" exitCode=0
Jul 02 21:42:28.553616 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.553513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4" event={"ID":"e1895ab2-d0f8-4477-b898-bb6e233c91a1","Type":"ContainerDied","Data":"309a816f17583666798a21e88ac15a0a3c2ff4a6c9d1bf8c808366435278f3f7"}
Jul 02 21:42:28.555246 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.555222    2571 generic.go:356] "Generic (PLEG): container finished" podID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerID="c98c47de51f8aa6a8e2f9a15cc8d68c1133fa9cc49d614a3a972f062ebc1e834" exitCode=0
Jul 02 21:42:28.555333 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.555306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g" event={"ID":"50b5b528-9141-4d5e-b6ee-c36472eb2360","Type":"ContainerDied","Data":"c98c47de51f8aa6a8e2f9a15cc8d68c1133fa9cc49d614a3a972f062ebc1e834"}
Jul 02 21:42:28.555384 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.555349    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g" event={"ID":"50b5b528-9141-4d5e-b6ee-c36472eb2360","Type":"ContainerStarted","Data":"cd2e4507abaf6dd04f64855dace065a8f6dba634b7fae110992cdbc8e0ae5828"}
Jul 02 21:42:28.556880 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:28.556675    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2" event={"ID":"b58cdfaa-bc61-4361-92a6-abe382e6468c","Type":"ContainerStarted","Data":"9d73f0570c7c0f5036fbf03cdaac3f23975ed385f37a839f459617bb2a9c08bf"}
Jul 02 21:42:29.564292 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.564212    2571 generic.go:356] "Generic (PLEG): container finished" podID="df942e3b-7345-4a54-a141-f893f0583811" containerID="0de87a29deaf78db11cfd09e0ed2a5ecf713e2950c6e583f0e3eba15c4aad3c0" exitCode=0
Jul 02 21:42:29.564640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.564283    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9" event={"ID":"df942e3b-7345-4a54-a141-f893f0583811","Type":"ContainerDied","Data":"0de87a29deaf78db11cfd09e0ed2a5ecf713e2950c6e583f0e3eba15c4aad3c0"}
Jul 02 21:42:29.566519 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.566492    2571 generic.go:356] "Generic (PLEG): container finished" podID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerID="4c52be96f3df9588975f84d8c678d0ad65167e72190d026c562010e16d991390" exitCode=0
Jul 02 21:42:29.566646 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.566563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4" event={"ID":"e1895ab2-d0f8-4477-b898-bb6e233c91a1","Type":"ContainerDied","Data":"4c52be96f3df9588975f84d8c678d0ad65167e72190d026c562010e16d991390"}
Jul 02 21:42:29.568345 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.568318    2571 generic.go:356] "Generic (PLEG): container finished" podID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerID="d48eb52396c3f6cff07ef54f2a74ec0d1e82d2045fa20af554ab5abf55092a7a" exitCode=0
Jul 02 21:42:29.568498 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.568425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g" event={"ID":"50b5b528-9141-4d5e-b6ee-c36472eb2360","Type":"ContainerDied","Data":"d48eb52396c3f6cff07ef54f2a74ec0d1e82d2045fa20af554ab5abf55092a7a"}
Jul 02 21:42:29.569870 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.569838    2571 generic.go:356] "Generic (PLEG): container finished" podID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerID="447dda281f27182a86d481db965ff22bab8de3f6098d87f3e82179baa00c4942" exitCode=0
Jul 02 21:42:29.570011 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:29.569877    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2" event={"ID":"b58cdfaa-bc61-4361-92a6-abe382e6468c","Type":"ContainerDied","Data":"447dda281f27182a86d481db965ff22bab8de3f6098d87f3e82179baa00c4942"}
Jul 02 21:42:30.576693 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.576654    2571 generic.go:356] "Generic (PLEG): container finished" podID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerID="ade1c2130acff258731be60cb522369448942372c84a976d8ecea5a406f2bd35" exitCode=0
Jul 02 21:42:30.577088 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.576737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g" event={"ID":"50b5b528-9141-4d5e-b6ee-c36472eb2360","Type":"ContainerDied","Data":"ade1c2130acff258731be60cb522369448942372c84a976d8ecea5a406f2bd35"}
Jul 02 21:42:30.578520 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.578493    2571 generic.go:356] "Generic (PLEG): container finished" podID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerID="21984403a8df3d12fbcdd3b96b9ed4474ad912a4a23a5fbac43bc6dd685044e2" exitCode=0
Jul 02 21:42:30.578640 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.578574    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2" event={"ID":"b58cdfaa-bc61-4361-92a6-abe382e6468c","Type":"ContainerDied","Data":"21984403a8df3d12fbcdd3b96b9ed4474ad912a4a23a5fbac43bc6dd685044e2"}
Jul 02 21:42:30.721573 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.721549    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:30.742193 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.742149    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:30.786461 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.786432    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-util\") pod \"df942e3b-7345-4a54-a141-f893f0583811\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") "
Jul 02 21:42:30.786461 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.786472    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltddc\" (UniqueName: \"kubernetes.io/projected/df942e3b-7345-4a54-a141-f893f0583811-kube-api-access-ltddc\") pod \"df942e3b-7345-4a54-a141-f893f0583811\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") "
Jul 02 21:42:30.786711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.786491    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-util\") pod \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") "
Jul 02 21:42:30.786711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.786542    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-bundle\") pod \"df942e3b-7345-4a54-a141-f893f0583811\" (UID: \"df942e3b-7345-4a54-a141-f893f0583811\") "
Jul 02 21:42:30.786711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.786563    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh5kr\" (UniqueName: \"kubernetes.io/projected/e1895ab2-d0f8-4477-b898-bb6e233c91a1-kube-api-access-kh5kr\") pod \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") "
Jul 02 21:42:30.786711 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.786599    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-bundle\") pod \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\" (UID: \"e1895ab2-d0f8-4477-b898-bb6e233c91a1\") "
Jul 02 21:42:30.787172 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.787126    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-bundle" (OuterVolumeSpecName: "bundle") pod "e1895ab2-d0f8-4477-b898-bb6e233c91a1" (UID: "e1895ab2-d0f8-4477-b898-bb6e233c91a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:30.787297 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.787185    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-bundle" (OuterVolumeSpecName: "bundle") pod "df942e3b-7345-4a54-a141-f893f0583811" (UID: "df942e3b-7345-4a54-a141-f893f0583811"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:30.788892 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.788868    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df942e3b-7345-4a54-a141-f893f0583811-kube-api-access-ltddc" (OuterVolumeSpecName: "kube-api-access-ltddc") pod "df942e3b-7345-4a54-a141-f893f0583811" (UID: "df942e3b-7345-4a54-a141-f893f0583811"). InnerVolumeSpecName "kube-api-access-ltddc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:42:30.789059 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.789044    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1895ab2-d0f8-4477-b898-bb6e233c91a1-kube-api-access-kh5kr" (OuterVolumeSpecName: "kube-api-access-kh5kr") pod "e1895ab2-d0f8-4477-b898-bb6e233c91a1" (UID: "e1895ab2-d0f8-4477-b898-bb6e233c91a1"). InnerVolumeSpecName "kube-api-access-kh5kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:42:30.792462 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.792427    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-util" (OuterVolumeSpecName: "util") pod "e1895ab2-d0f8-4477-b898-bb6e233c91a1" (UID: "e1895ab2-d0f8-4477-b898-bb6e233c91a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:30.793275 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.793256    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-util" (OuterVolumeSpecName: "util") pod "df942e3b-7345-4a54-a141-f893f0583811" (UID: "df942e3b-7345-4a54-a141-f893f0583811"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:30.888300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.888205    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:30.888300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.888240    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltddc\" (UniqueName: \"kubernetes.io/projected/df942e3b-7345-4a54-a141-f893f0583811-kube-api-access-ltddc\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:30.888300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.888253    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:30.888300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.888263    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df942e3b-7345-4a54-a141-f893f0583811-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:30.888300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.888275    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh5kr\" (UniqueName: \"kubernetes.io/projected/e1895ab2-d0f8-4477-b898-bb6e233c91a1-kube-api-access-kh5kr\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:30.888300 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:30.888285    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1895ab2-d0f8-4477-b898-bb6e233c91a1-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:31.584898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.584863    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9"
Jul 02 21:42:31.584898 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.584888    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9" event={"ID":"df942e3b-7345-4a54-a141-f893f0583811","Type":"ContainerDied","Data":"5d7c9fa969c9cde807ab8df43a137cafe05b22b7b0d6ec949efdb4cd87c9e814"}
Jul 02 21:42:31.585453 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.584940    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d7c9fa969c9cde807ab8df43a137cafe05b22b7b0d6ec949efdb4cd87c9e814"
Jul 02 21:42:31.586895 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.586865    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4"
Jul 02 21:42:31.586895 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.586878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4" event={"ID":"e1895ab2-d0f8-4477-b898-bb6e233c91a1","Type":"ContainerDied","Data":"ed782d3effa754c836cb6253ed02193d6d8636999223ab8454df36b458f821b7"}
Jul 02 21:42:31.587095 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.586925    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed782d3effa754c836cb6253ed02193d6d8636999223ab8454df36b458f821b7"
Jul 02 21:42:31.589095 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.589075    2571 generic.go:356] "Generic (PLEG): container finished" podID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerID="488987dc289cedc5478d5f3d39a1755f2f3337d1ea89a2467d7a8caf9084d56e" exitCode=0
Jul 02 21:42:31.589254 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.589133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2" event={"ID":"b58cdfaa-bc61-4361-92a6-abe382e6468c","Type":"ContainerDied","Data":"488987dc289cedc5478d5f3d39a1755f2f3337d1ea89a2467d7a8caf9084d56e"}
Jul 02 21:42:31.733353 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.733329    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:31.796364 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.796328    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9r5k\" (UniqueName: \"kubernetes.io/projected/50b5b528-9141-4d5e-b6ee-c36472eb2360-kube-api-access-b9r5k\") pod \"50b5b528-9141-4d5e-b6ee-c36472eb2360\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") "
Jul 02 21:42:31.796556 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.796401    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-bundle\") pod \"50b5b528-9141-4d5e-b6ee-c36472eb2360\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") "
Jul 02 21:42:31.796556 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.796436    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-util\") pod \"50b5b528-9141-4d5e-b6ee-c36472eb2360\" (UID: \"50b5b528-9141-4d5e-b6ee-c36472eb2360\") "
Jul 02 21:42:31.797056 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.797034    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-bundle" (OuterVolumeSpecName: "bundle") pod "50b5b528-9141-4d5e-b6ee-c36472eb2360" (UID: "50b5b528-9141-4d5e-b6ee-c36472eb2360"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:31.798580 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.798556    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50b5b528-9141-4d5e-b6ee-c36472eb2360-kube-api-access-b9r5k" (OuterVolumeSpecName: "kube-api-access-b9r5k") pod "50b5b528-9141-4d5e-b6ee-c36472eb2360" (UID: "50b5b528-9141-4d5e-b6ee-c36472eb2360"). InnerVolumeSpecName "kube-api-access-b9r5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:42:31.801667 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.801633    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-util" (OuterVolumeSpecName: "util") pod "50b5b528-9141-4d5e-b6ee-c36472eb2360" (UID: "50b5b528-9141-4d5e-b6ee-c36472eb2360"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:31.898055 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.897972    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:31.898055 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.897998    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50b5b528-9141-4d5e-b6ee-c36472eb2360-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:31.898055 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:31.898007    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9r5k\" (UniqueName: \"kubernetes.io/projected/50b5b528-9141-4d5e-b6ee-c36472eb2360-kube-api-access-b9r5k\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:32.596090 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.596053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g" event={"ID":"50b5b528-9141-4d5e-b6ee-c36472eb2360","Type":"ContainerDied","Data":"cd2e4507abaf6dd04f64855dace065a8f6dba634b7fae110992cdbc8e0ae5828"}
Jul 02 21:42:32.596505 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.596100    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g"
Jul 02 21:42:32.596505 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.596106    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd2e4507abaf6dd04f64855dace065a8f6dba634b7fae110992cdbc8e0ae5828"
Jul 02 21:42:32.733364 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.733339    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:32.807760 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.807719    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-bundle\") pod \"b58cdfaa-bc61-4361-92a6-abe382e6468c\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") "
Jul 02 21:42:32.807973 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.807855    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82zvm\" (UniqueName: \"kubernetes.io/projected/b58cdfaa-bc61-4361-92a6-abe382e6468c-kube-api-access-82zvm\") pod \"b58cdfaa-bc61-4361-92a6-abe382e6468c\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") "
Jul 02 21:42:32.807973 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.807885    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-util\") pod \"b58cdfaa-bc61-4361-92a6-abe382e6468c\" (UID: \"b58cdfaa-bc61-4361-92a6-abe382e6468c\") "
Jul 02 21:42:32.809226 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.808954    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-bundle" (OuterVolumeSpecName: "bundle") pod "b58cdfaa-bc61-4361-92a6-abe382e6468c" (UID: "b58cdfaa-bc61-4361-92a6-abe382e6468c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:32.812249 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.811138    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58cdfaa-bc61-4361-92a6-abe382e6468c-kube-api-access-82zvm" (OuterVolumeSpecName: "kube-api-access-82zvm") pod "b58cdfaa-bc61-4361-92a6-abe382e6468c" (UID: "b58cdfaa-bc61-4361-92a6-abe382e6468c"). InnerVolumeSpecName "kube-api-access-82zvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:42:32.818917 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.818867    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-util" (OuterVolumeSpecName: "util") pod "b58cdfaa-bc61-4361-92a6-abe382e6468c" (UID: "b58cdfaa-bc61-4361-92a6-abe382e6468c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:42:32.909318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.909233    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:32.909318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.909266    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82zvm\" (UniqueName: \"kubernetes.io/projected/b58cdfaa-bc61-4361-92a6-abe382e6468c-kube-api-access-82zvm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:32.909318 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:32.909277    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58cdfaa-bc61-4361-92a6-abe382e6468c-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:42:33.604067 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:33.604028    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2" event={"ID":"b58cdfaa-bc61-4361-92a6-abe382e6468c","Type":"ContainerDied","Data":"9d73f0570c7c0f5036fbf03cdaac3f23975ed385f37a839f459617bb2a9c08bf"}
Jul 02 21:42:33.604067 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:33.604068    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2"
Jul 02 21:42:33.604513 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:33.604123    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d73f0570c7c0f5036fbf03cdaac3f23975ed385f37a839f459617bb2a9c08bf"
Jul 02 21:42:41.418575 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.418540    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c8ff597b7-qbbhv"]
Jul 02 21:42:41.419115 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419093    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="extract"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419119    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="extract"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419132    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="util"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419142    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="util"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419171    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="pull"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419179    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="pull"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419190    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="extract"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419198    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="extract"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419212    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="util"
Jul 02 21:42:41.419219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419220    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="util"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419234    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419242    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419256    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="util"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419264    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="util"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419273    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="pull"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419281    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="pull"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419293    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="pull"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419301    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="pull"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419310    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="pull"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419326    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="pull"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419340    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="util"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419348    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="util"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419363    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419371    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419476    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="df942e3b-7345-4a54-a141-f893f0583811" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419487    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58cdfaa-bc61-4361-92a6-abe382e6468c" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419498    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="50b5b528-9141-4d5e-b6ee-c36472eb2360" containerName="extract"
Jul 02 21:42:41.419644 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.419508    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1895ab2-d0f8-4477-b898-bb6e233c91a1" containerName="extract"
Jul 02 21:42:41.421925 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.421906    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.439563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.439533    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8ff597b7-qbbhv"]
Jul 02 21:42:41.486403 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486370    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf7691-61f1-4909-82ce-07c39b6bf054-console-serving-cert\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.486687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-service-ca\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.486687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-oauth-serving-cert\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.486687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf7691-61f1-4909-82ce-07c39b6bf054-console-oauth-config\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.486687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-console-config\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.486687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq48c\" (UniqueName: \"kubernetes.io/projected/5daf7691-61f1-4909-82ce-07c39b6bf054-kube-api-access-xq48c\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.486687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.486646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-trusted-ca-bundle\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587142 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf7691-61f1-4909-82ce-07c39b6bf054-console-oauth-config\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587142 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-console-config\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587457 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq48c\" (UniqueName: \"kubernetes.io/projected/5daf7691-61f1-4909-82ce-07c39b6bf054-kube-api-access-xq48c\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587457 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-trusted-ca-bundle\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587457 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf7691-61f1-4909-82ce-07c39b6bf054-console-serving-cert\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587457 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-service-ca\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587457 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-oauth-serving-cert\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.587939 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.587909    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-console-config\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.588112 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.588067    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-oauth-serving-cert\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.588112 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.588064    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-trusted-ca-bundle\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.588277 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.588183    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daf7691-61f1-4909-82ce-07c39b6bf054-service-ca\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.590364 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.590342    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daf7691-61f1-4909-82ce-07c39b6bf054-console-serving-cert\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.590475 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.590346    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daf7691-61f1-4909-82ce-07c39b6bf054-console-oauth-config\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.596369 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.596345    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq48c\" (UniqueName: \"kubernetes.io/projected/5daf7691-61f1-4909-82ce-07c39b6bf054-kube-api-access-xq48c\") pod \"console-6c8ff597b7-qbbhv\" (UID: \"5daf7691-61f1-4909-82ce-07c39b6bf054\") " pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.732861 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.732771    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:41.872677 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:41.872650    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c8ff597b7-qbbhv"]
Jul 02 21:42:41.874408 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:42:41.874381    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daf7691_61f1_4909_82ce_07c39b6bf054.slice/crio-6604605b4995a443b1eb88b6700730686f67dfc6a9b1070d12f16a8ceeb8eb67 WatchSource:0}: Error finding container 6604605b4995a443b1eb88b6700730686f67dfc6a9b1070d12f16a8ceeb8eb67: Status 404 returned error can't find the container with id 6604605b4995a443b1eb88b6700730686f67dfc6a9b1070d12f16a8ceeb8eb67
Jul 02 21:42:42.659424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:42.659387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8ff597b7-qbbhv" event={"ID":"5daf7691-61f1-4909-82ce-07c39b6bf054","Type":"ContainerStarted","Data":"1b11ef8d1979cee6f8669a34a3dbe3ef25b719846c36ea04e919db73371b7c3e"}
Jul 02 21:42:42.659810 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:42.659436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c8ff597b7-qbbhv" event={"ID":"5daf7691-61f1-4909-82ce-07c39b6bf054","Type":"ContainerStarted","Data":"6604605b4995a443b1eb88b6700730686f67dfc6a9b1070d12f16a8ceeb8eb67"}
Jul 02 21:42:42.679696 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:42.679636    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c8ff597b7-qbbhv" podStartSLOduration=1.679615324 podStartE2EDuration="1.679615324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:42:42.67651742 +0000 UTC m=+401.674437476" watchObservedRunningTime="2026-07-02 21:42:42.679615324 +0000 UTC m=+401.677535381"
Jul 02 21:42:51.733129 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:51.733090    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:51.733555 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:51.733180    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:51.738548 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:51.738522    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:52.712886 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:52.712852    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c8ff597b7-qbbhv"
Jul 02 21:42:52.762097 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:52.762062    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5f9d65dc-vz8b2"]
Jul 02 21:42:59.341572 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.341534    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"]
Jul 02 21:42:59.344899 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.344879    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.347531 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.347508    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 21:42:59.347659 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.347632    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zzx2n\""
Jul 02 21:42:59.347659 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.347637    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 21:42:59.348428 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.348412    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 21:42:59.348493 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.348411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 21:42:59.351593 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.351571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"]
Jul 02 21:42:59.356028 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.356003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2wss\" (UniqueName: \"kubernetes.io/projected/849d00b2-4b44-4392-8b24-8da5c3555cd4-kube-api-access-g2wss\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.356172 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.356082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/849d00b2-4b44-4392-8b24-8da5c3555cd4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.356254 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.356195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/849d00b2-4b44-4392-8b24-8da5c3555cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.457149 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.457108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/849d00b2-4b44-4392-8b24-8da5c3555cd4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.457382 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.457215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/849d00b2-4b44-4392-8b24-8da5c3555cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.457382 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.457263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2wss\" (UniqueName: \"kubernetes.io/projected/849d00b2-4b44-4392-8b24-8da5c3555cd4-kube-api-access-g2wss\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.457855 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.457833    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/849d00b2-4b44-4392-8b24-8da5c3555cd4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.459784 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.459763    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/849d00b2-4b44-4392-8b24-8da5c3555cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.483340 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.483316    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2wss\" (UniqueName: \"kubernetes.io/projected/849d00b2-4b44-4392-8b24-8da5c3555cd4-kube-api-access-g2wss\") pod \"kuadrant-console-plugin-66b5774985-qfvp8\" (UID: \"849d00b2-4b44-4392-8b24-8da5c3555cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.656785 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.656697    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"
Jul 02 21:42:59.799695 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:42:59.799632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8"]
Jul 02 21:42:59.802042 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:42:59.802015    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod849d00b2_4b44_4392_8b24_8da5c3555cd4.slice/crio-6f3dc6e02cf7abffb78444e9ca8f27676ecf7b7fe498ba5cbc22b4d2894a5082 WatchSource:0}: Error finding container 6f3dc6e02cf7abffb78444e9ca8f27676ecf7b7fe498ba5cbc22b4d2894a5082: Status 404 returned error can't find the container with id 6f3dc6e02cf7abffb78444e9ca8f27676ecf7b7fe498ba5cbc22b4d2894a5082
Jul 02 21:43:00.757315 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:00.757274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8" event={"ID":"849d00b2-4b44-4392-8b24-8da5c3555cd4","Type":"ContainerStarted","Data":"6f3dc6e02cf7abffb78444e9ca8f27676ecf7b7fe498ba5cbc22b4d2894a5082"}
Jul 02 21:43:17.786006 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:17.785955    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c5f9d65dc-vz8b2" podUID="26fa9149-ab92-4829-996b-eb94c78d545c" containerName="console" containerID="cri-o://4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe" gracePeriod=15
Jul 02 21:43:23.114219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.114185    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:43:23.189608 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189577    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-service-ca\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.189805 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-oauth-serving-cert\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.189805 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189658    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-console-config\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.189805 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189683    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fr58\" (UniqueName: \"kubernetes.io/projected/26fa9149-ab92-4829-996b-eb94c78d545c-kube-api-access-7fr58\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.189805 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189721    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-oauth-config\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.189805 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189786    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-serving-cert\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.190090 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.189820    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-trusted-ca-bundle\") pod \"26fa9149-ab92-4829-996b-eb94c78d545c\" (UID: \"26fa9149-ab92-4829-996b-eb94c78d545c\") "
Jul 02 21:43:23.190090 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.190047    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-service-ca" (OuterVolumeSpecName: "service-ca") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:43:23.190574 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.190055    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-console-config" (OuterVolumeSpecName: "console-config") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:43:23.190574 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.190455    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:43:23.190574 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.190547    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:43:23.192119 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.192059    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fa9149-ab92-4829-996b-eb94c78d545c-kube-api-access-7fr58" (OuterVolumeSpecName: "kube-api-access-7fr58") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "kube-api-access-7fr58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:43:23.192467 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.192443    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:43:23.192530 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.192512    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26fa9149-ab92-4829-996b-eb94c78d545c" (UID: "26fa9149-ab92-4829-996b-eb94c78d545c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:43:23.290807 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290767    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.290807 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290800    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.290807 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290810    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.291139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290819    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.291139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290841    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa9149-ab92-4829-996b-eb94c78d545c-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.291139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290849    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fr58\" (UniqueName: \"kubernetes.io/projected/26fa9149-ab92-4829-996b-eb94c78d545c-kube-api-access-7fr58\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.291139 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.290857    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa9149-ab92-4829-996b-eb94c78d545c-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:43:23.905737 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.905634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8" event={"ID":"849d00b2-4b44-4392-8b24-8da5c3555cd4","Type":"ContainerStarted","Data":"8984efadf21eb6c3da3624fcda78cf40cc8172253978ef05e4109a4f7d79a5e4"}
Jul 02 21:43:23.906908 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.906882    2571 generic.go:356] "Generic (PLEG): container finished" podID="26fa9149-ab92-4829-996b-eb94c78d545c" containerID="4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe" exitCode=0
Jul 02 21:43:23.906992 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.906918    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5f9d65dc-vz8b2"
Jul 02 21:43:23.906992 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.906959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5f9d65dc-vz8b2" event={"ID":"26fa9149-ab92-4829-996b-eb94c78d545c","Type":"ContainerDied","Data":"4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe"}
Jul 02 21:43:23.907063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.907007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5f9d65dc-vz8b2" event={"ID":"26fa9149-ab92-4829-996b-eb94c78d545c","Type":"ContainerDied","Data":"64d6d4741ce046e9b4a14450fa5b7a6d34abf4fa683c3ea0a2753a980d27a08a"}
Jul 02 21:43:23.907063 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.907027    2571 scope.go:117] "RemoveContainer" containerID="4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe"
Jul 02 21:43:23.915757 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.915730    2571 scope.go:117] "RemoveContainer" containerID="4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe"
Jul 02 21:43:23.916022 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:43:23.916003    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe\": container with ID starting with 4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe not found: ID does not exist" containerID="4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe"
Jul 02 21:43:23.916065 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.916032    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe"} err="failed to get container status \"4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe\": rpc error: code = NotFound desc = could not find container \"4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe\": container with ID starting with 4af50cc9efff4dff0fa3c516fff59dcc924185b445fc26374073d89b18dc3bfe not found: ID does not exist"
Jul 02 21:43:23.946095 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.946041    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qfvp8" podStartSLOduration=1.44414994 podStartE2EDuration="24.94602512s" totalImagesPullingTime="23.50187518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:43:23.943851621 +0000 UTC m=+442.941771676" watchObservedRunningTime="2026-07-02 21:43:23.94602512 +0000 UTC m=+442.943945175"
Jul 02 21:43:23.982479 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.982448    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5f9d65dc-vz8b2"]
Jul 02 21:43:23.995001 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:23.994971    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c5f9d65dc-vz8b2"]
Jul 02 21:43:25.612177 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:25.612123    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26fa9149-ab92-4829-996b-eb94c78d545c" path="/var/lib/kubelet/pods/26fa9149-ab92-4829-996b-eb94c78d545c/volumes"
Jul 02 21:43:50.895290 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.895251    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:43:50.895754 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.895594    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fa9149-ab92-4829-996b-eb94c78d545c" containerName="console"
Jul 02 21:43:50.895754 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.895604    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fa9149-ab92-4829-996b-eb94c78d545c" containerName="console"
Jul 02 21:43:50.895754 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.895677    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fa9149-ab92-4829-996b-eb94c78d545c" containerName="console"
Jul 02 21:43:50.904271 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.904245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:50.906859 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.906836    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 21:43:50.907076 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.907056    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:43:50.936652 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.936620    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b962e0df-79de-448a-857d-dfd974d19a38-config-file\") pod \"limitador-limitador-64c94fd64f-t8szm\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:50.936806 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.936671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4v5g\" (UniqueName: \"kubernetes.io/projected/b962e0df-79de-448a-857d-dfd974d19a38-kube-api-access-x4v5g\") pod \"limitador-limitador-64c94fd64f-t8szm\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:50.988700 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:50.988665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:43:51.037424 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.037383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b962e0df-79de-448a-857d-dfd974d19a38-config-file\") pod \"limitador-limitador-64c94fd64f-t8szm\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:51.037596 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.037437    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4v5g\" (UniqueName: \"kubernetes.io/projected/b962e0df-79de-448a-857d-dfd974d19a38-kube-api-access-x4v5g\") pod \"limitador-limitador-64c94fd64f-t8szm\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:51.038030 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.038010    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b962e0df-79de-448a-857d-dfd974d19a38-config-file\") pod \"limitador-limitador-64c94fd64f-t8szm\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:51.048150 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.048115    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4v5g\" (UniqueName: \"kubernetes.io/projected/b962e0df-79de-448a-857d-dfd974d19a38-kube-api-access-x4v5g\") pod \"limitador-limitador-64c94fd64f-t8szm\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:51.216872 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.216795    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:51.389920 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.389891    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:43:51.391352 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:43:51.391323    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb962e0df_79de_448a_857d_dfd974d19a38.slice/crio-348208a59c30e80ad1e93f890c1ee67ca11624be6791d6e83fe2a3529d467c6e WatchSource:0}: Error finding container 348208a59c30e80ad1e93f890c1ee67ca11624be6791d6e83fe2a3529d467c6e: Status 404 returned error can't find the container with id 348208a59c30e80ad1e93f890c1ee67ca11624be6791d6e83fe2a3529d467c6e
Jul 02 21:43:51.877806 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.877764    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-thrqf"]
Jul 02 21:43:51.944907 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.944866    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thrqf"]
Jul 02 21:43:51.945355 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.944962    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:43:51.947549 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:51.947519    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gbfcb\""
Jul 02 21:43:52.049149 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:52.049111    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6x7r\" (UniqueName: \"kubernetes.io/projected/afa69364-3173-4fe1-a438-fdf7b637151e-kube-api-access-t6x7r\") pod \"authorino-75d556bd77-thrqf\" (UID: \"afa69364-3173-4fe1-a438-fdf7b637151e\") " pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:43:52.063570 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:52.063530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm" event={"ID":"b962e0df-79de-448a-857d-dfd974d19a38","Type":"ContainerStarted","Data":"348208a59c30e80ad1e93f890c1ee67ca11624be6791d6e83fe2a3529d467c6e"}
Jul 02 21:43:52.150730 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:52.150644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6x7r\" (UniqueName: \"kubernetes.io/projected/afa69364-3173-4fe1-a438-fdf7b637151e-kube-api-access-t6x7r\") pod \"authorino-75d556bd77-thrqf\" (UID: \"afa69364-3173-4fe1-a438-fdf7b637151e\") " pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:43:52.159774 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:52.159746    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6x7r\" (UniqueName: \"kubernetes.io/projected/afa69364-3173-4fe1-a438-fdf7b637151e-kube-api-access-t6x7r\") pod \"authorino-75d556bd77-thrqf\" (UID: \"afa69364-3173-4fe1-a438-fdf7b637151e\") " pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:43:52.255749 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:52.255713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:43:52.481295 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:52.481268    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thrqf"]
Jul 02 21:43:52.482738 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:43:52.482707    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafa69364_3173_4fe1_a438_fdf7b637151e.slice/crio-361ffa31a39ba1a5ae765b6a74b0a8714b7d2cde8a60f64be610daf4f0459036 WatchSource:0}: Error finding container 361ffa31a39ba1a5ae765b6a74b0a8714b7d2cde8a60f64be610daf4f0459036: Status 404 returned error can't find the container with id 361ffa31a39ba1a5ae765b6a74b0a8714b7d2cde8a60f64be610daf4f0459036
Jul 02 21:43:53.073137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:53.073090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thrqf" event={"ID":"afa69364-3173-4fe1-a438-fdf7b637151e","Type":"ContainerStarted","Data":"361ffa31a39ba1a5ae765b6a74b0a8714b7d2cde8a60f64be610daf4f0459036"}
Jul 02 21:43:57.104487 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:57.104445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thrqf" event={"ID":"afa69364-3173-4fe1-a438-fdf7b637151e","Type":"ContainerStarted","Data":"8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5"}
Jul 02 21:43:57.106102 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:57.106070    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm" event={"ID":"b962e0df-79de-448a-857d-dfd974d19a38","Type":"ContainerStarted","Data":"37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0"}
Jul 02 21:43:57.106222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:57.106144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:43:57.121992 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:57.121937    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-thrqf" podStartSLOduration=2.412560708 podStartE2EDuration="6.121922112s" totalImagesPullingTime="3.709361404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:43:57.119846788 +0000 UTC m=+476.117766841" watchObservedRunningTime="2026-07-02 21:43:57.121922112 +0000 UTC m=+476.119842199"
Jul 02 21:43:57.137215 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:43:57.137129    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm" podStartSLOduration=2.343178095 podStartE2EDuration="7.137106734s" totalImagesPullingTime="4.793928639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:43:57.135690284 +0000 UTC m=+476.133610344" watchObservedRunningTime="2026-07-02 21:43:57.137106734 +0000 UTC m=+476.135026790"
Jul 02 21:44:05.559324 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:05.559281    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:44:05.559768 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:05.559468    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm" podUID="b962e0df-79de-448a-857d-dfd974d19a38" containerName="limitador" containerID="cri-o://37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0" gracePeriod=30
Jul 02 21:44:05.560257 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:05.560240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:44:06.106022 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.105997    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:44:06.155287 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.155179    2571 generic.go:356] "Generic (PLEG): container finished" podID="b962e0df-79de-448a-857d-dfd974d19a38" containerID="37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0" exitCode=0
Jul 02 21:44:06.155287 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.155220    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm"
Jul 02 21:44:06.155287 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.155258    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm" event={"ID":"b962e0df-79de-448a-857d-dfd974d19a38","Type":"ContainerDied","Data":"37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0"}
Jul 02 21:44:06.155570 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.155317    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t8szm" event={"ID":"b962e0df-79de-448a-857d-dfd974d19a38","Type":"ContainerDied","Data":"348208a59c30e80ad1e93f890c1ee67ca11624be6791d6e83fe2a3529d467c6e"}
Jul 02 21:44:06.155570 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.155356    2571 scope.go:117] "RemoveContainer" containerID="37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0"
Jul 02 21:44:06.164310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.164288    2571 scope.go:117] "RemoveContainer" containerID="37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0"
Jul 02 21:44:06.164624 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:44:06.164600    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0\": container with ID starting with 37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0 not found: ID does not exist" containerID="37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0"
Jul 02 21:44:06.164698 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.164634    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0"} err="failed to get container status \"37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0\": rpc error: code = NotFound desc = could not find container \"37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0\": container with ID starting with 37784df05a1993a1866b898a421421a7ef9718d99184f0059aee478e4bd445e0 not found: ID does not exist"
Jul 02 21:44:06.190896 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.190866    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b962e0df-79de-448a-857d-dfd974d19a38-config-file\") pod \"b962e0df-79de-448a-857d-dfd974d19a38\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") "
Jul 02 21:44:06.191078 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.190981    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4v5g\" (UniqueName: \"kubernetes.io/projected/b962e0df-79de-448a-857d-dfd974d19a38-kube-api-access-x4v5g\") pod \"b962e0df-79de-448a-857d-dfd974d19a38\" (UID: \"b962e0df-79de-448a-857d-dfd974d19a38\") "
Jul 02 21:44:06.191310 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.191278    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b962e0df-79de-448a-857d-dfd974d19a38-config-file" (OuterVolumeSpecName: "config-file") pod "b962e0df-79de-448a-857d-dfd974d19a38" (UID: "b962e0df-79de-448a-857d-dfd974d19a38"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:44:06.193048 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.193027    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b962e0df-79de-448a-857d-dfd974d19a38-kube-api-access-x4v5g" (OuterVolumeSpecName: "kube-api-access-x4v5g") pod "b962e0df-79de-448a-857d-dfd974d19a38" (UID: "b962e0df-79de-448a-857d-dfd974d19a38"). InnerVolumeSpecName "kube-api-access-x4v5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:44:06.291822 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.291779    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b962e0df-79de-448a-857d-dfd974d19a38-config-file\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:44:06.291822 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.291813    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4v5g\" (UniqueName: \"kubernetes.io/projected/b962e0df-79de-448a-857d-dfd974d19a38-kube-api-access-x4v5g\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:44:06.475745 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.475718    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:44:06.479651 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:06.479624    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t8szm"]
Jul 02 21:44:07.616315 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:07.616278    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b962e0df-79de-448a-857d-dfd974d19a38" path="/var/lib/kubelet/pods/b962e0df-79de-448a-857d-dfd974d19a38/volumes"
Jul 02 21:44:52.109079 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.108992    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lf72k"]
Jul 02 21:44:52.109552 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.109373    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b962e0df-79de-448a-857d-dfd974d19a38" containerName="limitador"
Jul 02 21:44:52.109552 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.109385    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b962e0df-79de-448a-857d-dfd974d19a38" containerName="limitador"
Jul 02 21:44:52.109552 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.109441    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b962e0df-79de-448a-857d-dfd974d19a38" containerName="limitador"
Jul 02 21:44:52.116538 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.116509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:52.118886 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.118859    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lf72k"]
Jul 02 21:44:52.224413 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.224378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npptp\" (UniqueName: \"kubernetes.io/projected/9cb804c7-12ef-4fa2-ad30-b0341c293669-kube-api-access-npptp\") pod \"authorino-5d4b67c446-lf72k\" (UID: \"9cb804c7-12ef-4fa2-ad30-b0341c293669\") " pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:52.325500 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.325465    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npptp\" (UniqueName: \"kubernetes.io/projected/9cb804c7-12ef-4fa2-ad30-b0341c293669-kube-api-access-npptp\") pod \"authorino-5d4b67c446-lf72k\" (UID: \"9cb804c7-12ef-4fa2-ad30-b0341c293669\") " pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:52.333617 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.333589    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npptp\" (UniqueName: \"kubernetes.io/projected/9cb804c7-12ef-4fa2-ad30-b0341c293669-kube-api-access-npptp\") pod \"authorino-5d4b67c446-lf72k\" (UID: \"9cb804c7-12ef-4fa2-ad30-b0341c293669\") " pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:52.343643 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.343612    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lf72k"]
Jul 02 21:44:52.343893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.343881    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:52.368365 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.368284    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d94c74f4d-75b4r"]
Jul 02 21:44:52.372186 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.372164    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:52.379990 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.379963    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d94c74f4d-75b4r"]
Jul 02 21:44:52.464219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.464181    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d94c74f4d-75b4r"]
Jul 02 21:44:52.464494 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:44:52.464472    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n48vx], unattached volumes=[], failed to process volumes=[kube-api-access-n48vx]: context canceled" pod="kuadrant-system/authorino-7d94c74f4d-75b4r" podUID="1990fe8d-4a17-4eb7-b2b8-9d308d509236"
Jul 02 21:44:52.490207 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.490052    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-859789cd64-dlrn8"]
Jul 02 21:44:52.494112 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.494091    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lf72k"]
Jul 02 21:44:52.494223 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.494190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.495434 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:44:52.495383    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cb804c7_12ef_4fa2_ad30_b0341c293669.slice/crio-3aaf06b0006d77e16374a6977d7a031468802af6f9cfb9a4d5a0b59e92167370 WatchSource:0}: Error finding container 3aaf06b0006d77e16374a6977d7a031468802af6f9cfb9a4d5a0b59e92167370: Status 404 returned error can't find the container with id 3aaf06b0006d77e16374a6977d7a031468802af6f9cfb9a4d5a0b59e92167370
Jul 02 21:44:52.496586 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.496564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 21:44:52.501763 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.501740    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-859789cd64-dlrn8"]
Jul 02 21:44:52.527451 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.527418    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n48vx\" (UniqueName: \"kubernetes.io/projected/1990fe8d-4a17-4eb7-b2b8-9d308d509236-kube-api-access-n48vx\") pod \"authorino-7d94c74f4d-75b4r\" (UID: \"1990fe8d-4a17-4eb7-b2b8-9d308d509236\") " pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:52.628891 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.628800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rffst\" (UniqueName: \"kubernetes.io/projected/f4991ac9-8355-40a1-885f-4afc3676a3b7-kube-api-access-rffst\") pod \"authorino-859789cd64-dlrn8\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") " pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.629051 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.628893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n48vx\" (UniqueName: \"kubernetes.io/projected/1990fe8d-4a17-4eb7-b2b8-9d308d509236-kube-api-access-n48vx\") pod \"authorino-7d94c74f4d-75b4r\" (UID: \"1990fe8d-4a17-4eb7-b2b8-9d308d509236\") " pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:52.629051 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.628913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4991ac9-8355-40a1-885f-4afc3676a3b7-tls-cert\") pod \"authorino-859789cd64-dlrn8\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") " pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.636932 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.636893    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n48vx\" (UniqueName: \"kubernetes.io/projected/1990fe8d-4a17-4eb7-b2b8-9d308d509236-kube-api-access-n48vx\") pod \"authorino-7d94c74f4d-75b4r\" (UID: \"1990fe8d-4a17-4eb7-b2b8-9d308d509236\") " pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:52.729569 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.729530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4991ac9-8355-40a1-885f-4afc3676a3b7-tls-cert\") pod \"authorino-859789cd64-dlrn8\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") " pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.729748 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.729592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffst\" (UniqueName: \"kubernetes.io/projected/f4991ac9-8355-40a1-885f-4afc3676a3b7-kube-api-access-rffst\") pod \"authorino-859789cd64-dlrn8\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") " pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.732014 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.731988    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4991ac9-8355-40a1-885f-4afc3676a3b7-tls-cert\") pod \"authorino-859789cd64-dlrn8\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") " pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.737879 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.737854    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rffst\" (UniqueName: \"kubernetes.io/projected/f4991ac9-8355-40a1-885f-4afc3676a3b7-kube-api-access-rffst\") pod \"authorino-859789cd64-dlrn8\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") " pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.820540 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.820502    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:44:52.953941 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:52.953917    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-859789cd64-dlrn8"]
Jul 02 21:44:52.956004 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:44:52.955969    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4991ac9_8355_40a1_885f_4afc3676a3b7.slice/crio-7200df58225ae65b8208bcc1a7d0f3cbd6f33ba7b3b8a52b42c9f9962d23fb84 WatchSource:0}: Error finding container 7200df58225ae65b8208bcc1a7d0f3cbd6f33ba7b3b8a52b42c9f9962d23fb84: Status 404 returned error can't find the container with id 7200df58225ae65b8208bcc1a7d0f3cbd6f33ba7b3b8a52b42c9f9962d23fb84
Jul 02 21:44:53.402966 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.402923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lf72k" event={"ID":"9cb804c7-12ef-4fa2-ad30-b0341c293669","Type":"ContainerStarted","Data":"cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1"}
Jul 02 21:44:53.403385 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.402981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lf72k" event={"ID":"9cb804c7-12ef-4fa2-ad30-b0341c293669","Type":"ContainerStarted","Data":"3aaf06b0006d77e16374a6977d7a031468802af6f9cfb9a4d5a0b59e92167370"}
Jul 02 21:44:53.403385 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.403004    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-lf72k" podUID="9cb804c7-12ef-4fa2-ad30-b0341c293669" containerName="authorino" containerID="cri-o://cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1" gracePeriod=30
Jul 02 21:44:53.404208 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.404182    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-859789cd64-dlrn8" event={"ID":"f4991ac9-8355-40a1-885f-4afc3676a3b7","Type":"ContainerStarted","Data":"7200df58225ae65b8208bcc1a7d0f3cbd6f33ba7b3b8a52b42c9f9962d23fb84"}
Jul 02 21:44:53.404340 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.404312    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:53.419665 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.419607    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-lf72k" podStartSLOduration=0.912986774 podStartE2EDuration="1.419585309s" totalImagesPullingTime="506.598535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:53.417244433 +0000 UTC m=+532.415164488" watchObservedRunningTime="2026-07-02 21:44:53.419585309 +0000 UTC m=+532.417505366"
Jul 02 21:44:53.477359 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.477332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:53.637992 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.637904    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n48vx\" (UniqueName: \"kubernetes.io/projected/1990fe8d-4a17-4eb7-b2b8-9d308d509236-kube-api-access-n48vx\") pod \"1990fe8d-4a17-4eb7-b2b8-9d308d509236\" (UID: \"1990fe8d-4a17-4eb7-b2b8-9d308d509236\") "
Jul 02 21:44:53.640104 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.640069    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1990fe8d-4a17-4eb7-b2b8-9d308d509236-kube-api-access-n48vx" (OuterVolumeSpecName: "kube-api-access-n48vx") pod "1990fe8d-4a17-4eb7-b2b8-9d308d509236" (UID: "1990fe8d-4a17-4eb7-b2b8-9d308d509236"). InnerVolumeSpecName "kube-api-access-n48vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:44:53.652992 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.652967    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:53.739489 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.739450    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npptp\" (UniqueName: \"kubernetes.io/projected/9cb804c7-12ef-4fa2-ad30-b0341c293669-kube-api-access-npptp\") pod \"9cb804c7-12ef-4fa2-ad30-b0341c293669\" (UID: \"9cb804c7-12ef-4fa2-ad30-b0341c293669\") "
Jul 02 21:44:53.739660 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.739616    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n48vx\" (UniqueName: \"kubernetes.io/projected/1990fe8d-4a17-4eb7-b2b8-9d308d509236-kube-api-access-n48vx\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:44:53.741634 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.741605    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb804c7-12ef-4fa2-ad30-b0341c293669-kube-api-access-npptp" (OuterVolumeSpecName: "kube-api-access-npptp") pod "9cb804c7-12ef-4fa2-ad30-b0341c293669" (UID: "9cb804c7-12ef-4fa2-ad30-b0341c293669"). InnerVolumeSpecName "kube-api-access-npptp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:44:53.840540 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:53.840486    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npptp\" (UniqueName: \"kubernetes.io/projected/9cb804c7-12ef-4fa2-ad30-b0341c293669-kube-api-access-npptp\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:44:54.410913 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.410875    2571 generic.go:356] "Generic (PLEG): container finished" podID="9cb804c7-12ef-4fa2-ad30-b0341c293669" containerID="cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1" exitCode=0
Jul 02 21:44:54.410913 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.410917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lf72k"
Jul 02 21:44:54.411439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.410966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lf72k" event={"ID":"9cb804c7-12ef-4fa2-ad30-b0341c293669","Type":"ContainerDied","Data":"cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1"}
Jul 02 21:44:54.411439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.411008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lf72k" event={"ID":"9cb804c7-12ef-4fa2-ad30-b0341c293669","Type":"ContainerDied","Data":"3aaf06b0006d77e16374a6977d7a031468802af6f9cfb9a4d5a0b59e92167370"}
Jul 02 21:44:54.411439 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.411031    2571 scope.go:117] "RemoveContainer" containerID="cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1"
Jul 02 21:44:54.412563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.412538    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-859789cd64-dlrn8" event={"ID":"f4991ac9-8355-40a1-885f-4afc3676a3b7","Type":"ContainerStarted","Data":"b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40"}
Jul 02 21:44:54.412563 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.412554    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d94c74f4d-75b4r"
Jul 02 21:44:54.422248 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.422232    2571 scope.go:117] "RemoveContainer" containerID="cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1"
Jul 02 21:44:54.422535 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:44:54.422520    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1\": container with ID starting with cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1 not found: ID does not exist" containerID="cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1"
Jul 02 21:44:54.422589 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.422545    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1"} err="failed to get container status \"cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1\": rpc error: code = NotFound desc = could not find container \"cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1\": container with ID starting with cb44b22dafd32c1f9f8712593df307563aa989752e8f2525827436227dd50bc1 not found: ID does not exist"
Jul 02 21:44:54.429816 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.429776    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-859789cd64-dlrn8" podStartSLOduration=2.006158226 podStartE2EDuration="2.429761082s" totalImagesPullingTime="423.602856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:54.428728269 +0000 UTC m=+533.426648327" watchObservedRunningTime="2026-07-02 21:44:54.429761082 +0000 UTC m=+533.427681136"
Jul 02 21:44:54.453795 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.453758    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thrqf"]
Jul 02 21:44:54.453996 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.453966    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-thrqf" podUID="afa69364-3173-4fe1-a438-fdf7b637151e" containerName="authorino" containerID="cri-o://8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5" gracePeriod=30
Jul 02 21:44:54.459531 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.459505    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d94c74f4d-75b4r"]
Jul 02 21:44:54.465990 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.465964    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d94c74f4d-75b4r"]
Jul 02 21:44:54.479655 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.479626    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lf72k"]
Jul 02 21:44:54.483173 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.483134    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lf72k"]
Jul 02 21:44:54.710608 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.710586    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:44:54.851594 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.851559    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6x7r\" (UniqueName: \"kubernetes.io/projected/afa69364-3173-4fe1-a438-fdf7b637151e-kube-api-access-t6x7r\") pod \"afa69364-3173-4fe1-a438-fdf7b637151e\" (UID: \"afa69364-3173-4fe1-a438-fdf7b637151e\") "
Jul 02 21:44:54.853646 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.853611    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa69364-3173-4fe1-a438-fdf7b637151e-kube-api-access-t6x7r" (OuterVolumeSpecName: "kube-api-access-t6x7r") pod "afa69364-3173-4fe1-a438-fdf7b637151e" (UID: "afa69364-3173-4fe1-a438-fdf7b637151e"). InnerVolumeSpecName "kube-api-access-t6x7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:44:54.952490 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:54.952398    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6x7r\" (UniqueName: \"kubernetes.io/projected/afa69364-3173-4fe1-a438-fdf7b637151e-kube-api-access-t6x7r\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:44:55.419048 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.419012    2571 generic.go:356] "Generic (PLEG): container finished" podID="afa69364-3173-4fe1-a438-fdf7b637151e" containerID="8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5" exitCode=0
Jul 02 21:44:55.419530 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.419058    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thrqf"
Jul 02 21:44:55.419530 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.419115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thrqf" event={"ID":"afa69364-3173-4fe1-a438-fdf7b637151e","Type":"ContainerDied","Data":"8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5"}
Jul 02 21:44:55.419530 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.419184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thrqf" event={"ID":"afa69364-3173-4fe1-a438-fdf7b637151e","Type":"ContainerDied","Data":"361ffa31a39ba1a5ae765b6a74b0a8714b7d2cde8a60f64be610daf4f0459036"}
Jul 02 21:44:55.419530 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.419210    2571 scope.go:117] "RemoveContainer" containerID="8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5"
Jul 02 21:44:55.432022 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.432002    2571 scope.go:117] "RemoveContainer" containerID="8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5"
Jul 02 21:44:55.432355 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:44:55.432335    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5\": container with ID starting with 8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5 not found: ID does not exist" containerID="8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5"
Jul 02 21:44:55.432517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.432362    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5"} err="failed to get container status \"8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5\": rpc error: code = NotFound desc = could not find container \"8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5\": container with ID starting with 8055231b478df93bd0109642f19955a1f26ad7275bae084d54d1f9e02091a2d5 not found: ID does not exist"
Jul 02 21:44:55.443250 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.443222    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thrqf"]
Jul 02 21:44:55.447035 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.447013    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thrqf"]
Jul 02 21:44:55.617445 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.617411    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1990fe8d-4a17-4eb7-b2b8-9d308d509236" path="/var/lib/kubelet/pods/1990fe8d-4a17-4eb7-b2b8-9d308d509236/volumes"
Jul 02 21:44:55.617651 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.617640    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb804c7-12ef-4fa2-ad30-b0341c293669" path="/var/lib/kubelet/pods/9cb804c7-12ef-4fa2-ad30-b0341c293669/volumes"
Jul 02 21:44:55.617931 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:55.617919    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa69364-3173-4fe1-a438-fdf7b637151e" path="/var/lib/kubelet/pods/afa69364-3173-4fe1-a438-fdf7b637151e/volumes"
Jul 02 21:44:58.781953 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.781916    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77ff56c968-dnmtt"]
Jul 02 21:44:58.782583 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.782327    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb804c7-12ef-4fa2-ad30-b0341c293669" containerName="authorino"
Jul 02 21:44:58.782583 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.782340    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb804c7-12ef-4fa2-ad30-b0341c293669" containerName="authorino"
Jul 02 21:44:58.782583 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.782370    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa69364-3173-4fe1-a438-fdf7b637151e" containerName="authorino"
Jul 02 21:44:58.782583 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.782377    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa69364-3173-4fe1-a438-fdf7b637151e" containerName="authorino"
Jul 02 21:44:58.782583 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.782444    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa69364-3173-4fe1-a438-fdf7b637151e" containerName="authorino"
Jul 02 21:44:58.782583 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.782451    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb804c7-12ef-4fa2-ad30-b0341c293669" containerName="authorino"
Jul 02 21:44:58.787040 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.787022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:58.790523 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.790501    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 21:44:58.790663 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.790550    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 21:44:58.790663 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.790613    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2vqz5\""
Jul 02 21:44:58.800729 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.800700    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77ff56c968-dnmtt"]
Jul 02 21:44:58.888893 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.888861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd686abd-0a8a-469a-a7f5-c14a51c714eb-webhook-cert\") pod \"maas-controller-77ff56c968-dnmtt\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") " pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:58.889074 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.888906    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5759v\" (UniqueName: \"kubernetes.io/projected/cd686abd-0a8a-469a-a7f5-c14a51c714eb-kube-api-access-5759v\") pod \"maas-controller-77ff56c968-dnmtt\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") " pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:58.990236 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.990207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd686abd-0a8a-469a-a7f5-c14a51c714eb-webhook-cert\") pod \"maas-controller-77ff56c968-dnmtt\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") " pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:58.990411 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.990259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5759v\" (UniqueName: \"kubernetes.io/projected/cd686abd-0a8a-469a-a7f5-c14a51c714eb-kube-api-access-5759v\") pod \"maas-controller-77ff56c968-dnmtt\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") " pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:58.992780 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.992748    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd686abd-0a8a-469a-a7f5-c14a51c714eb-webhook-cert\") pod \"maas-controller-77ff56c968-dnmtt\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") " pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:58.999290 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:58.999265    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5759v\" (UniqueName: \"kubernetes.io/projected/cd686abd-0a8a-469a-a7f5-c14a51c714eb-kube-api-access-5759v\") pod \"maas-controller-77ff56c968-dnmtt\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") " pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:59.098474 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:59.098439    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:44:59.444293 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:44:59.444266    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77ff56c968-dnmtt"]
Jul 02 21:44:59.446762 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:44:59.446733    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd686abd_0a8a_469a_a7f5_c14a51c714eb.slice/crio-b2eb05887b4aef77036e26e47a715f53c4c827646ca305e5a1a0f2538102d94c WatchSource:0}: Error finding container b2eb05887b4aef77036e26e47a715f53c4c827646ca305e5a1a0f2538102d94c: Status 404 returned error can't find the container with id b2eb05887b4aef77036e26e47a715f53c4c827646ca305e5a1a0f2538102d94c
Jul 02 21:45:00.457056 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:00.456987    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77ff56c968-dnmtt" event={"ID":"cd686abd-0a8a-469a-a7f5-c14a51c714eb","Type":"ContainerStarted","Data":"b2eb05887b4aef77036e26e47a715f53c4c827646ca305e5a1a0f2538102d94c"}
Jul 02 21:45:01.463209 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:01.463094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77ff56c968-dnmtt" event={"ID":"cd686abd-0a8a-469a-a7f5-c14a51c714eb","Type":"ContainerStarted","Data":"8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d"}
Jul 02 21:45:01.463561 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:01.463241    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:45:01.513130 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:01.513027    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77ff56c968-dnmtt" podStartSLOduration=1.7813161549999998 podStartE2EDuration="3.51300901s" totalImagesPullingTime="1.731692855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:01.512482303 +0000 UTC m=+540.510402388" watchObservedRunningTime="2026-07-02 21:45:01.51300901 +0000 UTC m=+540.510929066"
Jul 02 21:45:12.474708 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:12.474673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:45:13.654881 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.654841    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77ff56c968-dnmtt"]
Jul 02 21:45:13.655312 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.655096    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-77ff56c968-dnmtt" podUID="cd686abd-0a8a-469a-a7f5-c14a51c714eb" containerName="manager" containerID="cri-o://8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d" gracePeriod=30
Jul 02 21:45:13.909885 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.909819    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:45:13.930181 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.930121    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd686abd-0a8a-469a-a7f5-c14a51c714eb-webhook-cert\") pod \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") "
Jul 02 21:45:13.930371 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.930217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5759v\" (UniqueName: \"kubernetes.io/projected/cd686abd-0a8a-469a-a7f5-c14a51c714eb-kube-api-access-5759v\") pod \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\" (UID: \"cd686abd-0a8a-469a-a7f5-c14a51c714eb\") "
Jul 02 21:45:13.932702 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.932667    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd686abd-0a8a-469a-a7f5-c14a51c714eb-kube-api-access-5759v" (OuterVolumeSpecName: "kube-api-access-5759v") pod "cd686abd-0a8a-469a-a7f5-c14a51c714eb" (UID: "cd686abd-0a8a-469a-a7f5-c14a51c714eb"). InnerVolumeSpecName "kube-api-access-5759v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:45:13.932829 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:13.932675    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd686abd-0a8a-469a-a7f5-c14a51c714eb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cd686abd-0a8a-469a-a7f5-c14a51c714eb" (UID: "cd686abd-0a8a-469a-a7f5-c14a51c714eb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:45:14.031069 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.031034    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd686abd-0a8a-469a-a7f5-c14a51c714eb-webhook-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:45:14.031069 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.031062    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5759v\" (UniqueName: \"kubernetes.io/projected/cd686abd-0a8a-469a-a7f5-c14a51c714eb-kube-api-access-5759v\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:45:14.531021 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.530984    2571 generic.go:356] "Generic (PLEG): container finished" podID="cd686abd-0a8a-469a-a7f5-c14a51c714eb" containerID="8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d" exitCode=0
Jul 02 21:45:14.531021 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.531023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77ff56c968-dnmtt" event={"ID":"cd686abd-0a8a-469a-a7f5-c14a51c714eb","Type":"ContainerDied","Data":"8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d"}
Jul 02 21:45:14.531312 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.531027    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77ff56c968-dnmtt"
Jul 02 21:45:14.531312 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.531067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77ff56c968-dnmtt" event={"ID":"cd686abd-0a8a-469a-a7f5-c14a51c714eb","Type":"ContainerDied","Data":"b2eb05887b4aef77036e26e47a715f53c4c827646ca305e5a1a0f2538102d94c"}
Jul 02 21:45:14.531312 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.531089    2571 scope.go:117] "RemoveContainer" containerID="8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d"
Jul 02 21:45:14.540180 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.540138    2571 scope.go:117] "RemoveContainer" containerID="8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d"
Jul 02 21:45:14.540545 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:45:14.540527    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d\": container with ID starting with 8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d not found: ID does not exist" containerID="8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d"
Jul 02 21:45:14.540594 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.540556    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d"} err="failed to get container status \"8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d\": rpc error: code = NotFound desc = could not find container \"8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d\": container with ID starting with 8b501df71c47ce425c7e0a4e4870380e85384fc626c455dc4b7d75b31b9c3a4d not found: ID does not exist"
Jul 02 21:45:14.552770 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.552738    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77ff56c968-dnmtt"]
Jul 02 21:45:14.557495 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:14.557463    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77ff56c968-dnmtt"]
Jul 02 21:45:15.612909 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:15.612875    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd686abd-0a8a-469a-a7f5-c14a51c714eb" path="/var/lib/kubelet/pods/cd686abd-0a8a-469a-a7f5-c14a51c714eb/volumes"
Jul 02 21:45:34.014149 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.014110    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-64c6cb795c-5znwj"]
Jul 02 21:45:34.014631 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.014530    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd686abd-0a8a-469a-a7f5-c14a51c714eb" containerName="manager"
Jul 02 21:45:34.014631 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.014543    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd686abd-0a8a-469a-a7f5-c14a51c714eb" containerName="manager"
Jul 02 21:45:34.014631 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.014617    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd686abd-0a8a-469a-a7f5-c14a51c714eb" containerName="manager"
Jul 02 21:45:34.018007 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.017984    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.020496 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.020470    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 21:45:34.020608 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.020550    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66gqh\""
Jul 02 21:45:34.029341 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.029316    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64c6cb795c-5znwj"]
Jul 02 21:45:34.122769 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.122730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0051f3ef-f90d-44bf-a55c-68b8f19f745e-openshift-service-ca\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.122769 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.122769    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnjds\" (UniqueName: \"kubernetes.io/projected/0051f3ef-f90d-44bf-a55c-68b8f19f745e-kube-api-access-cnjds\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.123003 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.122893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0051f3ef-f90d-44bf-a55c-68b8f19f745e-maas-api-tls\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.223577 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.223543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0051f3ef-f90d-44bf-a55c-68b8f19f745e-openshift-service-ca\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.223577 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.223582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnjds\" (UniqueName: \"kubernetes.io/projected/0051f3ef-f90d-44bf-a55c-68b8f19f745e-kube-api-access-cnjds\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.223790 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.223675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0051f3ef-f90d-44bf-a55c-68b8f19f745e-maas-api-tls\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.223828 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:45:34.223810    2571 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 02 21:45:34.223893 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:45:34.223882    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0051f3ef-f90d-44bf-a55c-68b8f19f745e-maas-api-tls podName:0051f3ef-f90d-44bf-a55c-68b8f19f745e nodeName:}" failed. No retries permitted until 2026-07-02 21:45:34.723864765 +0000 UTC m=+573.721784801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0051f3ef-f90d-44bf-a55c-68b8f19f745e-maas-api-tls") pod "maas-api-64c6cb795c-5znwj" (UID: "0051f3ef-f90d-44bf-a55c-68b8f19f745e") : secret "maas-api-serving-cert" not found
Jul 02 21:45:34.224268 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.224250    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0051f3ef-f90d-44bf-a55c-68b8f19f745e-openshift-service-ca\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.232641 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.232613    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnjds\" (UniqueName: \"kubernetes.io/projected/0051f3ef-f90d-44bf-a55c-68b8f19f745e-kube-api-access-cnjds\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.494510 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.494474    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x6tm5"]
Jul 02 21:45:34.498277 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.498254    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.501886 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.501863    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 21:45:34.503278 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.503259    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jgjw7\""
Jul 02 21:45:34.509723 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.509689    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x6tm5"]
Jul 02 21:45:34.627075 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.627036    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94b006a-2613-48c1-8808-a8ee418961a0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x6tm5\" (UID: \"a94b006a-2613-48c1-8808-a8ee418961a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.627292 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.627193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vns8p\" (UniqueName: \"kubernetes.io/projected/a94b006a-2613-48c1-8808-a8ee418961a0-kube-api-access-vns8p\") pod \"payload-pre-processing-7964457696-x6tm5\" (UID: \"a94b006a-2613-48c1-8808-a8ee418961a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.727972 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.727930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94b006a-2613-48c1-8808-a8ee418961a0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x6tm5\" (UID: \"a94b006a-2613-48c1-8808-a8ee418961a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.728222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.727991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0051f3ef-f90d-44bf-a55c-68b8f19f745e-maas-api-tls\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.728222 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.728043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vns8p\" (UniqueName: \"kubernetes.io/projected/a94b006a-2613-48c1-8808-a8ee418961a0-kube-api-access-vns8p\") pod \"payload-pre-processing-7964457696-x6tm5\" (UID: \"a94b006a-2613-48c1-8808-a8ee418961a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.728777 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.728750    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94b006a-2613-48c1-8808-a8ee418961a0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x6tm5\" (UID: \"a94b006a-2613-48c1-8808-a8ee418961a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.730529 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.730509    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0051f3ef-f90d-44bf-a55c-68b8f19f745e-maas-api-tls\") pod \"maas-api-64c6cb795c-5znwj\" (UID: \"0051f3ef-f90d-44bf-a55c-68b8f19f745e\") " pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.745520 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.745458    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vns8p\" (UniqueName: \"kubernetes.io/projected/a94b006a-2613-48c1-8808-a8ee418961a0-kube-api-access-vns8p\") pod \"payload-pre-processing-7964457696-x6tm5\" (UID: \"a94b006a-2613-48c1-8808-a8ee418961a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.810322 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.810285    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:34.929264 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.929227    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:34.950648 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:34.950625    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x6tm5"]
Jul 02 21:45:34.952218 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:45:34.952193    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94b006a_2613_48c1_8808_a8ee418961a0.slice/crio-e8b9283a51df1ae483fd6ad22f606fe1e95eb5b59783ffe14f0ce400c1d6fe61 WatchSource:0}: Error finding container e8b9283a51df1ae483fd6ad22f606fe1e95eb5b59783ffe14f0ce400c1d6fe61: Status 404 returned error can't find the container with id e8b9283a51df1ae483fd6ad22f606fe1e95eb5b59783ffe14f0ce400c1d6fe61
Jul 02 21:45:35.077438 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:35.077412    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64c6cb795c-5znwj"]
Jul 02 21:45:35.079141 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:45:35.079110    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0051f3ef_f90d_44bf_a55c_68b8f19f745e.slice/crio-1d4d193fe5d4d1a42e8c535f8177c19befd5d007d656c3b7e52196a3cff57b48 WatchSource:0}: Error finding container 1d4d193fe5d4d1a42e8c535f8177c19befd5d007d656c3b7e52196a3cff57b48: Status 404 returned error can't find the container with id 1d4d193fe5d4d1a42e8c535f8177c19befd5d007d656c3b7e52196a3cff57b48
Jul 02 21:45:35.642585 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:35.642544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64c6cb795c-5znwj" event={"ID":"0051f3ef-f90d-44bf-a55c-68b8f19f745e","Type":"ContainerStarted","Data":"1d4d193fe5d4d1a42e8c535f8177c19befd5d007d656c3b7e52196a3cff57b48"}
Jul 02 21:45:35.643860 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:35.643831    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5" event={"ID":"a94b006a-2613-48c1-8808-a8ee418961a0","Type":"ContainerStarted","Data":"e8b9283a51df1ae483fd6ad22f606fe1e95eb5b59783ffe14f0ce400c1d6fe61"}
Jul 02 21:45:37.657577 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:37.657533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64c6cb795c-5znwj" event={"ID":"0051f3ef-f90d-44bf-a55c-68b8f19f745e","Type":"ContainerStarted","Data":"399846c6e3b870d5d2b3118edb4d1266b8b0d4beed08bce423e4a12700c8e737"}
Jul 02 21:45:37.658051 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:37.657643    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:37.659109 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:37.659085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5" event={"ID":"a94b006a-2613-48c1-8808-a8ee418961a0","Type":"ContainerStarted","Data":"41c6de94656de247248b0ed91a1ba11da6d5e7a0af630b857658df9b9ba50489"}
Jul 02 21:45:37.659267 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:37.659212    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:37.674667 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:37.674608    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-64c6cb795c-5znwj" podStartSLOduration=2.915286728 podStartE2EDuration="4.674585502s" totalImagesPullingTime="1.759298774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:37.673641296 +0000 UTC m=+576.671561348" watchObservedRunningTime="2026-07-02 21:45:37.674585502 +0000 UTC m=+576.672505604"
Jul 02 21:45:37.689421 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:37.689354    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5" podStartSLOduration=1.806274852 podStartE2EDuration="3.689334449s" totalImagesPullingTime="1.883059597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:37.687206631 +0000 UTC m=+576.685126709" watchObservedRunningTime="2026-07-02 21:45:37.689334449 +0000 UTC m=+576.687254503"
Jul 02 21:45:43.670302 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:43.670274    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-64c6cb795c-5znwj"
Jul 02 21:45:48.666789 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:48.666752    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-x6tm5"
Jul 02 21:45:56.134593 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.134553    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"]
Jul 02 21:45:56.138038 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.138022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.141408 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.141386    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m6vlx\""
Jul 02 21:45:56.141537 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.141410    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 21:45:56.141537 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.141424    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 21:45:56.141537 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.141429    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 21:45:56.147109 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.147079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"]
Jul 02 21:45:56.230219 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.230145    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pq7t\" (UniqueName: \"kubernetes.io/projected/64ded87e-ad12-4b73-8bf4-c96427a3852e-kube-api-access-9pq7t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.230429 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.230286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.230429 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.230327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.230429 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.230400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.230429 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.230420    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.230598 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.230435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64ded87e-ad12-4b73-8bf4-c96427a3852e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.331736 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.331700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pq7t\" (UniqueName: \"kubernetes.io/projected/64ded87e-ad12-4b73-8bf4-c96427a3852e-kube-api-access-9pq7t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.331938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.331757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.331938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.331785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.331938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.331839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.331938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.331860    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.331938 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.331881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64ded87e-ad12-4b73-8bf4-c96427a3852e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.332253 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.332232    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.332296 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.332249    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.332336 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.332303    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.334170 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.334141    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64ded87e-ad12-4b73-8bf4-c96427a3852e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.334338 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.334322    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64ded87e-ad12-4b73-8bf4-c96427a3852e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.338830 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.338811    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pq7t\" (UniqueName: \"kubernetes.io/projected/64ded87e-ad12-4b73-8bf4-c96427a3852e-kube-api-access-9pq7t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr8q6\" (UID: \"64ded87e-ad12-4b73-8bf4-c96427a3852e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.449365 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.449280    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:45:56.608353 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.608325    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"]
Jul 02 21:45:56.609780 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:45:56.609754    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ded87e_ad12_4b73_8bf4_c96427a3852e.slice/crio-c1d9e92ff9fd356b566690e00927f373a1ec8041f6b8050016f53225344b910a WatchSource:0}: Error finding container c1d9e92ff9fd356b566690e00927f373a1ec8041f6b8050016f53225344b910a: Status 404 returned error can't find the container with id c1d9e92ff9fd356b566690e00927f373a1ec8041f6b8050016f53225344b910a
Jul 02 21:45:56.767230 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:56.767133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6" event={"ID":"64ded87e-ad12-4b73-8bf4-c96427a3852e","Type":"ContainerStarted","Data":"c1d9e92ff9fd356b566690e00927f373a1ec8041f6b8050016f53225344b910a"}
Jul 02 21:45:58.786913 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:58.786876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6" event={"ID":"64ded87e-ad12-4b73-8bf4-c96427a3852e","Type":"ContainerStarted","Data":"3e8b29533d6dfce5dbd5008b0cf2bc5366456764015917e86ba10b1d5da01542"}
Jul 02 21:45:58.805417 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:45:58.805366    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6" podStartSLOduration=1.682252756 podStartE2EDuration="2.805348801s" totalImagesPullingTime="1.123096045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:58.804419705 +0000 UTC m=+597.802339786" watchObservedRunningTime="2026-07-02 21:45:58.805348801 +0000 UTC m=+597.803268911"
Jul 02 21:46:01.473511 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:46:01.473480    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:46:01.473970 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:46:01.473853    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:46:06.449849 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:46:06.449815    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:46:06.452321 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:46:06.449971    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:46:06.462675 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:46:06.462652    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:46:06.840109 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:46:06.840079    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr8q6"
Jul 02 21:47:24.620364 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.620331    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"]
Jul 02 21:47:24.624181 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.624130    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.626585 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.626561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 21:47:24.636781 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.636758    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"]
Jul 02 21:47:24.660723 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.660681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.660927 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.660754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.660927 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.660788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.660927 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.660870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.661129 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.660926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vkcf\" (UniqueName: \"kubernetes.io/projected/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-kube-api-access-7vkcf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.661129 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.660961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.761581 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.761537    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.761581 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.761585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vkcf\" (UniqueName: \"kubernetes.io/projected/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-kube-api-access-7vkcf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.761844 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.761609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.761844 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.761687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.761844 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.761736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.761844 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.761769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.762103 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.762079    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.762253 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.762104    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.762253 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.762189    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.764016 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.763987    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.764242 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.764225    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.769965 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.769947    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vkcf\" (UniqueName: \"kubernetes.io/projected/a7253dbb-4779-44d9-8e8a-749a9dfe16d9-kube-api-access-7vkcf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h\" (UID: \"a7253dbb-4779-44d9-8e8a-749a9dfe16d9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:24.935075 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:24.934981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:25.078382 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:25.078358    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"]
Jul 02 21:47:25.080115 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:47:25.080082    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7253dbb_4779_44d9_8e8a_749a9dfe16d9.slice/crio-ecb657923aa084b706d51bdbf6bae16c13b7ec5d0c7c81716dbf21362e6132b7 WatchSource:0}: Error finding container ecb657923aa084b706d51bdbf6bae16c13b7ec5d0c7c81716dbf21362e6132b7: Status 404 returned error can't find the container with id ecb657923aa084b706d51bdbf6bae16c13b7ec5d0c7c81716dbf21362e6132b7
Jul 02 21:47:25.081613 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:25.081591    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:47:25.241097 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:25.241010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h" event={"ID":"a7253dbb-4779-44d9-8e8a-749a9dfe16d9","Type":"ContainerStarted","Data":"ecb657923aa084b706d51bdbf6bae16c13b7ec5d0c7c81716dbf21362e6132b7"}
Jul 02 21:47:26.248060 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:26.248024    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h" event={"ID":"a7253dbb-4779-44d9-8e8a-749a9dfe16d9","Type":"ContainerStarted","Data":"41951f2e58f39eb6005feb8c7fd220dc8bfd3fe2809111ca453ba829e11077d5"}
Jul 02 21:47:26.265363 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:26.265309    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h" podStartSLOduration=2.074615371 podStartE2EDuration="2.265290754s" totalImagesPullingTime="190.675383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:47:26.263641651 +0000 UTC m=+685.261561706" watchObservedRunningTime="2026-07-02 21:47:26.265290754 +0000 UTC m=+685.263210835"
Jul 02 21:47:34.935220 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:34.935189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:34.935687 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:34.935240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:34.947765 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:34.947739    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:47:35.306306 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:47:35.306210    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h"
Jul 02 21:48:33.466319 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.466280    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84cddf8cb5-hhk86"]
Jul 02 21:48:33.469744 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.469727    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.480371 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.480343    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84cddf8cb5-hhk86"]
Jul 02 21:48:33.607794 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.607756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29d18384-e2eb-4b62-b5bc-e9d5cc2723ab-tls-cert\") pod \"authorino-84cddf8cb5-hhk86\" (UID: \"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab\") " pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.607971 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.607841    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bht2j\" (UniqueName: \"kubernetes.io/projected/29d18384-e2eb-4b62-b5bc-e9d5cc2723ab-kube-api-access-bht2j\") pod \"authorino-84cddf8cb5-hhk86\" (UID: \"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab\") " pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.708814 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.708778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bht2j\" (UniqueName: \"kubernetes.io/projected/29d18384-e2eb-4b62-b5bc-e9d5cc2723ab-kube-api-access-bht2j\") pod \"authorino-84cddf8cb5-hhk86\" (UID: \"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab\") " pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.709013 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.708892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29d18384-e2eb-4b62-b5bc-e9d5cc2723ab-tls-cert\") pod \"authorino-84cddf8cb5-hhk86\" (UID: \"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab\") " pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.711376 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.711353    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/29d18384-e2eb-4b62-b5bc-e9d5cc2723ab-tls-cert\") pod \"authorino-84cddf8cb5-hhk86\" (UID: \"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab\") " pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.716784 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.716730    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bht2j\" (UniqueName: \"kubernetes.io/projected/29d18384-e2eb-4b62-b5bc-e9d5cc2723ab-kube-api-access-bht2j\") pod \"authorino-84cddf8cb5-hhk86\" (UID: \"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab\") " pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.779354 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.779319    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84cddf8cb5-hhk86"
Jul 02 21:48:33.928843 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:33.928811    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84cddf8cb5-hhk86"]
Jul 02 21:48:33.930342 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:48:33.930312    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29d18384_e2eb_4b62_b5bc_e9d5cc2723ab.slice/crio-36ab3dc40042867d9b9e399196121b6865a50dc61d62551257b0320f625954c7 WatchSource:0}: Error finding container 36ab3dc40042867d9b9e399196121b6865a50dc61d62551257b0320f625954c7: Status 404 returned error can't find the container with id 36ab3dc40042867d9b9e399196121b6865a50dc61d62551257b0320f625954c7
Jul 02 21:48:34.620452 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:34.620369    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84cddf8cb5-hhk86" event={"ID":"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab","Type":"ContainerStarted","Data":"47e647edff550cd0307db7bda73268bda5014d4f1b94bed5b7ddc290abfd55c5"}
Jul 02 21:48:34.620452 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:34.620409    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84cddf8cb5-hhk86" event={"ID":"29d18384-e2eb-4b62-b5bc-e9d5cc2723ab","Type":"ContainerStarted","Data":"36ab3dc40042867d9b9e399196121b6865a50dc61d62551257b0320f625954c7"}
Jul 02 21:48:34.639694 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:34.639643    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84cddf8cb5-hhk86" podStartSLOduration=1.238150247 podStartE2EDuration="1.639625042s" totalImagesPullingTime="401.474795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:48:34.63777851 +0000 UTC m=+753.635698567" watchObservedRunningTime="2026-07-02 21:48:34.639625042 +0000 UTC m=+753.637545096"
Jul 02 21:48:34.664559 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:34.664518    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-859789cd64-dlrn8"]
Jul 02 21:48:34.664858 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:34.664780    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-859789cd64-dlrn8" podUID="f4991ac9-8355-40a1-885f-4afc3676a3b7" containerName="authorino" containerID="cri-o://b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40" gracePeriod=30
Jul 02 21:48:34.932295 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:34.932264    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:48:35.021536 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.021501    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4991ac9-8355-40a1-885f-4afc3676a3b7-tls-cert\") pod \"f4991ac9-8355-40a1-885f-4afc3676a3b7\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") "
Jul 02 21:48:35.021739 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.021617    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rffst\" (UniqueName: \"kubernetes.io/projected/f4991ac9-8355-40a1-885f-4afc3676a3b7-kube-api-access-rffst\") pod \"f4991ac9-8355-40a1-885f-4afc3676a3b7\" (UID: \"f4991ac9-8355-40a1-885f-4afc3676a3b7\") "
Jul 02 21:48:35.023969 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.023926    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4991ac9-8355-40a1-885f-4afc3676a3b7-kube-api-access-rffst" (OuterVolumeSpecName: "kube-api-access-rffst") pod "f4991ac9-8355-40a1-885f-4afc3676a3b7" (UID: "f4991ac9-8355-40a1-885f-4afc3676a3b7"). InnerVolumeSpecName "kube-api-access-rffst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:48:35.032137 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.032110    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4991ac9-8355-40a1-885f-4afc3676a3b7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f4991ac9-8355-40a1-885f-4afc3676a3b7" (UID: "f4991ac9-8355-40a1-885f-4afc3676a3b7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:48:35.122517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.122482    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4991ac9-8355-40a1-885f-4afc3676a3b7-tls-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:48:35.122517 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.122512    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rffst\" (UniqueName: \"kubernetes.io/projected/f4991ac9-8355-40a1-885f-4afc3676a3b7-kube-api-access-rffst\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 21:48:35.627189 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.627137    2571 generic.go:356] "Generic (PLEG): container finished" podID="f4991ac9-8355-40a1-885f-4afc3676a3b7" containerID="b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40" exitCode=0
Jul 02 21:48:35.627189 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.627187    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-859789cd64-dlrn8"
Jul 02 21:48:35.627588 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.627220    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-859789cd64-dlrn8" event={"ID":"f4991ac9-8355-40a1-885f-4afc3676a3b7","Type":"ContainerDied","Data":"b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40"}
Jul 02 21:48:35.627588 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.627264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-859789cd64-dlrn8" event={"ID":"f4991ac9-8355-40a1-885f-4afc3676a3b7","Type":"ContainerDied","Data":"7200df58225ae65b8208bcc1a7d0f3cbd6f33ba7b3b8a52b42c9f9962d23fb84"}
Jul 02 21:48:35.628689 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.627418    2571 scope.go:117] "RemoveContainer" containerID="b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40"
Jul 02 21:48:35.638961 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.638942    2571 scope.go:117] "RemoveContainer" containerID="b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40"
Jul 02 21:48:35.639288 ip-10-0-139-133 kubenswrapper[2571]: E0702 21:48:35.639265    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40\": container with ID starting with b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40 not found: ID does not exist" containerID="b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40"
Jul 02 21:48:35.639377 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.639294    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40"} err="failed to get container status \"b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40\": rpc error: code = NotFound desc = could not find container \"b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40\": container with ID starting with b89d77275b36c3eefd585ae07506920002e1d3d7f1231a1ae836507434f40d40 not found: ID does not exist"
Jul 02 21:48:35.646019 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.645995    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-859789cd64-dlrn8"]
Jul 02 21:48:35.656954 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:35.656918    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-859789cd64-dlrn8"]
Jul 02 21:48:37.612639 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:48:37.612597    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4991ac9-8355-40a1-885f-4afc3676a3b7" path="/var/lib/kubelet/pods/f4991ac9-8355-40a1-885f-4afc3676a3b7/volumes"
Jul 02 21:49:47.913979 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.910983    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-544f8c6b68-svbmh"]
Jul 02 21:49:47.913979 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.911909    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4991ac9-8355-40a1-885f-4afc3676a3b7" containerName="authorino"
Jul 02 21:49:47.913979 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.911929    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4991ac9-8355-40a1-885f-4afc3676a3b7" containerName="authorino"
Jul 02 21:49:47.913979 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.912173    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4991ac9-8355-40a1-885f-4afc3676a3b7" containerName="authorino"
Jul 02 21:49:47.916361 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.916334    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:47.920030 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.920005    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 21:49:47.920200 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.920016    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 21:49:47.920200 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.920100    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2vqz5\""
Jul 02 21:49:47.922591 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:47.922566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-544f8c6b68-svbmh"]
Jul 02 21:49:48.016703 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.016664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a813305a-89e3-49ca-ac08-a2c999d98a00-webhook-cert\") pod \"maas-controller-544f8c6b68-svbmh\" (UID: \"a813305a-89e3-49ca-ac08-a2c999d98a00\") " pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.016703 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.016704    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvrk\" (UniqueName: \"kubernetes.io/projected/a813305a-89e3-49ca-ac08-a2c999d98a00-kube-api-access-ffvrk\") pod \"maas-controller-544f8c6b68-svbmh\" (UID: \"a813305a-89e3-49ca-ac08-a2c999d98a00\") " pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.117922 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.117868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a813305a-89e3-49ca-ac08-a2c999d98a00-webhook-cert\") pod \"maas-controller-544f8c6b68-svbmh\" (UID: \"a813305a-89e3-49ca-ac08-a2c999d98a00\") " pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.117922 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.117921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvrk\" (UniqueName: \"kubernetes.io/projected/a813305a-89e3-49ca-ac08-a2c999d98a00-kube-api-access-ffvrk\") pod \"maas-controller-544f8c6b68-svbmh\" (UID: \"a813305a-89e3-49ca-ac08-a2c999d98a00\") " pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.120487 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.120456    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a813305a-89e3-49ca-ac08-a2c999d98a00-webhook-cert\") pod \"maas-controller-544f8c6b68-svbmh\" (UID: \"a813305a-89e3-49ca-ac08-a2c999d98a00\") " pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.125524 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.125491    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvrk\" (UniqueName: \"kubernetes.io/projected/a813305a-89e3-49ca-ac08-a2c999d98a00-kube-api-access-ffvrk\") pod \"maas-controller-544f8c6b68-svbmh\" (UID: \"a813305a-89e3-49ca-ac08-a2c999d98a00\") " pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.228836 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.228749    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:48.370253 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:48.370225    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-544f8c6b68-svbmh"]
Jul 02 21:49:48.371618 ip-10-0-139-133 kubenswrapper[2571]: W0702 21:49:48.371590    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda813305a_89e3_49ca_ac08_a2c999d98a00.slice/crio-d276b09300d23b03bae9fe95dedca592c88c77b5780098fce48461e72be793dd WatchSource:0}: Error finding container d276b09300d23b03bae9fe95dedca592c88c77b5780098fce48461e72be793dd: Status 404 returned error can't find the container with id d276b09300d23b03bae9fe95dedca592c88c77b5780098fce48461e72be793dd
Jul 02 21:49:49.031317 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:49.031280    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-544f8c6b68-svbmh" event={"ID":"a813305a-89e3-49ca-ac08-a2c999d98a00","Type":"ContainerStarted","Data":"da18879a4fe7d44873ea9c35de0559b96214933daaaa7b7db015b6a5e6bee0fa"}
Jul 02 21:49:49.031824 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:49.031339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-544f8c6b68-svbmh" event={"ID":"a813305a-89e3-49ca-ac08-a2c999d98a00","Type":"ContainerStarted","Data":"d276b09300d23b03bae9fe95dedca592c88c77b5780098fce48461e72be793dd"}
Jul 02 21:49:49.031824 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:49.031413    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:49:49.049110 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:49:49.048988    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-544f8c6b68-svbmh" podStartSLOduration=1.6359969909999998 podStartE2EDuration="2.048969081s" totalImagesPullingTime="412.97209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:49:49.046281294 +0000 UTC m=+828.044201372" watchObservedRunningTime="2026-07-02 21:49:49.048969081 +0000 UTC m=+828.046889144"
Jul 02 21:50:00.042448 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:50:00.042419    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-544f8c6b68-svbmh"
Jul 02 21:51:01.518449 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:51:01.518421    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:51:01.519653 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:51:01.519628    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:56:01.560994 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:56:01.560967    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 21:56:01.563828 ip-10-0-139-133 kubenswrapper[2571]: I0702 21:56:01.563809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:01:01.599429 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:01:01.599398    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:01:01.603688 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:01:01.603664    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:05:11.063535 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.063506    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"]
Jul 02 22:05:11.067067 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.067051    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.070479 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.070454    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a72fe752\"/\"default-dockercfg-bxjqz\""
Jul 02 22:05:11.070613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.070498    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a72fe752\"/\"e2e-lifecycle-model-a72fe752-kserve-self-signed-certs\""
Jul 02 22:05:11.070613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.070527    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a72fe752\"/\"openshift-service-ca.crt\""
Jul 02 22:05:11.070613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.070497    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a72fe752\"/\"kube-root-ca.crt\""
Jul 02 22:05:11.079460 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.079438    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"]
Jul 02 22:05:11.121908 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.121883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwsq\" (UniqueName: \"kubernetes.io/projected/1b7e6412-2f68-4c46-ab86-36546cb3b523-kube-api-access-gwwsq\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.122035 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.121923    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b7e6412-2f68-4c46-ab86-36546cb3b523-tls-certs\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.122035 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.121951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-model-cache\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.122035 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.121977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-home\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.122035 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.121991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-tmp-dir\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.122035 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.122021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-dshm\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.222758 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.222726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b7e6412-2f68-4c46-ab86-36546cb3b523-tls-certs\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.222936 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.222774    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-model-cache\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.222936 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.222803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-home\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.222936 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.222823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-tmp-dir\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.222936 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.222857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-dshm\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.222936 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.222928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwsq\" (UniqueName: \"kubernetes.io/projected/1b7e6412-2f68-4c46-ab86-36546cb3b523-kube-api-access-gwwsq\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.223328 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.223297    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-home\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.223439 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.223333    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-tmp-dir\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.223439 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.223357    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-model-cache\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.225060 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.225038    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-dshm\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.225275 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.225257    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b7e6412-2f68-4c46-ab86-36546cb3b523-tls-certs\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.232141 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.232117    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwsq\" (UniqueName: \"kubernetes.io/projected/1b7e6412-2f68-4c46-ab86-36546cb3b523-kube-api-access-gwwsq\") pod \"e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") " pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.378964 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.378936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:11.518645 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:11.518622    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"]
Jul 02 22:05:11.520843 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:05:11.520804    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b7e6412_2f68_4c46_ab86_36546cb3b523.slice/crio-e4a13bba95e86c5db9a17ae661bce41b76d3b107eb2e1f6fcc8bd294d143b725 WatchSource:0}: Error finding container e4a13bba95e86c5db9a17ae661bce41b76d3b107eb2e1f6fcc8bd294d143b725: Status 404 returned error can't find the container with id e4a13bba95e86c5db9a17ae661bce41b76d3b107eb2e1f6fcc8bd294d143b725
Jul 02 22:05:12.009857 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:12.009826    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv" event={"ID":"1b7e6412-2f68-4c46-ab86-36546cb3b523","Type":"ContainerStarted","Data":"1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5"}
Jul 02 22:05:12.010047 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:12.009868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv" event={"ID":"1b7e6412-2f68-4c46-ab86-36546cb3b523","Type":"ContainerStarted","Data":"e4a13bba95e86c5db9a17ae661bce41b76d3b107eb2e1f6fcc8bd294d143b725"}
Jul 02 22:05:12.034473 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:12.034426    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv" podStartSLOduration=1.034411885 podStartE2EDuration="1.034411885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:05:12.032561394 +0000 UTC m=+1751.030481461" watchObservedRunningTime="2026-07-02 22:05:12.034411885 +0000 UTC m=+1751.032331940"
Jul 02 22:05:21.380023 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:21.379981    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:21.380499 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:21.380050    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:21.392598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:21.392571    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:22.078513 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:22.078485    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:40.154207 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:40.154173    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"]
Jul 02 22:05:55.175606 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.175495    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv" podUID="1b7e6412-2f68-4c46-ab86-36546cb3b523" containerName="main" containerID="cri-o://1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5" gracePeriod=45
Jul 02 22:05:55.425239 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.425217    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:55.511467 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511394    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-home\") pod \"1b7e6412-2f68-4c46-ab86-36546cb3b523\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") "
Jul 02 22:05:55.511467 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511451    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b7e6412-2f68-4c46-ab86-36546cb3b523-tls-certs\") pod \"1b7e6412-2f68-4c46-ab86-36546cb3b523\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") "
Jul 02 22:05:55.511660 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511481    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-dshm\") pod \"1b7e6412-2f68-4c46-ab86-36546cb3b523\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") "
Jul 02 22:05:55.511660 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511522    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwwsq\" (UniqueName: \"kubernetes.io/projected/1b7e6412-2f68-4c46-ab86-36546cb3b523-kube-api-access-gwwsq\") pod \"1b7e6412-2f68-4c46-ab86-36546cb3b523\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") "
Jul 02 22:05:55.511738 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511677    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-tmp-dir\") pod \"1b7e6412-2f68-4c46-ab86-36546cb3b523\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") "
Jul 02 22:05:55.511738 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511689    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-home" (OuterVolumeSpecName: "home") pod "1b7e6412-2f68-4c46-ab86-36546cb3b523" (UID: "1b7e6412-2f68-4c46-ab86-36546cb3b523"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:05:55.511824 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511739    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-model-cache\") pod \"1b7e6412-2f68-4c46-ab86-36546cb3b523\" (UID: \"1b7e6412-2f68-4c46-ab86-36546cb3b523\") "
Jul 02 22:05:55.511924 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511904    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b7e6412-2f68-4c46-ab86-36546cb3b523" (UID: "1b7e6412-2f68-4c46-ab86-36546cb3b523"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:05:55.512025 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.511994    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b7e6412-2f68-4c46-ab86-36546cb3b523" (UID: "1b7e6412-2f68-4c46-ab86-36546cb3b523"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:05:55.512147 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.512131    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:05:55.512224 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.512151    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:05:55.512224 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.512180    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:05:55.513727 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.513702    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b7e6412-2f68-4c46-ab86-36546cb3b523-kube-api-access-gwwsq" (OuterVolumeSpecName: "kube-api-access-gwwsq") pod "1b7e6412-2f68-4c46-ab86-36546cb3b523" (UID: "1b7e6412-2f68-4c46-ab86-36546cb3b523"). InnerVolumeSpecName "kube-api-access-gwwsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:05:55.513814 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.513737    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b7e6412-2f68-4c46-ab86-36546cb3b523-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b7e6412-2f68-4c46-ab86-36546cb3b523" (UID: "1b7e6412-2f68-4c46-ab86-36546cb3b523"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:05:55.513814 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.513750    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-dshm" (OuterVolumeSpecName: "dshm") pod "1b7e6412-2f68-4c46-ab86-36546cb3b523" (UID: "1b7e6412-2f68-4c46-ab86-36546cb3b523"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:05:55.612757 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.612733    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b7e6412-2f68-4c46-ab86-36546cb3b523-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:05:55.612757 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.612754    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwwsq\" (UniqueName: \"kubernetes.io/projected/1b7e6412-2f68-4c46-ab86-36546cb3b523-kube-api-access-gwwsq\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:05:55.612928 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:55.612764    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b7e6412-2f68-4c46-ab86-36546cb3b523-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:05:56.252148 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.252112    2571 generic.go:356] "Generic (PLEG): container finished" podID="1b7e6412-2f68-4c46-ab86-36546cb3b523" containerID="1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5" exitCode=0
Jul 02 22:05:56.252591 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.252173    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"
Jul 02 22:05:56.252591 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.252210    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv" event={"ID":"1b7e6412-2f68-4c46-ab86-36546cb3b523","Type":"ContainerDied","Data":"1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5"}
Jul 02 22:05:56.252591 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.252258    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv" event={"ID":"1b7e6412-2f68-4c46-ab86-36546cb3b523","Type":"ContainerDied","Data":"e4a13bba95e86c5db9a17ae661bce41b76d3b107eb2e1f6fcc8bd294d143b725"}
Jul 02 22:05:56.252591 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.252279    2571 scope.go:117] "RemoveContainer" containerID="1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5"
Jul 02 22:05:56.261280 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.261258    2571 scope.go:117] "RemoveContainer" containerID="1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5"
Jul 02 22:05:56.261527 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:05:56.261506    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5\": container with ID starting with 1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5 not found: ID does not exist" containerID="1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5"
Jul 02 22:05:56.261598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.261530    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5"} err="failed to get container status \"1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5\": rpc error: code = NotFound desc = could not find container \"1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5\": container with ID starting with 1788d350293c8b4148150443bb3bbcd70c2aed531f8fdc5230549781faba44a5 not found: ID does not exist"
Jul 02 22:05:56.271613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.271591    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"]
Jul 02 22:05:56.278048 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:56.278029    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a72fe752/e2e-lifecycle-model-a72fe752-kserve-8d67458bc-fhzcv"]
Jul 02 22:05:57.613395 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:05:57.613362    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b7e6412-2f68-4c46-ab86-36546cb3b523" path="/var/lib/kubelet/pods/1b7e6412-2f68-4c46-ab86-36546cb3b523/volumes"
Jul 02 22:06:01.635788 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:06:01.635761    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:06:01.642053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:06:01.642030    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:08:11.033287 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.033251    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"]
Jul 02 22:08:11.035889 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.033847    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b7e6412-2f68-4c46-ab86-36546cb3b523" containerName="main"
Jul 02 22:08:11.035889 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.033864    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b7e6412-2f68-4c46-ab86-36546cb3b523" containerName="main"
Jul 02 22:08:11.035889 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.033977    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b7e6412-2f68-4c46-ab86-36546cb3b523" containerName="main"
Jul 02 22:08:11.037397 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.037381    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.041015 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.040979    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-624219\"/\"test-model-624219-kserve-self-signed-certs\""
Jul 02 22:08:11.041145 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.041025    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-624219\"/\"openshift-service-ca.crt\""
Jul 02 22:08:11.041145 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.041031    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-624219\"/\"default-dockercfg-67924\""
Jul 02 22:08:11.041291 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.041202    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-624219\"/\"kube-root-ca.crt\""
Jul 02 22:08:11.045531 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.045510    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"]
Jul 02 22:08:11.133913 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.133887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-home\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.134049 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.133933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-model-cache\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.134049 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.133971    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tls-certs\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.134049 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.134000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-dshm\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.134049 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.134030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdxff\" (UniqueName: \"kubernetes.io/projected/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-kube-api-access-xdxff\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.134219 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.134065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tmp-dir\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235366 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-model-cache\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235501 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tls-certs\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235501 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-dshm\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235501 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxff\" (UniqueName: \"kubernetes.io/projected/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-kube-api-access-xdxff\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235671 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tmp-dir\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235671 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-home\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235784 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235717    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-model-cache\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235919 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235896    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tmp-dir\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.235998 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.235897    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-home\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.237675 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.237646    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-dshm\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.237906 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.237890    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tls-certs\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.244914 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.244894    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdxff\" (UniqueName: \"kubernetes.io/projected/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-kube-api-access-xdxff\") pod \"test-model-624219-kserve-5c4f8f96fc-vpbq5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") " pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.349306 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.349276    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:11.486706 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.486677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"]
Jul 02 22:08:11.488207 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:08:11.488179    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57b36ba9_3b8e_40f8_b1ad_f3f65da12cd5.slice/crio-dc5265635f564f1376ebb55a312754f21cf688d18c771ee72bf0274981522657 WatchSource:0}: Error finding container dc5265635f564f1376ebb55a312754f21cf688d18c771ee72bf0274981522657: Status 404 returned error can't find the container with id dc5265635f564f1376ebb55a312754f21cf688d18c771ee72bf0274981522657
Jul 02 22:08:11.998041 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.998008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5" event={"ID":"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5","Type":"ContainerStarted","Data":"ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2"}
Jul 02 22:08:11.998257 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:11.998049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5" event={"ID":"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5","Type":"ContainerStarted","Data":"dc5265635f564f1376ebb55a312754f21cf688d18c771ee72bf0274981522657"}
Jul 02 22:08:12.018758 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:12.018713    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5" podStartSLOduration=1.018697358 podStartE2EDuration="1.018697358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:08:12.017006057 +0000 UTC m=+1931.014926113" watchObservedRunningTime="2026-07-02 22:08:12.018697358 +0000 UTC m=+1931.016617413"
Jul 02 22:08:21.349923 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:21.349892    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:21.349923 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:21.349932    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:21.362683 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:21.362658    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:22.074066 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:22.074033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:08:35.090617 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.090584    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"]
Jul 02 22:08:35.093946 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.093930    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.097743 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.097710    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d372c0\"/\"test-model-d372c0-kserve-self-signed-certs\""
Jul 02 22:08:35.097881 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.097723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d372c0\"/\"openshift-service-ca.crt\""
Jul 02 22:08:35.097881 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.097723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d372c0\"/\"kube-root-ca.crt\""
Jul 02 22:08:35.097881 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.097779    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d372c0\"/\"default-dockercfg-vbdwf\""
Jul 02 22:08:35.108751 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.108719    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"]
Jul 02 22:08:35.142837 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.142804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tmp-dir\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.143002 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.142956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vqqj\" (UniqueName: \"kubernetes.io/projected/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-kube-api-access-8vqqj\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.143070 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.143002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-model-cache\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.143070 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.143038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-dshm\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.143140 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.143084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-home\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.143140 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.143114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tls-certs\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.243736 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.243702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-model-cache\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.243736 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.243744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-dshm\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.243934 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.243764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-home\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.243970 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.243946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tls-certs\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.244057 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.244042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tmp-dir\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.244093 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.244082    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-home\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.244178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.244131    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-model-cache\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.244225 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.244196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqqj\" (UniqueName: \"kubernetes.io/projected/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-kube-api-access-8vqqj\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.244340 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.244322    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tmp-dir\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.246094 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.246068    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-dshm\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.246357 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.246338    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tls-certs\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.252799 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.252783    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vqqj\" (UniqueName: \"kubernetes.io/projected/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-kube-api-access-8vqqj\") pod \"test-model-d372c0-kserve-6b445659dc-gbqst\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") " pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.408557 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.408485    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:35.547431 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:35.547402    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"]
Jul 02 22:08:35.548265 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:08:35.548235    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ccd383d_a486_4fb3_b8bc_d8d9b4accb66.slice/crio-fcca0980db66b0ee82334e7da9cf2863a7dfeaa870b3ed85551c76dd70d640f0 WatchSource:0}: Error finding container fcca0980db66b0ee82334e7da9cf2863a7dfeaa870b3ed85551c76dd70d640f0: Status 404 returned error can't find the container with id fcca0980db66b0ee82334e7da9cf2863a7dfeaa870b3ed85551c76dd70d640f0
Jul 02 22:08:36.139028 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:36.138980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst" event={"ID":"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66","Type":"ContainerStarted","Data":"b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29"}
Jul 02 22:08:36.139418 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:36.139033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst" event={"ID":"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66","Type":"ContainerStarted","Data":"fcca0980db66b0ee82334e7da9cf2863a7dfeaa870b3ed85551c76dd70d640f0"}
Jul 02 22:08:36.156066 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:36.156019    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst" podStartSLOduration=1.156005382 podStartE2EDuration="1.156005382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:08:36.154298273 +0000 UTC m=+1955.152218348" watchObservedRunningTime="2026-07-02 22:08:36.156005382 +0000 UTC m=+1955.153925437"
Jul 02 22:08:45.409620 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:45.409586    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:45.410242 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:45.409637    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:45.421893 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:45.421871    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:46.206806 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:46.206779    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:08:55.542554 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:55.542470    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"]
Jul 02 22:08:56.473109 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:08:56.473080    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"]
Jul 02 22:09:10.564809 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.564732    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5" podUID="57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" containerName="main" containerID="cri-o://ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2" gracePeriod=45
Jul 02 22:09:10.811425 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.811404    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:09:10.865964 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.865930    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tmp-dir\") pod \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") "
Jul 02 22:09:10.866131 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.865976    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-dshm\") pod \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") "
Jul 02 22:09:10.866131 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866012    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-model-cache\") pod \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") "
Jul 02 22:09:10.866131 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866069    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdxff\" (UniqueName: \"kubernetes.io/projected/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-kube-api-access-xdxff\") pod \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") "
Jul 02 22:09:10.866131 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866112    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tls-certs\") pod \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") "
Jul 02 22:09:10.866390 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-home\") pod \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\" (UID: \"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5\") "
Jul 02 22:09:10.866390 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866204    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" (UID: "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:10.866390 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866314    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-model-cache" (OuterVolumeSpecName: "model-cache") pod "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" (UID: "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:10.866536 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866443    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-home" (OuterVolumeSpecName: "home") pod "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" (UID: "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:10.866627 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866613    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:10.866680 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866632    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:10.866680 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.866647    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:10.868277 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.868256    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-dshm" (OuterVolumeSpecName: "dshm") pod "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" (UID: "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:10.868362 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.868272    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" (UID: "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:09:10.868362 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.868333    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-kube-api-access-xdxff" (OuterVolumeSpecName: "kube-api-access-xdxff") pod "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" (UID: "57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5"). InnerVolumeSpecName "kube-api-access-xdxff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:09:10.967572 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.967542    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:10.967572 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.967565    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdxff\" (UniqueName: \"kubernetes.io/projected/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-kube-api-access-xdxff\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:10.967726 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:10.967580    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:11.333906 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.333877    2571 generic.go:356] "Generic (PLEG): container finished" podID="57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" containerID="ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2" exitCode=0
Jul 02 22:09:11.334100 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.333917    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"
Jul 02 22:09:11.334100 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.333966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5" event={"ID":"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5","Type":"ContainerDied","Data":"ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2"}
Jul 02 22:09:11.334100 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.334008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5" event={"ID":"57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5","Type":"ContainerDied","Data":"dc5265635f564f1376ebb55a312754f21cf688d18c771ee72bf0274981522657"}
Jul 02 22:09:11.334100 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.334034    2571 scope.go:117] "RemoveContainer" containerID="ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2"
Jul 02 22:09:11.343904 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.343890    2571 scope.go:117] "RemoveContainer" containerID="ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2"
Jul 02 22:09:11.344129 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:09:11.344112    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2\": container with ID starting with ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2 not found: ID does not exist" containerID="ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2"
Jul 02 22:09:11.344194 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.344136    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2"} err="failed to get container status \"ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2\": rpc error: code = NotFound desc = could not find container \"ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2\": container with ID starting with ecb2cc04632c82f87dcb700258b577811f0af9b59fa40777bb0160524a39c2f2 not found: ID does not exist"
Jul 02 22:09:11.356461 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.356440    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"]
Jul 02 22:09:11.358761 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.358740    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-624219/test-model-624219-kserve-5c4f8f96fc-vpbq5"]
Jul 02 22:09:11.493687 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.493626    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst" podUID="2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" containerName="main" containerID="cri-o://b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29" gracePeriod=45
Jul 02 22:09:11.613847 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.613822    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" path="/var/lib/kubelet/pods/57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5/volumes"
Jul 02 22:09:11.749637 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.749613    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:09:11.774048 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774024    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tls-certs\") pod \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") "
Jul 02 22:09:11.774180 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774079    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vqqj\" (UniqueName: \"kubernetes.io/projected/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-kube-api-access-8vqqj\") pod \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") "
Jul 02 22:09:11.774180 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774149    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tmp-dir\") pod \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") "
Jul 02 22:09:11.774301 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774214    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-home\") pod \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") "
Jul 02 22:09:11.774301 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774247    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-model-cache\") pod \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") "
Jul 02 22:09:11.774301 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774295    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-dshm\") pod \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\" (UID: \"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66\") "
Jul 02 22:09:11.774500 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774456    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" (UID: "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:11.774580 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774531    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-home" (OuterVolumeSpecName: "home") pod "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" (UID: "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:11.774678 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774653    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:11.774678 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774680    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:11.774860 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.774842    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" (UID: "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:11.776435 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.776408    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-kube-api-access-8vqqj" (OuterVolumeSpecName: "kube-api-access-8vqqj") pod "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" (UID: "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66"). InnerVolumeSpecName "kube-api-access-8vqqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:09:11.776537 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.776438    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-dshm" (OuterVolumeSpecName: "dshm") pod "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" (UID: "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:09:11.776599 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.776590    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" (UID: "2ccd383d-a486-4fb3-b8bc-d8d9b4accb66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:09:11.875130 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.875049    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vqqj\" (UniqueName: \"kubernetes.io/projected/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-kube-api-access-8vqqj\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:11.875130 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.875075    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:11.875130 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.875088    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:11.875130 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:11.875099    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:09:12.341606 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.341568    2571 generic.go:356] "Generic (PLEG): container finished" podID="2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" containerID="b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29" exitCode=0
Jul 02 22:09:12.341783 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.341616    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"
Jul 02 22:09:12.341783 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.341659    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst" event={"ID":"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66","Type":"ContainerDied","Data":"b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29"}
Jul 02 22:09:12.341783 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.341699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst" event={"ID":"2ccd383d-a486-4fb3-b8bc-d8d9b4accb66","Type":"ContainerDied","Data":"fcca0980db66b0ee82334e7da9cf2863a7dfeaa870b3ed85551c76dd70d640f0"}
Jul 02 22:09:12.341783 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.341717    2571 scope.go:117] "RemoveContainer" containerID="b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29"
Jul 02 22:09:12.351802 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.351785    2571 scope.go:117] "RemoveContainer" containerID="b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29"
Jul 02 22:09:12.352065 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:09:12.352047    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29\": container with ID starting with b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29 not found: ID does not exist" containerID="b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29"
Jul 02 22:09:12.352117 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.352074    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29"} err="failed to get container status \"b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29\": rpc error: code = NotFound desc = could not find container \"b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29\": container with ID starting with b26c2324b44906772efa06fde1fa07f46ae2c3725cd4002680cdfbd8f9759d29 not found: ID does not exist"
Jul 02 22:09:12.362744 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.362723    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"]
Jul 02 22:09:12.366973 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:12.366955    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d372c0/test-model-d372c0-kserve-6b445659dc-gbqst"]
Jul 02 22:09:13.612519 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:09:13.612483    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" path="/var/lib/kubelet/pods/2ccd383d-a486-4fb3-b8bc-d8d9b4accb66/volumes"
Jul 02 22:10:52.048052 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048014    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"]
Jul 02 22:10:52.048529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048451    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" containerName="main"
Jul 02 22:10:52.048529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048464    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" containerName="main"
Jul 02 22:10:52.048529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048476    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" containerName="main"
Jul 02 22:10:52.048529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048483    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" containerName="main"
Jul 02 22:10:52.048677 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048542    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ccd383d-a486-4fb3-b8bc-d8d9b4accb66" containerName="main"
Jul 02 22:10:52.048677 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.048553    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b36ba9-3b8e-40f8-b1ad-f3f65da12cd5" containerName="main"
Jul 02 22:10:52.051792 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.051772    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.054397 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.054375    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-edb549\"/\"kube-root-ca.crt\""
Jul 02 22:10:52.055238 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.055219    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-edb549\"/\"auth-test-model-edb549-kserve-self-signed-certs\""
Jul 02 22:10:52.055338 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.055290    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-edb549\"/\"openshift-service-ca.crt\""
Jul 02 22:10:52.055413 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.055332    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-edb549\"/\"default-dockercfg-pwxcz\""
Jul 02 22:10:52.062007 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.061983    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"]
Jul 02 22:10:52.106269 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.106242    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98zfw\" (UniqueName: \"kubernetes.io/projected/60d1264f-72f8-48fe-990b-98b2229b3051-kube-api-access-98zfw\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.106411 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.106287    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d1264f-72f8-48fe-990b-98b2229b3051-tls-certs\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.106411 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.106315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-home\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.106411 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.106376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-dshm\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.106411 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.106392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-tmp-dir\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.106550 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.106418    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-model-cache\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207340 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-dshm\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207340 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-tmp-dir\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207588 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207368    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-model-cache\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207588 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98zfw\" (UniqueName: \"kubernetes.io/projected/60d1264f-72f8-48fe-990b-98b2229b3051-kube-api-access-98zfw\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207588 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d1264f-72f8-48fe-990b-98b2229b3051-tls-certs\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207588 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-home\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207905 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207877    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-model-cache\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.207905 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207900    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-home\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.208102 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.207922    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-tmp-dir\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.209738 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.209716    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-dshm\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.210009 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.209992    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d1264f-72f8-48fe-990b-98b2229b3051-tls-certs\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.216276 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.216252    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98zfw\" (UniqueName: \"kubernetes.io/projected/60d1264f-72f8-48fe-990b-98b2229b3051-kube-api-access-98zfw\") pod \"auth-test-model-edb549-kserve-88fdf9bff-45nxv\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") " pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.363252 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.363221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:10:52.500091 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.500058    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"]
Jul 02 22:10:52.501468 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:10:52.501435    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60d1264f_72f8_48fe_990b_98b2229b3051.slice/crio-1f57dc6367608daa0a615afdf08dd8322bd6768eb45e81d0e90787ab17a8c627 WatchSource:0}: Error finding container 1f57dc6367608daa0a615afdf08dd8322bd6768eb45e81d0e90787ab17a8c627: Status 404 returned error can't find the container with id 1f57dc6367608daa0a615afdf08dd8322bd6768eb45e81d0e90787ab17a8c627
Jul 02 22:10:52.881150 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.881112    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv" event={"ID":"60d1264f-72f8-48fe-990b-98b2229b3051","Type":"ContainerStarted","Data":"0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a"}
Jul 02 22:10:52.881150 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.881169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv" event={"ID":"60d1264f-72f8-48fe-990b-98b2229b3051","Type":"ContainerStarted","Data":"1f57dc6367608daa0a615afdf08dd8322bd6768eb45e81d0e90787ab17a8c627"}
Jul 02 22:10:52.902218 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:10:52.902171    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv" podStartSLOduration=0.902142087 podStartE2EDuration="902.142087ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:10:52.89958635 +0000 UTC m=+2091.897506424" watchObservedRunningTime="2026-07-02 22:10:52.902142087 +0000 UTC m=+2091.900062141"
Jul 02 22:11:01.670533 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:01.670504    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:11:01.678061 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:01.678043    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:11:02.363801 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:02.363763    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:11:02.364073 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:02.364049    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:11:02.376291 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:02.376268    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:11:02.946228 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:02.946190    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:11:19.342846 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.342809    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"]
Jul 02 22:11:19.346356 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.346340    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.348717 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.348698    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"kube-root-ca.crt\""
Jul 02 22:11:19.349580 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.349566    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"openshift-service-ca.crt\""
Jul 02 22:11:19.349654 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.349573    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"auth-test-model-f2a709-kserve-self-signed-certs\""
Jul 02 22:11:19.349654 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.349610    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"default-dockercfg-9h8c8\""
Jul 02 22:11:19.356392 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.356365    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"]
Jul 02 22:11:19.460725 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.460691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-home\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.460888 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.460766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-tmp-dir\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.460888 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.460795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xhn\" (UniqueName: \"kubernetes.io/projected/e177c707-87f5-4566-ac78-cb07cb4609fd-kube-api-access-s9xhn\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.460888 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.460817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-dshm\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.460994 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.460883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e177c707-87f5-4566-ac78-cb07cb4609fd-tls-certs\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.460994 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.460924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-model-cache\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.561710 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.561677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e177c707-87f5-4566-ac78-cb07cb4609fd-tls-certs\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.561878 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.561722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-model-cache\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.561878 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.561760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-home\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.561878 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.561804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-tmp-dir\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.561878 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.561825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xhn\" (UniqueName: \"kubernetes.io/projected/e177c707-87f5-4566-ac78-cb07cb4609fd-kube-api-access-s9xhn\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.561878 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.561852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-dshm\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.562229 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.562186    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-model-cache\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.562316 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.562290    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-home\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.562316 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.562309    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-tmp-dir\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.564052 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.564032    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-dshm\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.564366 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.564343    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e177c707-87f5-4566-ac78-cb07cb4609fd-tls-certs\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.570403 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.570384    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xhn\" (UniqueName: \"kubernetes.io/projected/e177c707-87f5-4566-ac78-cb07cb4609fd-kube-api-access-s9xhn\") pod \"auth-test-model-f2a709-kserve-7464468887-cn4zn\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") " pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.656087 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.656005    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:19.795920 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:19.795886    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"]
Jul 02 22:11:19.797371 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:11:19.797343    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode177c707_87f5_4566_ac78_cb07cb4609fd.slice/crio-314e097d01e8538ea28a6a337b58e04f9f9ca8a1bfa43c9e1722034f6075f229 WatchSource:0}: Error finding container 314e097d01e8538ea28a6a337b58e04f9f9ca8a1bfa43c9e1722034f6075f229: Status 404 returned error can't find the container with id 314e097d01e8538ea28a6a337b58e04f9f9ca8a1bfa43c9e1722034f6075f229
Jul 02 22:11:20.031397 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:20.031306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn" event={"ID":"e177c707-87f5-4566-ac78-cb07cb4609fd","Type":"ContainerStarted","Data":"5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f"}
Jul 02 22:11:20.031397 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:20.031356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn" event={"ID":"e177c707-87f5-4566-ac78-cb07cb4609fd","Type":"ContainerStarted","Data":"314e097d01e8538ea28a6a337b58e04f9f9ca8a1bfa43c9e1722034f6075f229"}
Jul 02 22:11:20.066952 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:20.066897    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn" podStartSLOduration=1.06688196 podStartE2EDuration="1.06688196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:11:20.066443833 +0000 UTC m=+2119.064363888" watchObservedRunningTime="2026-07-02 22:11:20.06688196 +0000 UTC m=+2119.064802015"
Jul 02 22:11:29.656249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:29.656215    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:29.656249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:29.656257    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:29.668852 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:29.668824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:11:30.095831 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:11:30.095799    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:13:35.486120 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:35.486046    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"]
Jul 02 22:13:36.353691 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:36.353660    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"]
Jul 02 22:13:47.455539 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.455506    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"]
Jul 02 22:13:47.458685 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.458667    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.461398 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.461379    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-edb549\"/\"sub-test-model-edb549-kserve-self-signed-certs\""
Jul 02 22:13:47.471063 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.471036    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"]
Jul 02 22:13:47.536287 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.536252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-home\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.536459 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.536396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-model-cache\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.536459 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.536435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-dshm\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.536583 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.536484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscj6\" (UniqueName: \"kubernetes.io/projected/b2404022-1017-448a-92ca-f992294b30b2-kube-api-access-bscj6\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.536583 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.536543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2404022-1017-448a-92ca-f992294b30b2-tls-certs\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.536583 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.536572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-tmp-dir\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.637916 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.637883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-model-cache\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.637916 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.637919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-dshm\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638138 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscj6\" (UniqueName: \"kubernetes.io/projected/b2404022-1017-448a-92ca-f992294b30b2-kube-api-access-bscj6\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638138 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2404022-1017-448a-92ca-f992294b30b2-tls-certs\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638138 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-tmp-dir\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638347 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-home\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638347 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638327    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-model-cache\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638510 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638484    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-tmp-dir\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.638640 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.638546    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-home\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.640191 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.640143    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-dshm\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.640462 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.640447    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2404022-1017-448a-92ca-f992294b30b2-tls-certs\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.647089 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.647068    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscj6\" (UniqueName: \"kubernetes.io/projected/b2404022-1017-448a-92ca-f992294b30b2-kube-api-access-bscj6\") pod \"sub-test-model-edb549-kserve-5d7d69b445-gnz69\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") " pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.767332 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.767274    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:47.905948 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:47.905925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"]
Jul 02 22:13:47.908028 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:13:47.908001    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2404022_1017_448a_92ca_f992294b30b2.slice/crio-a66979dab8dd8a171f5f2a6e1b1053c9b2a7cfb7e58c3b12bf24b4c7ab24d0e5 WatchSource:0}: Error finding container a66979dab8dd8a171f5f2a6e1b1053c9b2a7cfb7e58c3b12bf24b4c7ab24d0e5: Status 404 returned error can't find the container with id a66979dab8dd8a171f5f2a6e1b1053c9b2a7cfb7e58c3b12bf24b4c7ab24d0e5
Jul 02 22:13:48.851227 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:48.851188    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69" event={"ID":"b2404022-1017-448a-92ca-f992294b30b2","Type":"ContainerStarted","Data":"07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b"}
Jul 02 22:13:48.851227 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:48.851239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69" event={"ID":"b2404022-1017-448a-92ca-f992294b30b2","Type":"ContainerStarted","Data":"a66979dab8dd8a171f5f2a6e1b1053c9b2a7cfb7e58c3b12bf24b4c7ab24d0e5"}
Jul 02 22:13:48.872933 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:48.872886    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69" podStartSLOduration=1.872873684 podStartE2EDuration="1.872873684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:13:48.871215338 +0000 UTC m=+2267.869135394" watchObservedRunningTime="2026-07-02 22:13:48.872873684 +0000 UTC m=+2267.870793739"
Jul 02 22:13:50.506321 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.506286    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv" podUID="60d1264f-72f8-48fe-990b-98b2229b3051" containerName="main" containerID="cri-o://0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a" gracePeriod=45
Jul 02 22:13:50.763002 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.762934    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:13:50.863463 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.863434    2571 generic.go:356] "Generic (PLEG): container finished" podID="60d1264f-72f8-48fe-990b-98b2229b3051" containerID="0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a" exitCode=0
Jul 02 22:13:50.863614 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.863477    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"
Jul 02 22:13:50.863614 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.863516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv" event={"ID":"60d1264f-72f8-48fe-990b-98b2229b3051","Type":"ContainerDied","Data":"0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a"}
Jul 02 22:13:50.863614 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.863558    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv" event={"ID":"60d1264f-72f8-48fe-990b-98b2229b3051","Type":"ContainerDied","Data":"1f57dc6367608daa0a615afdf08dd8322bd6768eb45e81d0e90787ab17a8c627"}
Jul 02 22:13:50.863614 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.863581    2571 scope.go:117] "RemoveContainer" containerID="0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a"
Jul 02 22:13:50.867437 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867417    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98zfw\" (UniqueName: \"kubernetes.io/projected/60d1264f-72f8-48fe-990b-98b2229b3051-kube-api-access-98zfw\") pod \"60d1264f-72f8-48fe-990b-98b2229b3051\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") "
Jul 02 22:13:50.867534 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867458    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-home\") pod \"60d1264f-72f8-48fe-990b-98b2229b3051\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") "
Jul 02 22:13:50.867534 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867525    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-model-cache\") pod \"60d1264f-72f8-48fe-990b-98b2229b3051\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") "
Jul 02 22:13:50.867656 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867592    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d1264f-72f8-48fe-990b-98b2229b3051-tls-certs\") pod \"60d1264f-72f8-48fe-990b-98b2229b3051\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") "
Jul 02 22:13:50.867656 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-dshm\") pod \"60d1264f-72f8-48fe-990b-98b2229b3051\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") "
Jul 02 22:13:50.867769 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867674    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-tmp-dir\") pod \"60d1264f-72f8-48fe-990b-98b2229b3051\" (UID: \"60d1264f-72f8-48fe-990b-98b2229b3051\") "
Jul 02 22:13:50.867825 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867803    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-home" (OuterVolumeSpecName: "home") pod "60d1264f-72f8-48fe-990b-98b2229b3051" (UID: "60d1264f-72f8-48fe-990b-98b2229b3051"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:50.867869 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867841    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-model-cache" (OuterVolumeSpecName: "model-cache") pod "60d1264f-72f8-48fe-990b-98b2229b3051" (UID: "60d1264f-72f8-48fe-990b-98b2229b3051"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:50.868002 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.867977    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60d1264f-72f8-48fe-990b-98b2229b3051" (UID: "60d1264f-72f8-48fe-990b-98b2229b3051"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:50.868184 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.868007    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:50.868294 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.868186    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:50.869916 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.869894    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-dshm" (OuterVolumeSpecName: "dshm") pod "60d1264f-72f8-48fe-990b-98b2229b3051" (UID: "60d1264f-72f8-48fe-990b-98b2229b3051"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:50.870011 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.869963    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d1264f-72f8-48fe-990b-98b2229b3051-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60d1264f-72f8-48fe-990b-98b2229b3051" (UID: "60d1264f-72f8-48fe-990b-98b2229b3051"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:13:50.870011 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.869971    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d1264f-72f8-48fe-990b-98b2229b3051-kube-api-access-98zfw" (OuterVolumeSpecName: "kube-api-access-98zfw") pod "60d1264f-72f8-48fe-990b-98b2229b3051" (UID: "60d1264f-72f8-48fe-990b-98b2229b3051"). InnerVolumeSpecName "kube-api-access-98zfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:13:50.873318 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.873302    2571 scope.go:117] "RemoveContainer" containerID="0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a"
Jul 02 22:13:50.873615 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:13:50.873597    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a\": container with ID starting with 0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a not found: ID does not exist" containerID="0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a"
Jul 02 22:13:50.873673 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.873623    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a"} err="failed to get container status \"0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a\": rpc error: code = NotFound desc = could not find container \"0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a\": container with ID starting with 0cd4d4afa3c6e04f722673e7bdd9bc76e23d4acb464f914a06f3eaa607546c0a not found: ID does not exist"
Jul 02 22:13:50.968951 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.968924    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60d1264f-72f8-48fe-990b-98b2229b3051-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:50.968951 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.968949    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:50.969114 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.968977    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d1264f-72f8-48fe-990b-98b2229b3051-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:50.969114 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:50.968986    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98zfw\" (UniqueName: \"kubernetes.io/projected/60d1264f-72f8-48fe-990b-98b2229b3051-kube-api-access-98zfw\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.187221 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.187196    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"]
Jul 02 22:13:51.192552 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.192530    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/auth-test-model-edb549-kserve-88fdf9bff-45nxv"]
Jul 02 22:13:51.373986 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.373927    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn" podUID="e177c707-87f5-4566-ac78-cb07cb4609fd" containerName="main" containerID="cri-o://5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f" gracePeriod=45
Jul 02 22:13:51.614394 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.614365    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d1264f-72f8-48fe-990b-98b2229b3051" path="/var/lib/kubelet/pods/60d1264f-72f8-48fe-990b-98b2229b3051/volumes"
Jul 02 22:13:51.631027 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.631002    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:13:51.776409 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776330    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-tmp-dir\") pod \"e177c707-87f5-4566-ac78-cb07cb4609fd\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") "
Jul 02 22:13:51.776409 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776363    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-model-cache\") pod \"e177c707-87f5-4566-ac78-cb07cb4609fd\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") "
Jul 02 22:13:51.776598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776414    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e177c707-87f5-4566-ac78-cb07cb4609fd-tls-certs\") pod \"e177c707-87f5-4566-ac78-cb07cb4609fd\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") "
Jul 02 22:13:51.776598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776439    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xhn\" (UniqueName: \"kubernetes.io/projected/e177c707-87f5-4566-ac78-cb07cb4609fd-kube-api-access-s9xhn\") pod \"e177c707-87f5-4566-ac78-cb07cb4609fd\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") "
Jul 02 22:13:51.776598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776486    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-home\") pod \"e177c707-87f5-4566-ac78-cb07cb4609fd\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") "
Jul 02 22:13:51.776759 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776640    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-dshm\") pod \"e177c707-87f5-4566-ac78-cb07cb4609fd\" (UID: \"e177c707-87f5-4566-ac78-cb07cb4609fd\") "
Jul 02 22:13:51.776759 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776645    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e177c707-87f5-4566-ac78-cb07cb4609fd" (UID: "e177c707-87f5-4566-ac78-cb07cb4609fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:51.776857 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776660    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "e177c707-87f5-4566-ac78-cb07cb4609fd" (UID: "e177c707-87f5-4566-ac78-cb07cb4609fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:51.776857 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.776697    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-home" (OuterVolumeSpecName: "home") pod "e177c707-87f5-4566-ac78-cb07cb4609fd" (UID: "e177c707-87f5-4566-ac78-cb07cb4609fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:51.777017 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.777000    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.777073 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.777022    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.777073 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.777037    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.778740 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.778721    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-dshm" (OuterVolumeSpecName: "dshm") pod "e177c707-87f5-4566-ac78-cb07cb4609fd" (UID: "e177c707-87f5-4566-ac78-cb07cb4609fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:13:51.778818 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.778802    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e177c707-87f5-4566-ac78-cb07cb4609fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e177c707-87f5-4566-ac78-cb07cb4609fd" (UID: "e177c707-87f5-4566-ac78-cb07cb4609fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:13:51.778856 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.778841    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e177c707-87f5-4566-ac78-cb07cb4609fd-kube-api-access-s9xhn" (OuterVolumeSpecName: "kube-api-access-s9xhn") pod "e177c707-87f5-4566-ac78-cb07cb4609fd" (UID: "e177c707-87f5-4566-ac78-cb07cb4609fd"). InnerVolumeSpecName "kube-api-access-s9xhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:13:51.871718 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.871690    2571 generic.go:356] "Generic (PLEG): container finished" podID="e177c707-87f5-4566-ac78-cb07cb4609fd" containerID="5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f" exitCode=0
Jul 02 22:13:51.871870 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.871732    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"
Jul 02 22:13:51.871870 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.871774    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn" event={"ID":"e177c707-87f5-4566-ac78-cb07cb4609fd","Type":"ContainerDied","Data":"5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f"}
Jul 02 22:13:51.871870 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.871813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn" event={"ID":"e177c707-87f5-4566-ac78-cb07cb4609fd","Type":"ContainerDied","Data":"314e097d01e8538ea28a6a337b58e04f9f9ca8a1bfa43c9e1722034f6075f229"}
Jul 02 22:13:51.871870 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.871832    2571 scope.go:117] "RemoveContainer" containerID="5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f"
Jul 02 22:13:51.877670 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.877642    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e177c707-87f5-4566-ac78-cb07cb4609fd-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.877753 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.877670    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xhn\" (UniqueName: \"kubernetes.io/projected/e177c707-87f5-4566-ac78-cb07cb4609fd-kube-api-access-s9xhn\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.877753 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.877685    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e177c707-87f5-4566-ac78-cb07cb4609fd-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:13:51.881508 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.881494    2571 scope.go:117] "RemoveContainer" containerID="5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f"
Jul 02 22:13:51.881744 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:13:51.881725    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f\": container with ID starting with 5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f not found: ID does not exist" containerID="5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f"
Jul 02 22:13:51.881808 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.881750    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f"} err="failed to get container status \"5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f\": rpc error: code = NotFound desc = could not find container \"5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f\": container with ID starting with 5f5c55eee13e0da4226ad62b88c4cc03a5e2bc287120ae38387535be49a1933f not found: ID does not exist"
Jul 02 22:13:51.894849 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.894828    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"]
Jul 02 22:13:51.901616 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:51.901590    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/auth-test-model-f2a709-kserve-7464468887-cn4zn"]
Jul 02 22:13:53.611765 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:53.611735    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e177c707-87f5-4566-ac78-cb07cb4609fd" path="/var/lib/kubelet/pods/e177c707-87f5-4566-ac78-cb07cb4609fd/volumes"
Jul 02 22:13:57.767834 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:57.767802    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:57.767834 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:57.767840    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:57.780010 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:57.779987    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:13:57.918455 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:13:57.918429    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:14:10.550258 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550222    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"]
Jul 02 22:14:10.550646 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550631    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d1264f-72f8-48fe-990b-98b2229b3051" containerName="main"
Jul 02 22:14:10.550690 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550649    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d1264f-72f8-48fe-990b-98b2229b3051" containerName="main"
Jul 02 22:14:10.550690 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550663    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e177c707-87f5-4566-ac78-cb07cb4609fd" containerName="main"
Jul 02 22:14:10.550690 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550669    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e177c707-87f5-4566-ac78-cb07cb4609fd" containerName="main"
Jul 02 22:14:10.550775 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550731    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e177c707-87f5-4566-ac78-cb07cb4609fd" containerName="main"
Jul 02 22:14:10.550775 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.550746    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d1264f-72f8-48fe-990b-98b2229b3051" containerName="main"
Jul 02 22:14:10.553783 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.553761    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.557529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.557468    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"kube-root-ca.crt\""
Jul 02 22:14:10.557529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.557502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"sub-test-model-f2a709-kserve-self-signed-certs\""
Jul 02 22:14:10.557529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.557516    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"openshift-service-ca.crt\""
Jul 02 22:14:10.557529 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.557521    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"default-dockercfg-9h8c8\""
Jul 02 22:14:10.567426 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.567403    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"]
Jul 02 22:14:10.639982 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.639943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-home\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.640185 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.640009    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-dshm\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.640185 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.640054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-model-cache\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.640185 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.640136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tmp-dir\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.640346 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.640211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbzb\" (UniqueName: \"kubernetes.io/projected/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-kube-api-access-plbzb\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.640346 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.640245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tls-certs\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.741764 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.741730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plbzb\" (UniqueName: \"kubernetes.io/projected/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-kube-api-access-plbzb\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.741920 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.741782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tls-certs\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.741998 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.741972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-home\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.742092 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.742077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-dshm\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.742150 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.742106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-model-cache\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.742261 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.742221    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tmp-dir\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.742431 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.742411    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-home\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.742519 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.742498    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-model-cache\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.742587 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.742569    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tmp-dir\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.744237 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.744215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-dshm\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.744336 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.744322    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tls-certs\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.751478 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.751459    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbzb\" (UniqueName: \"kubernetes.io/projected/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-kube-api-access-plbzb\") pod \"sub-test-model-f2a709-kserve-5d45788d5c-nq8p5\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") " pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:10.864738 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:10.864708    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:11.000438 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:11.000413    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"]
Jul 02 22:14:11.002046 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:14:11.002013    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bf68f1e_7e7b_441c_9c64_9ab47cd30269.slice/crio-62301ed05f3e149f31a368624783333a53ad83a504483e578971a84c1049755a WatchSource:0}: Error finding container 62301ed05f3e149f31a368624783333a53ad83a504483e578971a84c1049755a: Status 404 returned error can't find the container with id 62301ed05f3e149f31a368624783333a53ad83a504483e578971a84c1049755a
Jul 02 22:14:11.979828 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:11.979794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5" event={"ID":"8bf68f1e-7e7b-441c-9c64-9ab47cd30269","Type":"ContainerStarted","Data":"8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc"}
Jul 02 22:14:11.980220 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:11.979835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5" event={"ID":"8bf68f1e-7e7b-441c-9c64-9ab47cd30269","Type":"ContainerStarted","Data":"62301ed05f3e149f31a368624783333a53ad83a504483e578971a84c1049755a"}
Jul 02 22:14:12.000740 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:12.000692    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5" podStartSLOduration=2.000676948 podStartE2EDuration="2.000676948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:14:11.998955992 +0000 UTC m=+2290.996876047" watchObservedRunningTime="2026-07-02 22:14:12.000676948 +0000 UTC m=+2290.998597020"
Jul 02 22:14:20.865118 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:20.865077    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:20.865604 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:20.865136    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:20.877559 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:20.877536    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:21.039268 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:21.039239    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:14:57.424019 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:57.423921    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"]
Jul 02 22:14:58.271924 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:14:58.271895    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"]
Jul 02 22:15:00.155838 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.155802    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"]
Jul 02 22:15:00.159520 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.159500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:00.181909 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.181885    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"]
Jul 02 22:15:00.195802 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.195778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7h85\" (UniqueName: \"kubernetes.io/projected/c07c33a8-1120-475d-80c1-b6106257742c-kube-api-access-v7h85\") pod \"maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54\" (UID: \"c07c33a8-1120-475d-80c1-b6106257742c\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:00.297178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.297130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7h85\" (UniqueName: \"kubernetes.io/projected/c07c33a8-1120-475d-80c1-b6106257742c-kube-api-access-v7h85\") pod \"maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54\" (UID: \"c07c33a8-1120-475d-80c1-b6106257742c\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:00.314460 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.314430    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7h85\" (UniqueName: \"kubernetes.io/projected/c07c33a8-1120-475d-80c1-b6106257742c-kube-api-access-v7h85\") pod \"maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54\" (UID: \"c07c33a8-1120-475d-80c1-b6106257742c\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:00.470753 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.470677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:00.620189 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:15:00.620134    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07c33a8_1120_475d_80c1_b6106257742c.slice/crio-087990e398d16d4c6e5c87a9bbaff5a9580a26b22657f1e0412d51ee6e55105b WatchSource:0}: Error finding container 087990e398d16d4c6e5c87a9bbaff5a9580a26b22657f1e0412d51ee6e55105b: Status 404 returned error can't find the container with id 087990e398d16d4c6e5c87a9bbaff5a9580a26b22657f1e0412d51ee6e55105b
Jul 02 22:15:00.620679 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.620650    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"]
Jul 02 22:15:00.622003 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:00.621986    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 22:15:01.257677 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:01.257645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54" event={"ID":"c07c33a8-1120-475d-80c1-b6106257742c","Type":"ContainerStarted","Data":"087990e398d16d4c6e5c87a9bbaff5a9580a26b22657f1e0412d51ee6e55105b"}
Jul 02 22:15:02.264406 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.264370    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"]
Jul 02 22:15:02.271282 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.271258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.275885 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.275855    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-edb549\"/\"rate-test-model-edb549-kserve-self-signed-certs\""
Jul 02 22:15:02.316588 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.316559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-dshm\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.316722 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.316608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9tbf\" (UniqueName: \"kubernetes.io/projected/456e4b71-94ed-4b61-a31e-310b70713edd-kube-api-access-b9tbf\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.316786 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.316746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-home\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.316833 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.316815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-model-cache\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.316872 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.316842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456e4b71-94ed-4b61-a31e-310b70713edd-tls-certs\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.316872 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.316864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-tmp-dir\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.325959 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.325933    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"]
Jul 02 22:15:02.417675 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.417637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-home\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.417852 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.417793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-model-cache\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.417852 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.417821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456e4b71-94ed-4b61-a31e-310b70713edd-tls-certs\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.417852 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.417844    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-tmp-dir\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.418039 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.417871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-dshm\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.418039 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.417917    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9tbf\" (UniqueName: \"kubernetes.io/projected/456e4b71-94ed-4b61-a31e-310b70713edd-kube-api-access-b9tbf\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.418039 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.418020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-home\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.418287 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.418133    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-model-cache\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.418364 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.418283    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-tmp-dir\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.420367 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.420336    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-dshm\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.420748 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.420728    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456e4b71-94ed-4b61-a31e-310b70713edd-tls-certs\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.432067 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.432043    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9tbf\" (UniqueName: \"kubernetes.io/projected/456e4b71-94ed-4b61-a31e-310b70713edd-kube-api-access-b9tbf\") pod \"rate-test-model-edb549-kserve-cc8cbf6dc-knzpm\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") " pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.582074 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.582046    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:02.955976 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:02.955951    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"]
Jul 02 22:15:02.956520 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:15:02.956499    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod456e4b71_94ed_4b61_a31e_310b70713edd.slice/crio-264c71048eb4bb9f622c637120919ed5cf6f419fc273961a310f1057d603f869 WatchSource:0}: Error finding container 264c71048eb4bb9f622c637120919ed5cf6f419fc273961a310f1057d603f869: Status 404 returned error can't find the container with id 264c71048eb4bb9f622c637120919ed5cf6f419fc273961a310f1057d603f869
Jul 02 22:15:03.272261 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:03.272228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm" event={"ID":"456e4b71-94ed-4b61-a31e-310b70713edd","Type":"ContainerStarted","Data":"0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8"}
Jul 02 22:15:03.272676 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:03.272275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm" event={"ID":"456e4b71-94ed-4b61-a31e-310b70713edd","Type":"ContainerStarted","Data":"264c71048eb4bb9f622c637120919ed5cf6f419fc273961a310f1057d603f869"}
Jul 02 22:15:03.273721 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:03.273699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54" event={"ID":"c07c33a8-1120-475d-80c1-b6106257742c","Type":"ContainerStarted","Data":"fa50a2e4a70d1f2ac208f06aed81f7bc352502ffd1255627fed4f05f6832a2cc"}
Jul 02 22:15:03.346703 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:03.346656    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54" podStartSLOduration=1.096933946 podStartE2EDuration="3.346641886s" totalImagesPullingTime="2.24970794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:15:03.345543749 +0000 UTC m=+2342.343463830" watchObservedRunningTime="2026-07-02 22:15:03.346641886 +0000 UTC m=+2342.344561940"
Jul 02 22:15:03.347722 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:03.347679    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm" podStartSLOduration=1.347669692 podStartE2EDuration="1.347669692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:15:03.300313358 +0000 UTC m=+2342.298233413" watchObservedRunningTime="2026-07-02 22:15:03.347669692 +0000 UTC m=+2342.345589747"
Jul 02 22:15:04.282045 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:04.282011    2571 generic.go:356] "Generic (PLEG): container finished" podID="c07c33a8-1120-475d-80c1-b6106257742c" containerID="fa50a2e4a70d1f2ac208f06aed81f7bc352502ffd1255627fed4f05f6832a2cc" exitCode=0
Jul 02 22:15:04.282546 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:04.282073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54" event={"ID":"c07c33a8-1120-475d-80c1-b6106257742c","Type":"ContainerDied","Data":"fa50a2e4a70d1f2ac208f06aed81f7bc352502ffd1255627fed4f05f6832a2cc"}
Jul 02 22:15:05.423053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:05.423033    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:05.548222 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:05.548120    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7h85\" (UniqueName: \"kubernetes.io/projected/c07c33a8-1120-475d-80c1-b6106257742c-kube-api-access-v7h85\") pod \"c07c33a8-1120-475d-80c1-b6106257742c\" (UID: \"c07c33a8-1120-475d-80c1-b6106257742c\") "
Jul 02 22:15:05.550205 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:05.550177    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07c33a8-1120-475d-80c1-b6106257742c-kube-api-access-v7h85" (OuterVolumeSpecName: "kube-api-access-v7h85") pod "c07c33a8-1120-475d-80c1-b6106257742c" (UID: "c07c33a8-1120-475d-80c1-b6106257742c"). InnerVolumeSpecName "kube-api-access-v7h85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:15:05.649064 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:05.649040    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7h85\" (UniqueName: \"kubernetes.io/projected/c07c33a8-1120-475d-80c1-b6106257742c-kube-api-access-v7h85\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:06.295042 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:06.295014    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"
Jul 02 22:15:06.295234 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:06.295041    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54" event={"ID":"c07c33a8-1120-475d-80c1-b6106257742c","Type":"ContainerDied","Data":"087990e398d16d4c6e5c87a9bbaff5a9580a26b22657f1e0412d51ee6e55105b"}
Jul 02 22:15:06.295234 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:06.295083    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="087990e398d16d4c6e5c87a9bbaff5a9580a26b22657f1e0412d51ee6e55105b"
Jul 02 22:15:12.443884 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.443849    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69" podUID="b2404022-1017-448a-92ca-f992294b30b2" containerName="main" containerID="cri-o://07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b" gracePeriod=45
Jul 02 22:15:12.582634 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.582608    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:12.582747 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.582657    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:12.596097 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.596074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:12.706022 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.705967    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:15:12.819120 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819086    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-dshm\") pod \"b2404022-1017-448a-92ca-f992294b30b2\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") "
Jul 02 22:15:12.819120 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819124    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2404022-1017-448a-92ca-f992294b30b2-tls-certs\") pod \"b2404022-1017-448a-92ca-f992294b30b2\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") "
Jul 02 22:15:12.819387 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819221    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-home\") pod \"b2404022-1017-448a-92ca-f992294b30b2\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") "
Jul 02 22:15:12.819387 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819252    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-tmp-dir\") pod \"b2404022-1017-448a-92ca-f992294b30b2\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") "
Jul 02 22:15:12.819387 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819271    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bscj6\" (UniqueName: \"kubernetes.io/projected/b2404022-1017-448a-92ca-f992294b30b2-kube-api-access-bscj6\") pod \"b2404022-1017-448a-92ca-f992294b30b2\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") "
Jul 02 22:15:12.819387 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819321    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-model-cache\") pod \"b2404022-1017-448a-92ca-f992294b30b2\" (UID: \"b2404022-1017-448a-92ca-f992294b30b2\") "
Jul 02 22:15:12.819613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819493    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-home" (OuterVolumeSpecName: "home") pod "b2404022-1017-448a-92ca-f992294b30b2" (UID: "b2404022-1017-448a-92ca-f992294b30b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:12.819613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819571    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2404022-1017-448a-92ca-f992294b30b2" (UID: "b2404022-1017-448a-92ca-f992294b30b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:12.819613 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819583    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2404022-1017-448a-92ca-f992294b30b2" (UID: "b2404022-1017-448a-92ca-f992294b30b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:12.819755 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.819655    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:12.821342 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.821316    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2404022-1017-448a-92ca-f992294b30b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2404022-1017-448a-92ca-f992294b30b2" (UID: "b2404022-1017-448a-92ca-f992294b30b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:15:12.821342 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.821330    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-dshm" (OuterVolumeSpecName: "dshm") pod "b2404022-1017-448a-92ca-f992294b30b2" (UID: "b2404022-1017-448a-92ca-f992294b30b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:12.821550 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.821365    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2404022-1017-448a-92ca-f992294b30b2-kube-api-access-bscj6" (OuterVolumeSpecName: "kube-api-access-bscj6") pod "b2404022-1017-448a-92ca-f992294b30b2" (UID: "b2404022-1017-448a-92ca-f992294b30b2"). InnerVolumeSpecName "kube-api-access-bscj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:15:12.920245 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.920214    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:12.920245 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.920241    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:12.920395 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.920254    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2404022-1017-448a-92ca-f992294b30b2-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:12.920395 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.920264    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2404022-1017-448a-92ca-f992294b30b2-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:12.920395 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:12.920277    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bscj6\" (UniqueName: \"kubernetes.io/projected/b2404022-1017-448a-92ca-f992294b30b2-kube-api-access-bscj6\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:13.291738 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.291676    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5" podUID="8bf68f1e-7e7b-441c-9c64-9ab47cd30269" containerName="main" containerID="cri-o://8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc" gracePeriod=45
Jul 02 22:15:13.336443 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.336408    2571 generic.go:356] "Generic (PLEG): container finished" podID="b2404022-1017-448a-92ca-f992294b30b2" containerID="07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b" exitCode=0
Jul 02 22:15:13.336559 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.336449    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"
Jul 02 22:15:13.336559 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.336493    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69" event={"ID":"b2404022-1017-448a-92ca-f992294b30b2","Type":"ContainerDied","Data":"07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b"}
Jul 02 22:15:13.336559 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.336555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69" event={"ID":"b2404022-1017-448a-92ca-f992294b30b2","Type":"ContainerDied","Data":"a66979dab8dd8a171f5f2a6e1b1053c9b2a7cfb7e58c3b12bf24b4c7ab24d0e5"}
Jul 02 22:15:13.336735 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.336584    2571 scope.go:117] "RemoveContainer" containerID="07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b"
Jul 02 22:15:13.348422 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.348396    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:15:13.400120 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.400083    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"]
Jul 02 22:15:13.405573 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.405548    2571 scope.go:117] "RemoveContainer" containerID="07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b"
Jul 02 22:15:13.405921 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:15:13.405887    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b\": container with ID starting with 07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b not found: ID does not exist" containerID="07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b"
Jul 02 22:15:13.406029 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.405926    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b"} err="failed to get container status \"07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b\": rpc error: code = NotFound desc = could not find container \"07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b\": container with ID starting with 07402f7e079bfc15cd3cad7274bc4e607a03744e5b1cc72efb3de1b67cf8fe6b not found: ID does not exist"
Jul 02 22:15:13.407459 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.407438    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/sub-test-model-edb549-kserve-5d7d69b445-gnz69"]
Jul 02 22:15:13.561878 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.561804    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:15:13.615582 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.615546    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2404022-1017-448a-92ca-f992294b30b2" path="/var/lib/kubelet/pods/b2404022-1017-448a-92ca-f992294b30b2/volumes"
Jul 02 22:15:13.727330 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727300    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plbzb\" (UniqueName: \"kubernetes.io/projected/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-kube-api-access-plbzb\") pod \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") "
Jul 02 22:15:13.727500 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727348    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-dshm\") pod \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") "
Jul 02 22:15:13.727500 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727470    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tmp-dir\") pod \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") "
Jul 02 22:15:13.727598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727512    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tls-certs\") pod \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") "
Jul 02 22:15:13.727598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727544    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-model-cache\") pod \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") "
Jul 02 22:15:13.727598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727574    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-home\") pod \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\" (UID: \"8bf68f1e-7e7b-441c-9c64-9ab47cd30269\") "
Jul 02 22:15:13.727764 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727683    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8bf68f1e-7e7b-441c-9c64-9ab47cd30269" (UID: "8bf68f1e-7e7b-441c-9c64-9ab47cd30269"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:13.727917 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727882    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-model-cache" (OuterVolumeSpecName: "model-cache") pod "8bf68f1e-7e7b-441c-9c64-9ab47cd30269" (UID: "8bf68f1e-7e7b-441c-9c64-9ab47cd30269"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:13.727917 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.727897    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-home" (OuterVolumeSpecName: "home") pod "8bf68f1e-7e7b-441c-9c64-9ab47cd30269" (UID: "8bf68f1e-7e7b-441c-9c64-9ab47cd30269"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:13.728149 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.728088    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:13.728149 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.728114    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:13.728149 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.728128    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:13.729662 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.729638    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-dshm" (OuterVolumeSpecName: "dshm") pod "8bf68f1e-7e7b-441c-9c64-9ab47cd30269" (UID: "8bf68f1e-7e7b-441c-9c64-9ab47cd30269"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:15:13.729766 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.729703    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-kube-api-access-plbzb" (OuterVolumeSpecName: "kube-api-access-plbzb") pod "8bf68f1e-7e7b-441c-9c64-9ab47cd30269" (UID: "8bf68f1e-7e7b-441c-9c64-9ab47cd30269"). InnerVolumeSpecName "kube-api-access-plbzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:15:13.729766 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.729729    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8bf68f1e-7e7b-441c-9c64-9ab47cd30269" (UID: "8bf68f1e-7e7b-441c-9c64-9ab47cd30269"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:15:13.829222 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.829193    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:13.829222 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.829218    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plbzb\" (UniqueName: \"kubernetes.io/projected/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-kube-api-access-plbzb\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:13.829222 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:13.829229    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bf68f1e-7e7b-441c-9c64-9ab47cd30269-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:15:14.343546 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.343516    2571 generic.go:356] "Generic (PLEG): container finished" podID="8bf68f1e-7e7b-441c-9c64-9ab47cd30269" containerID="8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc" exitCode=0
Jul 02 22:15:14.343716 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.343572    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"
Jul 02 22:15:14.343716 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.343599    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5" event={"ID":"8bf68f1e-7e7b-441c-9c64-9ab47cd30269","Type":"ContainerDied","Data":"8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc"}
Jul 02 22:15:14.343716 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.343650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5" event={"ID":"8bf68f1e-7e7b-441c-9c64-9ab47cd30269","Type":"ContainerDied","Data":"62301ed05f3e149f31a368624783333a53ad83a504483e578971a84c1049755a"}
Jul 02 22:15:14.343716 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.343672    2571 scope.go:117] "RemoveContainer" containerID="8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc"
Jul 02 22:15:14.353068 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.353050    2571 scope.go:117] "RemoveContainer" containerID="8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc"
Jul 02 22:15:14.353324 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:15:14.353307    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc\": container with ID starting with 8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc not found: ID does not exist" containerID="8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc"
Jul 02 22:15:14.353374 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.353333    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc"} err="failed to get container status \"8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc\": rpc error: code = NotFound desc = could not find container \"8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc\": container with ID starting with 8ca21872c5a26c8347545bf08d1f55082a846fbae52a92e58bc931581fa535dc not found: ID does not exist"
Jul 02 22:15:14.381024 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.380996    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"]
Jul 02 22:15:14.384388 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:14.384367    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/sub-test-model-f2a709-kserve-5d45788d5c-nq8p5"]
Jul 02 22:15:15.612004 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:15.611972    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf68f1e-7e7b-441c-9c64-9ab47cd30269" path="/var/lib/kubelet/pods/8bf68f1e-7e7b-441c-9c64-9ab47cd30269/volumes"
Jul 02 22:15:34.791637 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.791605    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"]
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.791975    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2404022-1017-448a-92ca-f992294b30b2" containerName="main"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.791987    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2404022-1017-448a-92ca-f992294b30b2" containerName="main"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.791996    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07c33a8-1120-475d-80c1-b6106257742c" containerName="cleanup"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.792001    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07c33a8-1120-475d-80c1-b6106257742c" containerName="cleanup"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.792014    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf68f1e-7e7b-441c-9c64-9ab47cd30269" containerName="main"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.792020    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf68f1e-7e7b-441c-9c64-9ab47cd30269" containerName="main"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.792088    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bf68f1e-7e7b-441c-9c64-9ab47cd30269" containerName="main"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.792098    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2404022-1017-448a-92ca-f992294b30b2" containerName="main"
Jul 02 22:15:34.792113 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.792105    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c07c33a8-1120-475d-80c1-b6106257742c" containerName="cleanup"
Jul 02 22:15:34.795186 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.795147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.798282 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.798260    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"kube-root-ca.crt\""
Jul 02 22:15:34.799147 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.799128    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"default-dockercfg-9h8c8\""
Jul 02 22:15:34.799331 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.799312    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"openshift-service-ca.crt\""
Jul 02 22:15:34.799409 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.799355    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2a709\"/\"rate-test-model-f2a709-kserve-self-signed-certs\""
Jul 02 22:15:34.811837 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.811811    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"]
Jul 02 22:15:34.832619 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.832592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-model-cache\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.832737 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.832646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-home\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.832737 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.832716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-tmp-dir\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.832812 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.832778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264aed47-dc12-4aa8-8b19-348e3e165d2c-tls-certs\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.832847 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.832830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7w6\" (UniqueName: \"kubernetes.io/projected/264aed47-dc12-4aa8-8b19-348e3e165d2c-kube-api-access-pj7w6\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.832895 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.832883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-dshm\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934273 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264aed47-dc12-4aa8-8b19-348e3e165d2c-tls-certs\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934439 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934292    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7w6\" (UniqueName: \"kubernetes.io/projected/264aed47-dc12-4aa8-8b19-348e3e165d2c-kube-api-access-pj7w6\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934439 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-dshm\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934439 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-model-cache\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934593 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-home\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934593 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-tmp-dir\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934829 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934808    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-model-cache\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934909 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934832    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-home\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.934909 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.934863    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-tmp-dir\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.937070 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.937045    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-dshm\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.937233 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.937216    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264aed47-dc12-4aa8-8b19-348e3e165d2c-tls-certs\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:34.944599 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:34.944582    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7w6\" (UniqueName: \"kubernetes.io/projected/264aed47-dc12-4aa8-8b19-348e3e165d2c-kube-api-access-pj7w6\") pod \"rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") " pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:35.106214 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:35.106176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:35.246216 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:35.246185    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"]
Jul 02 22:15:35.248017 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:15:35.247989    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod264aed47_dc12_4aa8_8b19_348e3e165d2c.slice/crio-bd0dea07f505bd6d2c5bfd2f1d019586f0a151643839469d5b2feebcc2fe718b WatchSource:0}: Error finding container bd0dea07f505bd6d2c5bfd2f1d019586f0a151643839469d5b2feebcc2fe718b: Status 404 returned error can't find the container with id bd0dea07f505bd6d2c5bfd2f1d019586f0a151643839469d5b2feebcc2fe718b
Jul 02 22:15:35.464987 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:35.464905    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm" event={"ID":"264aed47-dc12-4aa8-8b19-348e3e165d2c","Type":"ContainerStarted","Data":"1320f0f4aa3135d0818e51f7ca48e03d0f830a44f02e95169e756697ab449a67"}
Jul 02 22:15:35.464987 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:35.464950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm" event={"ID":"264aed47-dc12-4aa8-8b19-348e3e165d2c","Type":"ContainerStarted","Data":"bd0dea07f505bd6d2c5bfd2f1d019586f0a151643839469d5b2feebcc2fe718b"}
Jul 02 22:15:35.486458 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:35.486410    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm" podStartSLOduration=1.486395151 podStartE2EDuration="1.486395151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:15:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:15:35.484547491 +0000 UTC m=+2374.482467547" watchObservedRunningTime="2026-07-02 22:15:35.486395151 +0000 UTC m=+2374.484315205"
Jul 02 22:15:45.107081 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:45.107045    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:45.107081 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:45.107089    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:45.119470 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:45.119441    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:15:45.532406 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:15:45.532376    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:16:01.709928 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:01.709899    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:16:01.720079 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:01.720043    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:16:27.830798 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:27.830719    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"]
Jul 02 22:16:28.640227 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:28.640193    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"]
Jul 02 22:16:29.586367 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.586333    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559406958496"]
Jul 02 22:16:29.589487 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.589471    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:29.592142 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.592117    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d2w6w\""
Jul 02 22:16:29.599008 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.598986    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958496"]
Jul 02 22:16:29.646530 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.646503    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9dgm\" (UniqueName: \"kubernetes.io/projected/e4233d15-77f5-4a16-bf25-3ea461ee6ac1-kube-api-access-t9dgm\") pod \"test-curl-7398-140559406958496\" (UID: \"e4233d15-77f5-4a16-bf25-3ea461ee6ac1\") " pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:29.747012 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.746970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9dgm\" (UniqueName: \"kubernetes.io/projected/e4233d15-77f5-4a16-bf25-3ea461ee6ac1-kube-api-access-t9dgm\") pod \"test-curl-7398-140559406958496\" (UID: \"e4233d15-77f5-4a16-bf25-3ea461ee6ac1\") " pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:29.755940 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.755912    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9dgm\" (UniqueName: \"kubernetes.io/projected/e4233d15-77f5-4a16-bf25-3ea461ee6ac1-kube-api-access-t9dgm\") pod \"test-curl-7398-140559406958496\" (UID: \"e4233d15-77f5-4a16-bf25-3ea461ee6ac1\") " pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:29.900036 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:29.899945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:30.044177 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:30.044059    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958496"]
Jul 02 22:16:30.046947 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:30.046914    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4233d15_77f5_4a16_bf25_3ea461ee6ac1.slice/crio-b1bfa8400f4720113c46e6dbc09bcb49c169837e6fd49c43b7416f6eb544eead WatchSource:0}: Error finding container b1bfa8400f4720113c46e6dbc09bcb49c169837e6fd49c43b7416f6eb544eead: Status 404 returned error can't find the container with id b1bfa8400f4720113c46e6dbc09bcb49c169837e6fd49c43b7416f6eb544eead
Jul 02 22:16:30.778292 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:30.778264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958496" event={"ID":"e4233d15-77f5-4a16-bf25-3ea461ee6ac1","Type":"ContainerStarted","Data":"b1bfa8400f4720113c46e6dbc09bcb49c169837e6fd49c43b7416f6eb544eead"}
Jul 02 22:16:31.784452 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:31.784417    2571 generic.go:356] "Generic (PLEG): container finished" podID="e4233d15-77f5-4a16-bf25-3ea461ee6ac1" containerID="1f2a53c099c4919290bdf4627e9239d53dd01aa0cb9340de6a13a3d8077f76c2" exitCode=0
Jul 02 22:16:31.784885 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:31.784503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958496" event={"ID":"e4233d15-77f5-4a16-bf25-3ea461ee6ac1","Type":"ContainerDied","Data":"1f2a53c099c4919290bdf4627e9239d53dd01aa0cb9340de6a13a3d8077f76c2"}
Jul 02 22:16:32.927616 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:32.927589    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:32.967603 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:32.967570    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559406958496_e4233d15-77f5-4a16-bf25-3ea461ee6ac1/test-curl-7398-140559406958496/0.log"
Jul 02 22:16:32.996013 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:32.995983    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559406958496"]
Jul 02 22:16:32.998301 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:32.998281    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559406958496"]
Jul 02 22:16:33.077458 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.077431    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9dgm\" (UniqueName: \"kubernetes.io/projected/e4233d15-77f5-4a16-bf25-3ea461ee6ac1-kube-api-access-t9dgm\") pod \"e4233d15-77f5-4a16-bf25-3ea461ee6ac1\" (UID: \"e4233d15-77f5-4a16-bf25-3ea461ee6ac1\") "
Jul 02 22:16:33.079573 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.079548    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4233d15-77f5-4a16-bf25-3ea461ee6ac1-kube-api-access-t9dgm" (OuterVolumeSpecName: "kube-api-access-t9dgm") pod "e4233d15-77f5-4a16-bf25-3ea461ee6ac1" (UID: "e4233d15-77f5-4a16-bf25-3ea461ee6ac1"). InnerVolumeSpecName "kube-api-access-t9dgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:33.118221 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.118188    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559406958720"]
Jul 02 22:16:33.118602 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.118588    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4233d15-77f5-4a16-bf25-3ea461ee6ac1" containerName="test-curl-7398-140559406958496"
Jul 02 22:16:33.118654 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.118604    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4233d15-77f5-4a16-bf25-3ea461ee6ac1" containerName="test-curl-7398-140559406958496"
Jul 02 22:16:33.118699 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.118690    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4233d15-77f5-4a16-bf25-3ea461ee6ac1" containerName="test-curl-7398-140559406958496"
Jul 02 22:16:33.121651 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.121635    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:33.126617 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.126593    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958720"]
Jul 02 22:16:33.178940 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.178910    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9dgm\" (UniqueName: \"kubernetes.io/projected/e4233d15-77f5-4a16-bf25-3ea461ee6ac1-kube-api-access-t9dgm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:33.279972 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.279943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2rrf\" (UniqueName: \"kubernetes.io/projected/61f6684c-9aa8-4f40-a220-2bfe43470426-kube-api-access-w2rrf\") pod \"test-curl-7398-140559406958720\" (UID: \"61f6684c-9aa8-4f40-a220-2bfe43470426\") " pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:33.381081 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.381004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2rrf\" (UniqueName: \"kubernetes.io/projected/61f6684c-9aa8-4f40-a220-2bfe43470426-kube-api-access-w2rrf\") pod \"test-curl-7398-140559406958720\" (UID: \"61f6684c-9aa8-4f40-a220-2bfe43470426\") " pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:33.390192 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.390149    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2rrf\" (UniqueName: \"kubernetes.io/projected/61f6684c-9aa8-4f40-a220-2bfe43470426-kube-api-access-w2rrf\") pod \"test-curl-7398-140559406958720\" (UID: \"61f6684c-9aa8-4f40-a220-2bfe43470426\") " pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:33.432707 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.432676    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:33.572214 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:33.572188    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61f6684c_9aa8_4f40_a220_2bfe43470426.slice/crio-5ef3843351766546c3f87fa7d1d27852b290de05a4bb00a3164cdf2051fde298 WatchSource:0}: Error finding container 5ef3843351766546c3f87fa7d1d27852b290de05a4bb00a3164cdf2051fde298: Status 404 returned error can't find the container with id 5ef3843351766546c3f87fa7d1d27852b290de05a4bb00a3164cdf2051fde298
Jul 02 22:16:33.572341 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.572220    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958720"]
Jul 02 22:16:33.612437 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.612406    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4233d15-77f5-4a16-bf25-3ea461ee6ac1" path="/var/lib/kubelet/pods/e4233d15-77f5-4a16-bf25-3ea461ee6ac1/volumes"
Jul 02 22:16:33.796207 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.796098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958720" event={"ID":"61f6684c-9aa8-4f40-a220-2bfe43470426","Type":"ContainerStarted","Data":"5ef3843351766546c3f87fa7d1d27852b290de05a4bb00a3164cdf2051fde298"}
Jul 02 22:16:33.797422 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.797402    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958496"
Jul 02 22:16:33.797565 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:33.797424    2571 scope.go:117] "RemoveContainer" containerID="1f2a53c099c4919290bdf4627e9239d53dd01aa0cb9340de6a13a3d8077f76c2"
Jul 02 22:16:34.804453 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:34.804418    2571 generic.go:356] "Generic (PLEG): container finished" podID="61f6684c-9aa8-4f40-a220-2bfe43470426" containerID="e4a4d59673dbcd1bd2245cd1c38ad2cedd4d6354d443b8bca555873dffb5500c" exitCode=0
Jul 02 22:16:34.804898 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:34.804505    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958720" event={"ID":"61f6684c-9aa8-4f40-a220-2bfe43470426","Type":"ContainerDied","Data":"e4a4d59673dbcd1bd2245cd1c38ad2cedd4d6354d443b8bca555873dffb5500c"}
Jul 02 22:16:35.948335 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:35.948308    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:35.969990 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:35.969969    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559406958720_61f6684c-9aa8-4f40-a220-2bfe43470426/test-curl-7398-140559406958720/0.log"
Jul 02 22:16:35.997857 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:35.997829    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559406958720"]
Jul 02 22:16:36.001552 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.001530    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559406958720"]
Jul 02 22:16:36.108532 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.108506    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2rrf\" (UniqueName: \"kubernetes.io/projected/61f6684c-9aa8-4f40-a220-2bfe43470426-kube-api-access-w2rrf\") pod \"61f6684c-9aa8-4f40-a220-2bfe43470426\" (UID: \"61f6684c-9aa8-4f40-a220-2bfe43470426\") "
Jul 02 22:16:36.110506 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.110487    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f6684c-9aa8-4f40-a220-2bfe43470426-kube-api-access-w2rrf" (OuterVolumeSpecName: "kube-api-access-w2rrf") pod "61f6684c-9aa8-4f40-a220-2bfe43470426" (UID: "61f6684c-9aa8-4f40-a220-2bfe43470426"). InnerVolumeSpecName "kube-api-access-w2rrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:36.127784 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.127760    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559406958832"]
Jul 02 22:16:36.128206 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.128189    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f6684c-9aa8-4f40-a220-2bfe43470426" containerName="test-curl-7398-140559406958720"
Jul 02 22:16:36.128293 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.128208    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f6684c-9aa8-4f40-a220-2bfe43470426" containerName="test-curl-7398-140559406958720"
Jul 02 22:16:36.128350 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.128339    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f6684c-9aa8-4f40-a220-2bfe43470426" containerName="test-curl-7398-140559406958720"
Jul 02 22:16:36.131300 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.131282    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:36.138609 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.138586    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958832"]
Jul 02 22:16:36.209793 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.209760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t2bt\" (UniqueName: \"kubernetes.io/projected/2acf0260-7d11-453f-b938-3ce5966697df-kube-api-access-7t2bt\") pod \"test-curl-7398-140559406958832\" (UID: \"2acf0260-7d11-453f-b938-3ce5966697df\") " pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:36.209954 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.209883    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2rrf\" (UniqueName: \"kubernetes.io/projected/61f6684c-9aa8-4f40-a220-2bfe43470426-kube-api-access-w2rrf\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:36.310547 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.310513    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t2bt\" (UniqueName: \"kubernetes.io/projected/2acf0260-7d11-453f-b938-3ce5966697df-kube-api-access-7t2bt\") pod \"test-curl-7398-140559406958832\" (UID: \"2acf0260-7d11-453f-b938-3ce5966697df\") " pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:36.320067 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.320039    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t2bt\" (UniqueName: \"kubernetes.io/projected/2acf0260-7d11-453f-b938-3ce5966697df-kube-api-access-7t2bt\") pod \"test-curl-7398-140559406958832\" (UID: \"2acf0260-7d11-453f-b938-3ce5966697df\") " pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:36.441685 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.441601    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:36.577912 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.577885    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958832"]
Jul 02 22:16:36.579462 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:36.579439    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2acf0260_7d11_453f_b938_3ce5966697df.slice/crio-ed4a3a958db1dcdd84378cc56575740707c4f1d80842c6a6d31604844849ffe5 WatchSource:0}: Error finding container ed4a3a958db1dcdd84378cc56575740707c4f1d80842c6a6d31604844849ffe5: Status 404 returned error can't find the container with id ed4a3a958db1dcdd84378cc56575740707c4f1d80842c6a6d31604844849ffe5
Jul 02 22:16:36.817210 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.817120    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:36.817210 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.817183    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ef3843351766546c3f87fa7d1d27852b290de05a4bb00a3164cdf2051fde298"
Jul 02 22:16:36.818460 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:36.818435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958832" event={"ID":"2acf0260-7d11-453f-b938-3ce5966697df","Type":"ContainerStarted","Data":"ed4a3a958db1dcdd84378cc56575740707c4f1d80842c6a6d31604844849ffe5"}
Jul 02 22:16:36.828056 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:16:36.828031    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7398-140559406958720\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="61f6684c-9aa8-4f40-a220-2bfe43470426" pod="opendatahub/test-curl-7398-140559406958720"
Jul 02 22:16:37.611828 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:37.611795    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61f6684c-9aa8-4f40-a220-2bfe43470426" path="/var/lib/kubelet/pods/61f6684c-9aa8-4f40-a220-2bfe43470426/volumes"
Jul 02 22:16:37.825123 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:37.825088    2571 generic.go:356] "Generic (PLEG): container finished" podID="2acf0260-7d11-453f-b938-3ce5966697df" containerID="f5d14a499ecef0dca01d9bfbe56ad7bd976e24d0d2e28ff7f04f7d8813df7651" exitCode=0
Jul 02 22:16:37.825287 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:37.825192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958832" event={"ID":"2acf0260-7d11-453f-b938-3ce5966697df","Type":"ContainerDied","Data":"f5d14a499ecef0dca01d9bfbe56ad7bd976e24d0d2e28ff7f04f7d8813df7651"}
Jul 02 22:16:38.963105 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:38.963082    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:38.987848 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:38.987821    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559406958832_2acf0260-7d11-453f-b938-3ce5966697df/test-curl-7398-140559406958832/0.log"
Jul 02 22:16:39.021933 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.021906    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559406958832"]
Jul 02 22:16:39.027665 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.027642    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559406958832"]
Jul 02 22:16:39.136830 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.136750    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t2bt\" (UniqueName: \"kubernetes.io/projected/2acf0260-7d11-453f-b938-3ce5966697df-kube-api-access-7t2bt\") pod \"2acf0260-7d11-453f-b938-3ce5966697df\" (UID: \"2acf0260-7d11-453f-b938-3ce5966697df\") "
Jul 02 22:16:39.138771 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.138741    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2acf0260-7d11-453f-b938-3ce5966697df-kube-api-access-7t2bt" (OuterVolumeSpecName: "kube-api-access-7t2bt") pod "2acf0260-7d11-453f-b938-3ce5966697df" (UID: "2acf0260-7d11-453f-b938-3ce5966697df"). InnerVolumeSpecName "kube-api-access-7t2bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:39.165757 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.165730    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559406958160"]
Jul 02 22:16:39.166149 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.166137    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2acf0260-7d11-453f-b938-3ce5966697df" containerName="test-curl-7398-140559406958832"
Jul 02 22:16:39.166215 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.166164    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2acf0260-7d11-453f-b938-3ce5966697df" containerName="test-curl-7398-140559406958832"
Jul 02 22:16:39.166249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.166230    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2acf0260-7d11-453f-b938-3ce5966697df" containerName="test-curl-7398-140559406958832"
Jul 02 22:16:39.168957 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.168942    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:39.178391 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.178366    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958160"]
Jul 02 22:16:39.237435 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.237403    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t2bt\" (UniqueName: \"kubernetes.io/projected/2acf0260-7d11-453f-b938-3ce5966697df-kube-api-access-7t2bt\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:39.338619 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.338582    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sklgq\" (UniqueName: \"kubernetes.io/projected/1740eba2-b783-45f4-9f0a-03fb7873f3b2-kube-api-access-sklgq\") pod \"test-curl-7398-140559406958160\" (UID: \"1740eba2-b783-45f4-9f0a-03fb7873f3b2\") " pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:39.440038 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.439952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sklgq\" (UniqueName: \"kubernetes.io/projected/1740eba2-b783-45f4-9f0a-03fb7873f3b2-kube-api-access-sklgq\") pod \"test-curl-7398-140559406958160\" (UID: \"1740eba2-b783-45f4-9f0a-03fb7873f3b2\") " pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:39.448727 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.448704    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sklgq\" (UniqueName: \"kubernetes.io/projected/1740eba2-b783-45f4-9f0a-03fb7873f3b2-kube-api-access-sklgq\") pod \"test-curl-7398-140559406958160\" (UID: \"1740eba2-b783-45f4-9f0a-03fb7873f3b2\") " pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:39.479363 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.479332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:39.612383 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.612191    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2acf0260-7d11-453f-b938-3ce5966697df" path="/var/lib/kubelet/pods/2acf0260-7d11-453f-b938-3ce5966697df/volumes"
Jul 02 22:16:39.615175 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.615141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406958160"]
Jul 02 22:16:39.616352 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:39.616325    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1740eba2_b783_45f4_9f0a_03fb7873f3b2.slice/crio-6d368740885e496295baa5f1574be1c8d732c7599ef1288f1c81d1af6611c214 WatchSource:0}: Error finding container 6d368740885e496295baa5f1574be1c8d732c7599ef1288f1c81d1af6611c214: Status 404 returned error can't find the container with id 6d368740885e496295baa5f1574be1c8d732c7599ef1288f1c81d1af6611c214
Jul 02 22:16:39.836924 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.836890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958160" event={"ID":"1740eba2-b783-45f4-9f0a-03fb7873f3b2","Type":"ContainerStarted","Data":"6d368740885e496295baa5f1574be1c8d732c7599ef1288f1c81d1af6611c214"}
Jul 02 22:16:39.838178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.838137    2571 scope.go:117] "RemoveContainer" containerID="f5d14a499ecef0dca01d9bfbe56ad7bd976e24d0d2e28ff7f04f7d8813df7651"
Jul 02 22:16:39.838302 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:39.838142    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958832"
Jul 02 22:16:40.845433 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:40.845397    2571 generic.go:356] "Generic (PLEG): container finished" podID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" containerID="14e335261398018ee9050fb7770f369bed0be291cc1bd87e05e0eae43be53f1e" exitCode=0
Jul 02 22:16:40.845815 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:40.845485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406958160" event={"ID":"1740eba2-b783-45f4-9f0a-03fb7873f3b2","Type":"ContainerDied","Data":"14e335261398018ee9050fb7770f369bed0be291cc1bd87e05e0eae43be53f1e"}
Jul 02 22:16:41.994184 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:41.994146    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:42.049991 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.049969    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559406958160_1740eba2-b783-45f4-9f0a-03fb7873f3b2/test-curl-7398-140559406958160/0.log"
Jul 02 22:16:42.093300 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.093268    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559406958160"]
Jul 02 22:16:42.098670 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.098646    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559406958160"]
Jul 02 22:16:42.163931 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.163855    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sklgq\" (UniqueName: \"kubernetes.io/projected/1740eba2-b783-45f4-9f0a-03fb7873f3b2-kube-api-access-sklgq\") pod \"1740eba2-b783-45f4-9f0a-03fb7873f3b2\" (UID: \"1740eba2-b783-45f4-9f0a-03fb7873f3b2\") "
Jul 02 22:16:42.165954 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.165928    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1740eba2-b783-45f4-9f0a-03fb7873f3b2-kube-api-access-sklgq" (OuterVolumeSpecName: "kube-api-access-sklgq") pod "1740eba2-b783-45f4-9f0a-03fb7873f3b2" (UID: "1740eba2-b783-45f4-9f0a-03fb7873f3b2"). InnerVolumeSpecName "kube-api-access-sklgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:42.264569 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.264544    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sklgq\" (UniqueName: \"kubernetes.io/projected/1740eba2-b783-45f4-9f0a-03fb7873f3b2-kube-api-access-sklgq\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:42.290614 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.290585    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559404699440"]
Jul 02 22:16:42.290971 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.290951    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" containerName="test-curl-7398-140559406958160"
Jul 02 22:16:42.291021 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.290974    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" containerName="test-curl-7398-140559406958160"
Jul 02 22:16:42.291059 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.291033    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" containerName="test-curl-7398-140559406958160"
Jul 02 22:16:42.293957 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.293944    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:42.316483 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.316460    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559404699440"]
Jul 02 22:16:42.466594 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.466512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg7zt\" (UniqueName: \"kubernetes.io/projected/7a63a7b1-93d4-4006-9982-ec2a096ad500-kube-api-access-zg7zt\") pod \"test-curl-7398-140559404699440\" (UID: \"7a63a7b1-93d4-4006-9982-ec2a096ad500\") " pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:42.567869 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.567837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg7zt\" (UniqueName: \"kubernetes.io/projected/7a63a7b1-93d4-4006-9982-ec2a096ad500-kube-api-access-zg7zt\") pod \"test-curl-7398-140559404699440\" (UID: \"7a63a7b1-93d4-4006-9982-ec2a096ad500\") " pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:42.576852 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.576824    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg7zt\" (UniqueName: \"kubernetes.io/projected/7a63a7b1-93d4-4006-9982-ec2a096ad500-kube-api-access-zg7zt\") pod \"test-curl-7398-140559404699440\" (UID: \"7a63a7b1-93d4-4006-9982-ec2a096ad500\") " pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:42.602835 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.602811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:42.743968 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.743882    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559404699440"]
Jul 02 22:16:42.750392 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:42.750364    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a63a7b1_93d4_4006_9982_ec2a096ad500.slice/crio-aff88f098827f0514918caeb87e083b257b6b7aaaaf9631f311208ea1877d728 WatchSource:0}: Error finding container aff88f098827f0514918caeb87e083b257b6b7aaaaf9631f311208ea1877d728: Status 404 returned error can't find the container with id aff88f098827f0514918caeb87e083b257b6b7aaaaf9631f311208ea1877d728
Jul 02 22:16:42.850524 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.850485    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm" podUID="456e4b71-94ed-4b61-a31e-310b70713edd" containerName="main" containerID="cri-o://0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8" gracePeriod=45
Jul 02 22:16:42.860061 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.860037    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:42.860061 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.860054    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d368740885e496295baa5f1574be1c8d732c7599ef1288f1c81d1af6611c214"
Jul 02 22:16:42.861336 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:42.861314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559404699440" event={"ID":"7a63a7b1-93d4-4006-9982-ec2a096ad500","Type":"ContainerStarted","Data":"aff88f098827f0514918caeb87e083b257b6b7aaaaf9631f311208ea1877d728"}
Jul 02 22:16:42.916921 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:16:42.916897    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7398-140559406958160\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:43.121533 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.121513    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:16:43.124368 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:16:43.124342    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7398-140559406958160\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" pod="opendatahub/test-curl-7398-140559406958160"
Jul 02 22:16:43.275559 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275489    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456e4b71-94ed-4b61-a31e-310b70713edd-tls-certs\") pod \"456e4b71-94ed-4b61-a31e-310b70713edd\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") "
Jul 02 22:16:43.275559 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275530    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-dshm\") pod \"456e4b71-94ed-4b61-a31e-310b70713edd\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") "
Jul 02 22:16:43.275724 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275563    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-model-cache\") pod \"456e4b71-94ed-4b61-a31e-310b70713edd\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") "
Jul 02 22:16:43.275724 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275673    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-tmp-dir\") pod \"456e4b71-94ed-4b61-a31e-310b70713edd\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") "
Jul 02 22:16:43.275803 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275764    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-model-cache" (OuterVolumeSpecName: "model-cache") pod "456e4b71-94ed-4b61-a31e-310b70713edd" (UID: "456e4b71-94ed-4b61-a31e-310b70713edd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:43.275803 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275781    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9tbf\" (UniqueName: \"kubernetes.io/projected/456e4b71-94ed-4b61-a31e-310b70713edd-kube-api-access-b9tbf\") pod \"456e4b71-94ed-4b61-a31e-310b70713edd\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") "
Jul 02 22:16:43.275893 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275841    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-home\") pod \"456e4b71-94ed-4b61-a31e-310b70713edd\" (UID: \"456e4b71-94ed-4b61-a31e-310b70713edd\") "
Jul 02 22:16:43.275950 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.275909    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "456e4b71-94ed-4b61-a31e-310b70713edd" (UID: "456e4b71-94ed-4b61-a31e-310b70713edd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:43.276099 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.276068    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-home" (OuterVolumeSpecName: "home") pod "456e4b71-94ed-4b61-a31e-310b70713edd" (UID: "456e4b71-94ed-4b61-a31e-310b70713edd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:43.276264 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.276246    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:43.276345 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.276266    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:43.276345 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.276294    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:43.277643 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.277618    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/456e4b71-94ed-4b61-a31e-310b70713edd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "456e4b71-94ed-4b61-a31e-310b70713edd" (UID: "456e4b71-94ed-4b61-a31e-310b70713edd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:16:43.277735 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.277620    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-dshm" (OuterVolumeSpecName: "dshm") pod "456e4b71-94ed-4b61-a31e-310b70713edd" (UID: "456e4b71-94ed-4b61-a31e-310b70713edd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:43.277735 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.277686    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/456e4b71-94ed-4b61-a31e-310b70713edd-kube-api-access-b9tbf" (OuterVolumeSpecName: "kube-api-access-b9tbf") pod "456e4b71-94ed-4b61-a31e-310b70713edd" (UID: "456e4b71-94ed-4b61-a31e-310b70713edd"). InnerVolumeSpecName "kube-api-access-b9tbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:43.377062 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.377037    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456e4b71-94ed-4b61-a31e-310b70713edd-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:43.377062 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.377059    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/456e4b71-94ed-4b61-a31e-310b70713edd-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:43.377233 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.377068    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9tbf\" (UniqueName: \"kubernetes.io/projected/456e4b71-94ed-4b61-a31e-310b70713edd-kube-api-access-b9tbf\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:43.612222 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.612196    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1740eba2-b783-45f4-9f0a-03fb7873f3b2" path="/var/lib/kubelet/pods/1740eba2-b783-45f4-9f0a-03fb7873f3b2/volumes"
Jul 02 22:16:43.659626 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.659586    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm" podUID="264aed47-dc12-4aa8-8b19-348e3e165d2c" containerName="main" containerID="cri-o://1320f0f4aa3135d0818e51f7ca48e03d0f830a44f02e95169e756697ab449a67" gracePeriod=45
Jul 02 22:16:43.870441 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.870373    2571 generic.go:356] "Generic (PLEG): container finished" podID="7a63a7b1-93d4-4006-9982-ec2a096ad500" containerID="aad3a1e5ff2fb02946cd8af641ce1c479331bd85a975a88760c336312d27e491" exitCode=6
Jul 02 22:16:43.870571 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.870454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559404699440" event={"ID":"7a63a7b1-93d4-4006-9982-ec2a096ad500","Type":"ContainerDied","Data":"aad3a1e5ff2fb02946cd8af641ce1c479331bd85a975a88760c336312d27e491"}
Jul 02 22:16:43.872197 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.872149    2571 generic.go:356] "Generic (PLEG): container finished" podID="264aed47-dc12-4aa8-8b19-348e3e165d2c" containerID="1320f0f4aa3135d0818e51f7ca48e03d0f830a44f02e95169e756697ab449a67" exitCode=0
Jul 02 22:16:43.872299 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.872195    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm" event={"ID":"264aed47-dc12-4aa8-8b19-348e3e165d2c","Type":"ContainerDied","Data":"1320f0f4aa3135d0818e51f7ca48e03d0f830a44f02e95169e756697ab449a67"}
Jul 02 22:16:43.873518 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.873497    2571 generic.go:356] "Generic (PLEG): container finished" podID="456e4b71-94ed-4b61-a31e-310b70713edd" containerID="0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8" exitCode=0
Jul 02 22:16:43.873609 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.873530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm" event={"ID":"456e4b71-94ed-4b61-a31e-310b70713edd","Type":"ContainerDied","Data":"0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8"}
Jul 02 22:16:43.873609 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.873538    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"
Jul 02 22:16:43.873609 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.873557    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm" event={"ID":"456e4b71-94ed-4b61-a31e-310b70713edd","Type":"ContainerDied","Data":"264c71048eb4bb9f622c637120919ed5cf6f419fc273961a310f1057d603f869"}
Jul 02 22:16:43.873609 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.873578    2571 scope.go:117] "RemoveContainer" containerID="0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8"
Jul 02 22:16:43.883685 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.883668    2571 scope.go:117] "RemoveContainer" containerID="0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8"
Jul 02 22:16:43.883956 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:16:43.883924    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8\": container with ID starting with 0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8 not found: ID does not exist" containerID="0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8"
Jul 02 22:16:43.884032 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.883958    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8"} err="failed to get container status \"0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8\": rpc error: code = NotFound desc = could not find container \"0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8\": container with ID starting with 0857a42a78411f75f56930c423b1a803e9c9ad31d18ffb2bb0b46c75681e6ad8 not found: ID does not exist"
Jul 02 22:16:43.900676 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.900656    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"]
Jul 02 22:16:43.908949 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.908922    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-edb549/rate-test-model-edb549-kserve-cc8cbf6dc-knzpm"]
Jul 02 22:16:43.910508 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:43.910493    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:16:44.085072 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085047    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-tmp-dir\") pod \"264aed47-dc12-4aa8-8b19-348e3e165d2c\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") "
Jul 02 22:16:44.085249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085085    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj7w6\" (UniqueName: \"kubernetes.io/projected/264aed47-dc12-4aa8-8b19-348e3e165d2c-kube-api-access-pj7w6\") pod \"264aed47-dc12-4aa8-8b19-348e3e165d2c\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") "
Jul 02 22:16:44.085249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085121    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-dshm\") pod \"264aed47-dc12-4aa8-8b19-348e3e165d2c\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") "
Jul 02 22:16:44.085249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085196    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264aed47-dc12-4aa8-8b19-348e3e165d2c-tls-certs\") pod \"264aed47-dc12-4aa8-8b19-348e3e165d2c\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") "
Jul 02 22:16:44.085249 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085234    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-model-cache\") pod \"264aed47-dc12-4aa8-8b19-348e3e165d2c\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") "
Jul 02 22:16:44.085478 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085291    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-home\") pod \"264aed47-dc12-4aa8-8b19-348e3e165d2c\" (UID: \"264aed47-dc12-4aa8-8b19-348e3e165d2c\") "
Jul 02 22:16:44.085478 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085381    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "264aed47-dc12-4aa8-8b19-348e3e165d2c" (UID: "264aed47-dc12-4aa8-8b19-348e3e165d2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:44.085596 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085557    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "264aed47-dc12-4aa8-8b19-348e3e165d2c" (UID: "264aed47-dc12-4aa8-8b19-348e3e165d2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:44.085596 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085570    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-home" (OuterVolumeSpecName: "home") pod "264aed47-dc12-4aa8-8b19-348e3e165d2c" (UID: "264aed47-dc12-4aa8-8b19-348e3e165d2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:44.085702 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.085637    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-tmp-dir\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:44.087299 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.087274    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-dshm" (OuterVolumeSpecName: "dshm") pod "264aed47-dc12-4aa8-8b19-348e3e165d2c" (UID: "264aed47-dc12-4aa8-8b19-348e3e165d2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 22:16:44.087379 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.087315    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/264aed47-dc12-4aa8-8b19-348e3e165d2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "264aed47-dc12-4aa8-8b19-348e3e165d2c" (UID: "264aed47-dc12-4aa8-8b19-348e3e165d2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:16:44.087379 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.087322    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264aed47-dc12-4aa8-8b19-348e3e165d2c-kube-api-access-pj7w6" (OuterVolumeSpecName: "kube-api-access-pj7w6") pod "264aed47-dc12-4aa8-8b19-348e3e165d2c" (UID: "264aed47-dc12-4aa8-8b19-348e3e165d2c"). InnerVolumeSpecName "kube-api-access-pj7w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:44.186825 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.186765    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264aed47-dc12-4aa8-8b19-348e3e165d2c-tls-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:44.186825 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.186787    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:44.186825 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.186795    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-home\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:44.186825 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.186803    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj7w6\" (UniqueName: \"kubernetes.io/projected/264aed47-dc12-4aa8-8b19-348e3e165d2c-kube-api-access-pj7w6\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:44.186825 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.186811    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264aed47-dc12-4aa8-8b19-348e3e165d2c-dshm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:44.880271 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.880248    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"
Jul 02 22:16:44.880434 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.880294    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm" event={"ID":"264aed47-dc12-4aa8-8b19-348e3e165d2c","Type":"ContainerDied","Data":"bd0dea07f505bd6d2c5bfd2f1d019586f0a151643839469d5b2feebcc2fe718b"}
Jul 02 22:16:44.880434 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.880348    2571 scope.go:117] "RemoveContainer" containerID="1320f0f4aa3135d0818e51f7ca48e03d0f830a44f02e95169e756697ab449a67"
Jul 02 22:16:44.903658 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.903627    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"]
Jul 02 22:16:44.907926 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:44.907902    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2a709/rate-test-model-f2a709-kserve-7d96dc5cc9-wgvxm"]
Jul 02 22:16:45.018292 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.018266    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:45.040549 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.040528    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559404699440_7a63a7b1-93d4-4006-9982-ec2a096ad500/test-curl-7398-140559404699440/0.log"
Jul 02 22:16:45.069276 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.069249    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559404699440"]
Jul 02 22:16:45.074390 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.074370    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559404699440"]
Jul 02 22:16:45.196026 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.195963    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg7zt\" (UniqueName: \"kubernetes.io/projected/7a63a7b1-93d4-4006-9982-ec2a096ad500-kube-api-access-zg7zt\") pod \"7a63a7b1-93d4-4006-9982-ec2a096ad500\" (UID: \"7a63a7b1-93d4-4006-9982-ec2a096ad500\") "
Jul 02 22:16:45.198083 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.198060    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a63a7b1-93d4-4006-9982-ec2a096ad500-kube-api-access-zg7zt" (OuterVolumeSpecName: "kube-api-access-zg7zt") pod "7a63a7b1-93d4-4006-9982-ec2a096ad500" (UID: "7a63a7b1-93d4-4006-9982-ec2a096ad500"). InnerVolumeSpecName "kube-api-access-zg7zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:45.276587 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.276553    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559406565296"]
Jul 02 22:16:45.276981 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.276964    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264aed47-dc12-4aa8-8b19-348e3e165d2c" containerName="main"
Jul 02 22:16:45.277053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.276983    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="264aed47-dc12-4aa8-8b19-348e3e165d2c" containerName="main"
Jul 02 22:16:45.277053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.276995    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a63a7b1-93d4-4006-9982-ec2a096ad500" containerName="test-curl-7398-140559404699440"
Jul 02 22:16:45.277053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.277004    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a63a7b1-93d4-4006-9982-ec2a096ad500" containerName="test-curl-7398-140559404699440"
Jul 02 22:16:45.277053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.277022    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="456e4b71-94ed-4b61-a31e-310b70713edd" containerName="main"
Jul 02 22:16:45.277053 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.277030    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="456e4b71-94ed-4b61-a31e-310b70713edd" containerName="main"
Jul 02 22:16:45.277332 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.277135    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a63a7b1-93d4-4006-9982-ec2a096ad500" containerName="test-curl-7398-140559404699440"
Jul 02 22:16:45.277332 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.277167    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="264aed47-dc12-4aa8-8b19-348e3e165d2c" containerName="main"
Jul 02 22:16:45.277332 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.277179    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="456e4b71-94ed-4b61-a31e-310b70713edd" containerName="main"
Jul 02 22:16:45.280388 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.280370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:45.289518 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.289497    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406565296"]
Jul 02 22:16:45.297022 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.296999    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg7zt\" (UniqueName: \"kubernetes.io/projected/7a63a7b1-93d4-4006-9982-ec2a096ad500-kube-api-access-zg7zt\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:45.398190 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.398144    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qqz\" (UniqueName: \"kubernetes.io/projected/113e7294-a063-4173-8378-3597734812bf-kube-api-access-r7qqz\") pod \"test-curl-7398-140559406565296\" (UID: \"113e7294-a063-4173-8378-3597734812bf\") " pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:45.499210 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.499179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qqz\" (UniqueName: \"kubernetes.io/projected/113e7294-a063-4173-8378-3597734812bf-kube-api-access-r7qqz\") pod \"test-curl-7398-140559406565296\" (UID: \"113e7294-a063-4173-8378-3597734812bf\") " pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:45.507775 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.507748    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qqz\" (UniqueName: \"kubernetes.io/projected/113e7294-a063-4173-8378-3597734812bf-kube-api-access-r7qqz\") pod \"test-curl-7398-140559406565296\" (UID: \"113e7294-a063-4173-8378-3597734812bf\") " pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:45.589896 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.589869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:45.613285 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.613257    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264aed47-dc12-4aa8-8b19-348e3e165d2c" path="/var/lib/kubelet/pods/264aed47-dc12-4aa8-8b19-348e3e165d2c/volumes"
Jul 02 22:16:45.613706 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.613689    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="456e4b71-94ed-4b61-a31e-310b70713edd" path="/var/lib/kubelet/pods/456e4b71-94ed-4b61-a31e-310b70713edd/volumes"
Jul 02 22:16:45.614026 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.614010    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a63a7b1-93d4-4006-9982-ec2a096ad500" path="/var/lib/kubelet/pods/7a63a7b1-93d4-4006-9982-ec2a096ad500/volumes"
Jul 02 22:16:45.726609 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:45.726579    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod113e7294_a063_4173_8378_3597734812bf.slice/crio-2e6ed1572ee0c96f8904215ea48142f74a42a6ed5d90d92188070ea379c00d25 WatchSource:0}: Error finding container 2e6ed1572ee0c96f8904215ea48142f74a42a6ed5d90d92188070ea379c00d25: Status 404 returned error can't find the container with id 2e6ed1572ee0c96f8904215ea48142f74a42a6ed5d90d92188070ea379c00d25
Jul 02 22:16:45.727082 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.727061    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406565296"]
Jul 02 22:16:45.887929 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.887900    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559404699440"
Jul 02 22:16:45.888073 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.887964    2571 scope.go:117] "RemoveContainer" containerID="aad3a1e5ff2fb02946cd8af641ce1c479331bd85a975a88760c336312d27e491"
Jul 02 22:16:45.890452 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:45.890424    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406565296" event={"ID":"113e7294-a063-4173-8378-3597734812bf","Type":"ContainerStarted","Data":"2e6ed1572ee0c96f8904215ea48142f74a42a6ed5d90d92188070ea379c00d25"}
Jul 02 22:16:46.897852 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:46.897814    2571 generic.go:356] "Generic (PLEG): container finished" podID="113e7294-a063-4173-8378-3597734812bf" containerID="2c4be15ad09b5d2bc349da62ecb96d18e97e65d6cbdcf8787ef843d1137f36eb" exitCode=6
Jul 02 22:16:46.898293 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:46.897900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406565296" event={"ID":"113e7294-a063-4173-8378-3597734812bf","Type":"ContainerDied","Data":"2c4be15ad09b5d2bc349da62ecb96d18e97e65d6cbdcf8787ef843d1137f36eb"}
Jul 02 22:16:48.040475 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.040449    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:48.062088 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.062064    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559406565296_113e7294-a063-4173-8378-3597734812bf/test-curl-7398-140559406565296/0.log"
Jul 02 22:16:48.090059 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.090032    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559406565296"]
Jul 02 22:16:48.094182 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.094147    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559406565296"]
Jul 02 22:16:48.120957 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.120937    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7qqz\" (UniqueName: \"kubernetes.io/projected/113e7294-a063-4173-8378-3597734812bf-kube-api-access-r7qqz\") pod \"113e7294-a063-4173-8378-3597734812bf\" (UID: \"113e7294-a063-4173-8378-3597734812bf\") "
Jul 02 22:16:48.122903 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.122885    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113e7294-a063-4173-8378-3597734812bf-kube-api-access-r7qqz" (OuterVolumeSpecName: "kube-api-access-r7qqz") pod "113e7294-a063-4173-8378-3597734812bf" (UID: "113e7294-a063-4173-8378-3597734812bf"). InnerVolumeSpecName "kube-api-access-r7qqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:48.221652 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.221594    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7qqz\" (UniqueName: \"kubernetes.io/projected/113e7294-a063-4173-8378-3597734812bf-kube-api-access-r7qqz\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:48.243164 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.243136    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559406564976"]
Jul 02 22:16:48.243555 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.243542    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113e7294-a063-4173-8378-3597734812bf" containerName="test-curl-7398-140559406565296"
Jul 02 22:16:48.243605 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.243557    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="113e7294-a063-4173-8378-3597734812bf" containerName="test-curl-7398-140559406565296"
Jul 02 22:16:48.243648 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.243614    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="113e7294-a063-4173-8378-3597734812bf" containerName="test-curl-7398-140559406565296"
Jul 02 22:16:48.247370 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.247353    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:48.254876 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.254850    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406564976"]
Jul 02 22:16:48.322481 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.322451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxcm\" (UniqueName: \"kubernetes.io/projected/b14ac84d-0867-40a1-a47f-6d4d04a6e204-kube-api-access-9cxcm\") pod \"test-curl-7398-140559406564976\" (UID: \"b14ac84d-0867-40a1-a47f-6d4d04a6e204\") " pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:48.423753 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.423717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxcm\" (UniqueName: \"kubernetes.io/projected/b14ac84d-0867-40a1-a47f-6d4d04a6e204-kube-api-access-9cxcm\") pod \"test-curl-7398-140559406564976\" (UID: \"b14ac84d-0867-40a1-a47f-6d4d04a6e204\") " pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:48.432305 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.432287    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxcm\" (UniqueName: \"kubernetes.io/projected/b14ac84d-0867-40a1-a47f-6d4d04a6e204-kube-api-access-9cxcm\") pod \"test-curl-7398-140559406564976\" (UID: \"b14ac84d-0867-40a1-a47f-6d4d04a6e204\") " pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:48.557585 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.557509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:48.696203 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.696181    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559406564976"]
Jul 02 22:16:48.697945 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:48.697914    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb14ac84d_0867_40a1_a47f_6d4d04a6e204.slice/crio-94a60e025de52f04f080f7e8ad17c5203fdea942252c8c46e4150e9c7a06f4cc WatchSource:0}: Error finding container 94a60e025de52f04f080f7e8ad17c5203fdea942252c8c46e4150e9c7a06f4cc: Status 404 returned error can't find the container with id 94a60e025de52f04f080f7e8ad17c5203fdea942252c8c46e4150e9c7a06f4cc
Jul 02 22:16:48.911628 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.911598    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406564976" event={"ID":"b14ac84d-0867-40a1-a47f-6d4d04a6e204","Type":"ContainerStarted","Data":"94a60e025de52f04f080f7e8ad17c5203fdea942252c8c46e4150e9c7a06f4cc"}
Jul 02 22:16:48.912793 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.912772    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:48.912793 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:48.912785    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e6ed1572ee0c96f8904215ea48142f74a42a6ed5d90d92188070ea379c00d25"
Jul 02 22:16:48.923189 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:16:48.923139    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7398-140559406565296\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="113e7294-a063-4173-8378-3597734812bf" pod="opendatahub/test-curl-7398-140559406565296"
Jul 02 22:16:49.612173 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:49.612131    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113e7294-a063-4173-8378-3597734812bf" path="/var/lib/kubelet/pods/113e7294-a063-4173-8378-3597734812bf/volumes"
Jul 02 22:16:49.919835 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:49.919749    2571 generic.go:356] "Generic (PLEG): container finished" podID="b14ac84d-0867-40a1-a47f-6d4d04a6e204" containerID="30cf0d7a4add90c7027727291c75dd3d4dd3b59a0426b7d36909bd90aabf12a7" exitCode=6
Jul 02 22:16:49.919980 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:49.919844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559406564976" event={"ID":"b14ac84d-0867-40a1-a47f-6d4d04a6e204","Type":"ContainerDied","Data":"30cf0d7a4add90c7027727291c75dd3d4dd3b59a0426b7d36909bd90aabf12a7"}
Jul 02 22:16:51.076697 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.076678    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:51.114499 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.114478    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559406564976_b14ac84d-0867-40a1-a47f-6d4d04a6e204/test-curl-7398-140559406564976/0.log"
Jul 02 22:16:51.140512 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.140478    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559406564976"]
Jul 02 22:16:51.146298 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.146270    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559406564976"]
Jul 02 22:16:51.149963 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.149947    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cxcm\" (UniqueName: \"kubernetes.io/projected/b14ac84d-0867-40a1-a47f-6d4d04a6e204-kube-api-access-9cxcm\") pod \"b14ac84d-0867-40a1-a47f-6d4d04a6e204\" (UID: \"b14ac84d-0867-40a1-a47f-6d4d04a6e204\") "
Jul 02 22:16:51.151962 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.151940    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14ac84d-0867-40a1-a47f-6d4d04a6e204-kube-api-access-9cxcm" (OuterVolumeSpecName: "kube-api-access-9cxcm") pod "b14ac84d-0867-40a1-a47f-6d4d04a6e204" (UID: "b14ac84d-0867-40a1-a47f-6d4d04a6e204"). InnerVolumeSpecName "kube-api-access-9cxcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:51.250683 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.250613    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cxcm\" (UniqueName: \"kubernetes.io/projected/b14ac84d-0867-40a1-a47f-6d4d04a6e204-kube-api-access-9cxcm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:51.279863 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.279836    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7398-140559409023856"]
Jul 02 22:16:51.280234 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.280221    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14ac84d-0867-40a1-a47f-6d4d04a6e204" containerName="test-curl-7398-140559406564976"
Jul 02 22:16:51.280274 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.280236    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14ac84d-0867-40a1-a47f-6d4d04a6e204" containerName="test-curl-7398-140559406564976"
Jul 02 22:16:51.280318 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.280307    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14ac84d-0867-40a1-a47f-6d4d04a6e204" containerName="test-curl-7398-140559406564976"
Jul 02 22:16:51.283330 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.283316    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:51.291840 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.291818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559409023856"]
Jul 02 22:16:51.351413 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.351377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq5sc\" (UniqueName: \"kubernetes.io/projected/8ec3f3ea-7618-4d3a-92d5-6ae09299e758-kube-api-access-dq5sc\") pod \"test-curl-7398-140559409023856\" (UID: \"8ec3f3ea-7618-4d3a-92d5-6ae09299e758\") " pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:51.452810 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.452779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq5sc\" (UniqueName: \"kubernetes.io/projected/8ec3f3ea-7618-4d3a-92d5-6ae09299e758-kube-api-access-dq5sc\") pod \"test-curl-7398-140559409023856\" (UID: \"8ec3f3ea-7618-4d3a-92d5-6ae09299e758\") " pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:51.461427 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.461404    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq5sc\" (UniqueName: \"kubernetes.io/projected/8ec3f3ea-7618-4d3a-92d5-6ae09299e758-kube-api-access-dq5sc\") pod \"test-curl-7398-140559409023856\" (UID: \"8ec3f3ea-7618-4d3a-92d5-6ae09299e758\") " pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:51.592877 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.592856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:51.623708 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.623679    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14ac84d-0867-40a1-a47f-6d4d04a6e204" path="/var/lib/kubelet/pods/b14ac84d-0867-40a1-a47f-6d4d04a6e204/volumes"
Jul 02 22:16:51.733130 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.733097    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7398-140559409023856"]
Jul 02 22:16:51.735405 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:16:51.735377    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ec3f3ea_7618_4d3a_92d5_6ae09299e758.slice/crio-832b2e54ebf9a710373fd63017fa692d5340fdd82e472bffe25e29eef7bc5c99 WatchSource:0}: Error finding container 832b2e54ebf9a710373fd63017fa692d5340fdd82e472bffe25e29eef7bc5c99: Status 404 returned error can't find the container with id 832b2e54ebf9a710373fd63017fa692d5340fdd82e472bffe25e29eef7bc5c99
Jul 02 22:16:51.932369 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.932290    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559406564976"
Jul 02 22:16:51.932513 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.932296    2571 scope.go:117] "RemoveContainer" containerID="30cf0d7a4add90c7027727291c75dd3d4dd3b59a0426b7d36909bd90aabf12a7"
Jul 02 22:16:51.933733 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:51.933565    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559409023856" event={"ID":"8ec3f3ea-7618-4d3a-92d5-6ae09299e758","Type":"ContainerStarted","Data":"832b2e54ebf9a710373fd63017fa692d5340fdd82e472bffe25e29eef7bc5c99"}
Jul 02 22:16:52.941817 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:52.941779    2571 generic.go:356] "Generic (PLEG): container finished" podID="8ec3f3ea-7618-4d3a-92d5-6ae09299e758" containerID="d2830037ee0271fba9ebaff4827360fd3887cf24f438938620bfca688dbf0852" exitCode=6
Jul 02 22:16:52.942211 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:52.941863    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7398-140559409023856" event={"ID":"8ec3f3ea-7618-4d3a-92d5-6ae09299e758","Type":"ContainerDied","Data":"d2830037ee0271fba9ebaff4827360fd3887cf24f438938620bfca688dbf0852"}
Jul 02 22:16:54.079124 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.079097    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:54.117693 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.117671    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7398-140559409023856_8ec3f3ea-7618-4d3a-92d5-6ae09299e758/test-curl-7398-140559409023856/0.log"
Jul 02 22:16:54.144879 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.144855    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7398-140559409023856"]
Jul 02 22:16:54.151861 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.151839    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7398-140559409023856"]
Jul 02 22:16:54.177877 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.177857    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq5sc\" (UniqueName: \"kubernetes.io/projected/8ec3f3ea-7618-4d3a-92d5-6ae09299e758-kube-api-access-dq5sc\") pod \"8ec3f3ea-7618-4d3a-92d5-6ae09299e758\" (UID: \"8ec3f3ea-7618-4d3a-92d5-6ae09299e758\") "
Jul 02 22:16:54.179950 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.179932    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec3f3ea-7618-4d3a-92d5-6ae09299e758-kube-api-access-dq5sc" (OuterVolumeSpecName: "kube-api-access-dq5sc") pod "8ec3f3ea-7618-4d3a-92d5-6ae09299e758" (UID: "8ec3f3ea-7618-4d3a-92d5-6ae09299e758"). InnerVolumeSpecName "kube-api-access-dq5sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:16:54.279236 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.279176    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq5sc\" (UniqueName: \"kubernetes.io/projected/8ec3f3ea-7618-4d3a-92d5-6ae09299e758-kube-api-access-dq5sc\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Jul 02 22:16:54.958087 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.958062    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:54.958250 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:54.958060    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="832b2e54ebf9a710373fd63017fa692d5340fdd82e472bffe25e29eef7bc5c99"
Jul 02 22:16:54.967928 ip-10-0-139-133 kubenswrapper[2571]: E0702 22:16:54.967901    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7398-140559409023856\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="8ec3f3ea-7618-4d3a-92d5-6ae09299e758" pod="opendatahub/test-curl-7398-140559409023856"
Jul 02 22:16:55.612116 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:16:55.612083    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec3f3ea-7618-4d3a-92d5-6ae09299e758" path="/var/lib/kubelet/pods/8ec3f3ea-7618-4d3a-92d5-6ae09299e758/volumes"
Jul 02 22:17:02.876203 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:02.876148    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"]
Jul 02 22:17:02.893561 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:02.893527    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2a709-29717175-gmj54"]
Jul 02 22:17:03.611750 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:03.611713    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c07c33a8-1120-475d-80c1-b6106257742c" path="/var/lib/kubelet/pods/c07c33a8-1120-475d-80c1-b6106257742c/volumes"
Jul 02 22:17:09.765363 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:09.765333    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84cddf8cb5-hhk86_29d18384-e2eb-4b62-b5bc-e9d5cc2723ab/authorino/0.log"
Jul 02 22:17:14.735145 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:14.735112    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64c6cb795c-5znwj_0051f3ef-f90d-44bf-a55c-68b8f19f745e/maas-api/0.log"
Jul 02 22:17:15.077649 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:15.077620    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-544f8c6b68-svbmh_a813305a-89e3-49ca-ac08-a2c999d98a00/manager/0.log"
Jul 02 22:17:15.556667 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:15.556591    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bcc4b86cc-8bhpd_f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5/copy-manifests/0.log"
Jul 02 22:17:15.580434 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:15.580404    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bcc4b86cc-8bhpd_f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5/manager/0.log"
Jul 02 22:17:16.628035 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.628006    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4_e1895ab2-d0f8-4477-b898-bb6e233c91a1/pull/0.log"
Jul 02 22:17:16.635117 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.635094    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4_e1895ab2-d0f8-4477-b898-bb6e233c91a1/extract/0.log"
Jul 02 22:17:16.644052 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.644035    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4_e1895ab2-d0f8-4477-b898-bb6e233c91a1/util/0.log"
Jul 02 22:17:16.755832 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.755809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2_b58cdfaa-bc61-4361-92a6-abe382e6468c/util/0.log"
Jul 02 22:17:16.762674 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.762651    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2_b58cdfaa-bc61-4361-92a6-abe382e6468c/pull/0.log"
Jul 02 22:17:16.769368 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.769344    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2_b58cdfaa-bc61-4361-92a6-abe382e6468c/extract/0.log"
Jul 02 22:17:16.888532 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.888462    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g_50b5b528-9141-4d5e-b6ee-c36472eb2360/util/0.log"
Jul 02 22:17:16.895679 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.895663    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g_50b5b528-9141-4d5e-b6ee-c36472eb2360/pull/0.log"
Jul 02 22:17:16.902211 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:16.902194    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g_50b5b528-9141-4d5e-b6ee-c36472eb2360/extract/0.log"
Jul 02 22:17:17.017485 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:17.017464    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9_df942e3b-7345-4a54-a141-f893f0583811/util/0.log"
Jul 02 22:17:17.023865 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:17.023847    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9_df942e3b-7345-4a54-a141-f893f0583811/pull/0.log"
Jul 02 22:17:17.030592 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:17.030576    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9_df942e3b-7345-4a54-a141-f893f0583811/extract/0.log"
Jul 02 22:17:17.146369 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:17.146313    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84cddf8cb5-hhk86_29d18384-e2eb-4b62-b5bc-e9d5cc2723ab/authorino/0.log"
Jul 02 22:17:17.523219 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:17.523137    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qfvp8_849d00b2-4b44-4392-8b24-8da5c3555cd4/kuadrant-console-plugin/0.log"
Jul 02 22:17:18.666808 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:18.666775    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697fd7f55-4cdr5_c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71/kube-auth-proxy/0.log"
Jul 02 22:17:19.026527 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:19.026454    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x6tm5_a94b006a-2613-48c1-8808-a8ee418961a0/payload-pre-processing/0.log"
Jul 02 22:17:19.254784 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:19.254756    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b98f7769-6nglb_7eb2a04b-cf88-4bce-8ead-1d077a6b8474/router/0.log"
Jul 02 22:17:19.745510 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:19.745480    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wr8q6_64ded87e-ad12-4b73-8bf4-c96427a3852e/main/0.log"
Jul 02 22:17:20.211026 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:20.210999    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qjt6h_a7253dbb-4779-44d9-8e8a-749a9dfe16d9/main/0.log"
Jul 02 22:17:24.266635 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.266605    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h24vs/must-gather-bpvlk"]
Jul 02 22:17:24.267037 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.266991    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec3f3ea-7618-4d3a-92d5-6ae09299e758" containerName="test-curl-7398-140559409023856"
Jul 02 22:17:24.267037 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.267003    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec3f3ea-7618-4d3a-92d5-6ae09299e758" containerName="test-curl-7398-140559409023856"
Jul 02 22:17:24.267126 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.267078    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec3f3ea-7618-4d3a-92d5-6ae09299e758" containerName="test-curl-7398-140559409023856"
Jul 02 22:17:24.271690 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.271671    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.274309 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.274288    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h24vs\"/\"openshift-service-ca.crt\""
Jul 02 22:17:24.274411 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.274372    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h24vs\"/\"default-dockercfg-6wgd7\""
Jul 02 22:17:24.275032 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.275013    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h24vs\"/\"kube-root-ca.crt\""
Jul 02 22:17:24.287562 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.287543    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h24vs/must-gather-bpvlk"]
Jul 02 22:17:24.442500 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.442470    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rgf9\" (UniqueName: \"kubernetes.io/projected/9fa7379a-dcc7-41e5-969f-ea748ba903d0-kube-api-access-5rgf9\") pod \"must-gather-bpvlk\" (UID: \"9fa7379a-dcc7-41e5-969f-ea748ba903d0\") " pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.442661 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.442521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fa7379a-dcc7-41e5-969f-ea748ba903d0-must-gather-output\") pod \"must-gather-bpvlk\" (UID: \"9fa7379a-dcc7-41e5-969f-ea748ba903d0\") " pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.543246 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.543176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rgf9\" (UniqueName: \"kubernetes.io/projected/9fa7379a-dcc7-41e5-969f-ea748ba903d0-kube-api-access-5rgf9\") pod \"must-gather-bpvlk\" (UID: \"9fa7379a-dcc7-41e5-969f-ea748ba903d0\") " pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.543246 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.543230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fa7379a-dcc7-41e5-969f-ea748ba903d0-must-gather-output\") pod \"must-gather-bpvlk\" (UID: \"9fa7379a-dcc7-41e5-969f-ea748ba903d0\") " pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.543556 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.543532    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fa7379a-dcc7-41e5-969f-ea748ba903d0-must-gather-output\") pod \"must-gather-bpvlk\" (UID: \"9fa7379a-dcc7-41e5-969f-ea748ba903d0\") " pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.552659 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.552627    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rgf9\" (UniqueName: \"kubernetes.io/projected/9fa7379a-dcc7-41e5-969f-ea748ba903d0-kube-api-access-5rgf9\") pod \"must-gather-bpvlk\" (UID: \"9fa7379a-dcc7-41e5-969f-ea748ba903d0\") " pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.580587 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.580564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h24vs/must-gather-bpvlk"
Jul 02 22:17:24.715811 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:24.715781    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h24vs/must-gather-bpvlk"]
Jul 02 22:17:24.717169 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:17:24.717130    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fa7379a_dcc7_41e5_969f_ea748ba903d0.slice/crio-5bc682b2bbeac908f6cb6ed408d14df167280b3c4e1f10ff1894d1d965d1c355 WatchSource:0}: Error finding container 5bc682b2bbeac908f6cb6ed408d14df167280b3c4e1f10ff1894d1d965d1c355: Status 404 returned error can't find the container with id 5bc682b2bbeac908f6cb6ed408d14df167280b3c4e1f10ff1894d1d965d1c355
Jul 02 22:17:25.132730 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:25.132697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h24vs/must-gather-bpvlk" event={"ID":"9fa7379a-dcc7-41e5-969f-ea748ba903d0","Type":"ContainerStarted","Data":"5bc682b2bbeac908f6cb6ed408d14df167280b3c4e1f10ff1894d1d965d1c355"}
Jul 02 22:17:26.142955 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:26.142911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h24vs/must-gather-bpvlk" event={"ID":"9fa7379a-dcc7-41e5-969f-ea748ba903d0","Type":"ContainerStarted","Data":"f5de36729bff6c31fb0a9217684b73d01d7f3598d3bdbd6b9ef873797e58cae3"}
Jul 02 22:17:26.143485 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:26.142981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h24vs/must-gather-bpvlk" event={"ID":"9fa7379a-dcc7-41e5-969f-ea748ba903d0","Type":"ContainerStarted","Data":"aea684a20b90351f23d2fe9719aaa68d8a46edc6421dfb34c17dcdaa5bfb0257"}
Jul 02 22:17:26.164534 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:26.164473    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h24vs/must-gather-bpvlk" podStartSLOduration=1.162991219 podStartE2EDuration="2.16445605s" totalImagesPullingTime="1.001464831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:17:26.163736529 +0000 UTC m=+2485.161656586" watchObservedRunningTime="2026-07-02 22:17:26.16445605 +0000 UTC m=+2485.162376104"
Jul 02 22:17:27.278560 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:27.278526    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6xm9s_47776b6a-6004-4f70-a8fc-9339ebba8a9c/global-pull-secret-syncer/0.log"
Jul 02 22:17:27.487629 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:27.487593    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rxwdf_241b0783-6b39-4256-a74a-91afbd1950f1/konnectivity-agent/0.log"
Jul 02 22:17:27.515178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:27.515122    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-133.ec2.internal_32ae2d495edd1c172f704b47a293daec/haproxy/0.log"
Jul 02 22:17:32.162990 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.162934    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4_e1895ab2-d0f8-4477-b898-bb6e233c91a1/extract/0.log"
Jul 02 22:17:32.196309 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.196278    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4_e1895ab2-d0f8-4477-b898-bb6e233c91a1/util/0.log"
Jul 02 22:17:32.219549 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.219519    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bzck4_e1895ab2-d0f8-4477-b898-bb6e233c91a1/pull/0.log"
Jul 02 22:17:32.268114 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.267937    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2_b58cdfaa-bc61-4361-92a6-abe382e6468c/extract/0.log"
Jul 02 22:17:32.316689 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.316658    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2_b58cdfaa-bc61-4361-92a6-abe382e6468c/util/0.log"
Jul 02 22:17:32.345549 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.345516    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fjxv2_b58cdfaa-bc61-4361-92a6-abe382e6468c/pull/0.log"
Jul 02 22:17:32.388119 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.388071    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g_50b5b528-9141-4d5e-b6ee-c36472eb2360/extract/0.log"
Jul 02 22:17:32.416624 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.416543    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g_50b5b528-9141-4d5e-b6ee-c36472eb2360/util/0.log"
Jul 02 22:17:32.443049 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.443021    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wnh9g_50b5b528-9141-4d5e-b6ee-c36472eb2360/pull/0.log"
Jul 02 22:17:32.477129 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.477094    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9_df942e3b-7345-4a54-a141-f893f0583811/extract/0.log"
Jul 02 22:17:32.507447 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.507413    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9_df942e3b-7345-4a54-a141-f893f0583811/util/0.log"
Jul 02 22:17:32.534144 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.534115    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1262h9_df942e3b-7345-4a54-a141-f893f0583811/pull/0.log"
Jul 02 22:17:32.910178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.909922    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84cddf8cb5-hhk86_29d18384-e2eb-4b62-b5bc-e9d5cc2723ab/authorino/0.log"
Jul 02 22:17:32.992690 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:32.992660    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qfvp8_849d00b2-4b44-4392-8b24-8da5c3555cd4/kuadrant-console-plugin/0.log"
Jul 02 22:17:34.979951 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:34.979925    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/alertmanager/0.log"
Jul 02 22:17:35.018542 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.018509    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/config-reloader/0.log"
Jul 02 22:17:35.047312 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.047254    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/kube-rbac-proxy-web/0.log"
Jul 02 22:17:35.084346 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.084315    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/kube-rbac-proxy/0.log"
Jul 02 22:17:35.125000 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.124975    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/kube-rbac-proxy-metric/0.log"
Jul 02 22:17:35.162588 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.162561    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/prom-label-proxy/0.log"
Jul 02 22:17:35.202753 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.202694    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cb894ca-5ba4-407a-bfe3-6060433b3212/init-config-reloader/0.log"
Jul 02 22:17:35.265402 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.265285    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-j8zkd_1da23408-506e-47cc-841d-c449810a2b17/cluster-monitoring-operator/0.log"
Jul 02 22:17:35.309011 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.308983    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-j6cck_bafa2f8c-32b7-4d3b-81be-009c8b116360/kube-state-metrics/0.log"
Jul 02 22:17:35.343917 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.343882    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-j6cck_bafa2f8c-32b7-4d3b-81be-009c8b116360/kube-rbac-proxy-main/0.log"
Jul 02 22:17:35.374899 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.374872    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-j6cck_bafa2f8c-32b7-4d3b-81be-009c8b116360/kube-rbac-proxy-self/0.log"
Jul 02 22:17:35.414744 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.414710    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dcdb95d79-kbmll_8e9d433a-b1c2-445a-b607-7b6770a02503/metrics-server/0.log"
Jul 02 22:17:35.506209 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.506169    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v472_2a6a7fbc-96bc-49d6-a458-1e38bc14989b/node-exporter/0.log"
Jul 02 22:17:35.540954 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.540877    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v472_2a6a7fbc-96bc-49d6-a458-1e38bc14989b/kube-rbac-proxy/0.log"
Jul 02 22:17:35.577697 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:35.577668    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v472_2a6a7fbc-96bc-49d6-a458-1e38bc14989b/init-textfile/0.log"
Jul 02 22:17:36.368024 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:36.367995    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c777f7f88-2sbfh_3366c98c-1305-4c5c-9bc3-3dc113aa4a00/telemeter-client/0.log"
Jul 02 22:17:36.401118 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:36.401093    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c777f7f88-2sbfh_3366c98c-1305-4c5c-9bc3-3dc113aa4a00/reload/0.log"
Jul 02 22:17:36.424725 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:36.424691    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c777f7f88-2sbfh_3366c98c-1305-4c5c-9bc3-3dc113aa4a00/kube-rbac-proxy/0.log"
Jul 02 22:17:37.074430 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.074397    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"]
Jul 02 22:17:37.080083 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.080058    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.088835 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.088810    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"]
Jul 02 22:17:37.191178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.190687    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-sys\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.191178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.190771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-podres\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.191178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.190800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-proc\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.191178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.190853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-lib-modules\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.191178 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.190885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4n7g\" (UniqueName: \"kubernetes.io/projected/920e86a7-8f66-4603-91b5-5e0126e6742a-kube-api-access-d4n7g\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.291743 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291708    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-sys\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.291926 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-podres\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.291926 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-proc\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.291926 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-lib-modules\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.291926 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291847    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-sys\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.291926 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291850    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4n7g\" (UniqueName: \"kubernetes.io/projected/920e86a7-8f66-4603-91b5-5e0126e6742a-kube-api-access-d4n7g\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.292211 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291945    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-proc\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.292211 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291977    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-podres\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.292211 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.291977    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/920e86a7-8f66-4603-91b5-5e0126e6742a-lib-modules\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.300905 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.300869    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4n7g\" (UniqueName: \"kubernetes.io/projected/920e86a7-8f66-4603-91b5-5e0126e6742a-kube-api-access-d4n7g\") pod \"perf-node-gather-daemonset-w7m87\" (UID: \"920e86a7-8f66-4603-91b5-5e0126e6742a\") " pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.401942 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.401641    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:37.594408 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:37.594055    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"]
Jul 02 22:17:37.597981 ip-10-0-139-133 kubenswrapper[2571]: W0702 22:17:37.597947    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod920e86a7_8f66_4603_91b5_5e0126e6742a.slice/crio-538679b87f09e4f4cf217a1777ae888a5fda4f14c0795ba57419fee5cba5a640 WatchSource:0}: Error finding container 538679b87f09e4f4cf217a1777ae888a5fda4f14c0795ba57419fee5cba5a640: Status 404 returned error can't find the container with id 538679b87f09e4f4cf217a1777ae888a5fda4f14c0795ba57419fee5cba5a640
Jul 02 22:17:38.252194 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.252133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87" event={"ID":"920e86a7-8f66-4603-91b5-5e0126e6742a","Type":"ContainerStarted","Data":"86c39073acb8d00b0346d22dbeeb05d68553aea5d5ccccdce190de775b376cf3"}
Jul 02 22:17:38.252404 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.252235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87" event={"ID":"920e86a7-8f66-4603-91b5-5e0126e6742a","Type":"ContainerStarted","Data":"538679b87f09e4f4cf217a1777ae888a5fda4f14c0795ba57419fee5cba5a640"}
Jul 02 22:17:38.252404 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.252360    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:38.262321 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.262265    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/1.log"
Jul 02 22:17:38.268586 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.268563    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ljhv8_53580e86-54c5-4b81-afb5-82a247fd9caa/console-operator/2.log"
Jul 02 22:17:38.270710 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.270657    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87" podStartSLOduration=1.270637501 podStartE2EDuration="1.270637501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 22:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:17:38.268822133 +0000 UTC m=+2497.266742203" watchObservedRunningTime="2026-07-02 22:17:38.270637501 +0000 UTC m=+2497.268557558"
Jul 02 22:17:38.728666 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:38.728634    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c8ff597b7-qbbhv_5daf7691-61f1-4909-82ce-07c39b6bf054/console/0.log"
Jul 02 22:17:39.351656 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:39.351627    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-dlmd7_534fa6be-3350-4cf5-b252-362e4e88dddf/volume-data-source-validator/0.log"
Jul 02 22:17:40.534363 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:40.534334    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p8zln_ff5fcbb2-24f9-434f-9e14-a032498123db/dns/0.log"
Jul 02 22:17:40.559312 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:40.559284    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p8zln_ff5fcbb2-24f9-434f-9e14-a032498123db/kube-rbac-proxy/0.log"
Jul 02 22:17:40.632087 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:40.632057    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bndfl_46ded035-79e8-4c40-87de-9bab0965336e/dns-node-resolver/0.log"
Jul 02 22:17:41.299602 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:41.299574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rmmlm_2a863c86-f513-4fff-9402-d63252872752/node-ca/0.log"
Jul 02 22:17:42.434419 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:42.434389    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697fd7f55-4cdr5_c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71/kube-auth-proxy/0.log"
Jul 02 22:17:42.565981 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:42.565950    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x6tm5_a94b006a-2613-48c1-8808-a8ee418961a0/payload-pre-processing/0.log"
Jul 02 22:17:42.634740 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:42.634712    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b98f7769-6nglb_7eb2a04b-cf88-4bce-8ead-1d077a6b8474/router/0.log"
Jul 02 22:17:43.320491 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:43.320454    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ldwg6_2ea5b680-7b01-4262-9fb7-1aa02a08abad/serve-healthcheck-canary/0.log"
Jul 02 22:17:43.895401 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:43.895371    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-f9x65_d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6/insights-operator/0.log"
Jul 02 22:17:43.895767 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:43.895564    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-f9x65_d1f6fd43-122a-4ed3-ba13-7de3e6a99cb6/insights-operator/1.log"
Jul 02 22:17:43.925675 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:43.925625    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cct6d_56b2355d-7f8a-477d-b7db-f350914e34b6/kube-rbac-proxy/0.log"
Jul 02 22:17:43.950798 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:43.950762    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cct6d_56b2355d-7f8a-477d-b7db-f350914e34b6/exporter/0.log"
Jul 02 22:17:43.974829 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:43.974785    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cct6d_56b2355d-7f8a-477d-b7db-f350914e34b6/extractor/0.log"
Jul 02 22:17:44.273774 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:44.273708    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h24vs/perf-node-gather-daemonset-w7m87"
Jul 02 22:17:46.774012 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:46.773939    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64c6cb795c-5znwj_0051f3ef-f90d-44bf-a55c-68b8f19f745e/maas-api/0.log"
Jul 02 22:17:46.968148 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:46.968109    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-544f8c6b68-svbmh_a813305a-89e3-49ca-ac08-a2c999d98a00/manager/0.log"
Jul 02 22:17:47.207943 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:47.207916    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bcc4b86cc-8bhpd_f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5/manager/0.log"
Jul 02 22:17:47.227565 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:47.227541    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bcc4b86cc-8bhpd_f6eb6db2-637e-40f3-b3ea-d9da2c8c2da5/copy-manifests/0.log"
Jul 02 22:17:47.603917 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:47.603884    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697fd7f55-4cdr5_c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71/kube-auth-proxy/0.log"
Jul 02 22:17:47.702880 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:47.702845    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x6tm5_a94b006a-2613-48c1-8808-a8ee418961a0/payload-pre-processing/0.log"
Jul 02 22:17:47.751598 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:47.751572    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b98f7769-6nglb_7eb2a04b-cf88-4bce-8ead-1d077a6b8474/router/0.log"
Jul 02 22:17:48.746495 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:48.746464    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8677d7b8dc-7tz7p_784a19e5-09b7-4dce-8f6a-ce3a5865e720/manager/0.log"
Jul 02 22:17:49.137265 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:49.137181    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697fd7f55-4cdr5_c81538c7-32ce-4dd2-92ef-d9d0d1a4ad71/kube-auth-proxy/0.log"
Jul 02 22:17:49.242623 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:49.242591    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x6tm5_a94b006a-2613-48c1-8808-a8ee418961a0/payload-pre-processing/0.log"
Jul 02 22:17:49.300333 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:49.300304    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b98f7769-6nglb_7eb2a04b-cf88-4bce-8ead-1d077a6b8474/router/0.log"
Jul 02 22:17:54.001110 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:54.001076    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-z6wv4_a7b7e92c-b1f9-46b7-8113-3854077820e8/kube-storage-version-migrator-operator/1.log"
Jul 02 22:17:54.001984 ip-10-0-139-133 kubenswrapper[2571]: I0702 22:17:54.001963    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-z6wv4_a7b7e92c-b1f9-46b7-8113-3854077820e8/kube-storage-version-migrator-operator/0.log"