Jul 08 11:13:27.962718 ip-10-0-141-201 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 11:13:28.417757 ip-10-0-141-201 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 11:13:28.417757 ip-10-0-141-201 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 11:13:28.417757 ip-10-0-141-201 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 11:13:28.417757 ip-10-0-141-201 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 11:13:28.417757 ip-10-0-141-201 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 11:13:28.419696 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.419608    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 11:13:28.425170 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425155    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 11:13:28.425170 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425170    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425174    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425177    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425180    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425183    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425186    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425188    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425191    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425194    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425196    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425199    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425203    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425205    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425208    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425211    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425213    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425216    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425218    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425221    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425224    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 11:13:28.425230 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425226    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425229    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425232    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425234    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425237    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425240    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425244    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425248    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425251    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425253    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425256    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425259    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425262    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425265    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425267    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425270    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425272    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425275    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425277    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 11:13:28.425725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425280    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425283    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425285    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425288    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425290    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425293    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425296    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425298    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425301    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425303    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425306    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425309    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425311    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425314    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425316    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425320    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425323    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425325    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425328    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425330    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 11:13:28.426179 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425333    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425335    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425337    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425340    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425342    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425345    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425347    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425350    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425352    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425355    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425357    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425360    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425363    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425365    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425368    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425370    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425373    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425378    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425381    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425384    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 11:13:28.426711 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425386    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425389    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425392    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425394    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425397    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425399    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425402    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425405    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425408    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425411    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425413    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425415    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425418    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425422    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425425    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425428    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425430    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425446    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 11:13:28.427186 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.425449    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427487    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427495    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427499    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427501    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427505    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427508    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427511    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427513    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427516    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427518    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427521    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427524    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427527    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427529    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427532    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427534    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427537    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427539    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427542    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 11:13:28.427623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427544    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427547    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427551    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427554    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427557    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427560    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427562    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427565    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427568    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427570    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427573    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427575    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427578    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427580    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427583    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427586    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427589    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427591    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427594    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427597    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 11:13:28.428150 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427600    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427602    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427604    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427607    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427609    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427611    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427614    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427616    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427618    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427621    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427624    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427627    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427630    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427632    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427634    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427637    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427639    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427642    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427644    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427647    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 11:13:28.428694 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427650    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427654    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427656    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427659    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427661    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427664    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427667    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427669    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427672    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427674    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427676    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427679    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427682    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427685    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427687    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427690    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427692    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427694    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427697    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427699    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 11:13:28.429184 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427702    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427704    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427708    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427711    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427713    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427715    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427718    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427720    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427722    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427725    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427729    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427732    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427735    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427738    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427740    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427743    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427746    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427748    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427752    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 11:13:28.429696 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.427754    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428091    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428095    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428098    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428101    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428104    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428107    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428109    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428111    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428114    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428116    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428118    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428121    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428123    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428125    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428128    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428132    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428136    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428139    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428142    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 11:13:28.430171 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428145    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428148    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428151    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428154    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428157    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428160    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428164    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428166    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428169    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428171    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428174    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428177    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428179    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428182    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428184    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428186    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428190    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428194    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428197    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 11:13:28.430671 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428201    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428203    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428206    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428209    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428211    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428227    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428230    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428233    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428236    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428238    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428241    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428243    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428246    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428248    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428251    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428253    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428255    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428258    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428260    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428263    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 11:13:28.431209 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428265    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428267    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428271    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428273    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428276    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428278    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428281    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428283    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428286    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428288    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428290    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428293    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428296    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428298    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428319    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428324    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428327    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428329    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428332    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428335    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 11:13:28.431709 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428337    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428340    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428343    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428345    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428347    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428350    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428352    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428355    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428357    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428359    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428362    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428365    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428367    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428369    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428372    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428374    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428377    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428380    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428382    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428384    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 11:13:28.432192 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.428387    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428469    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428476    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428481    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428485    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428490    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428494    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428497    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428501    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428504    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428507    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428510    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428515    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428518    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428521    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428524    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428528    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428530    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428533    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428537    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428540    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428543    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428547    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428550    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 11:13:28.432686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428554    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428556    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428559    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428563    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428566    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428568    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428571    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428574    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428577    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428581    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428584    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428587    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428589    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428592    2561 flags.go:64] FLAG: --enable-server="true"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428595    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428599    2561 flags.go:64] FLAG: --event-burst="100"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428602    2561 flags.go:64] FLAG: --event-qps="50"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428605    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428608    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428610    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428615    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428618    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428621    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428623    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428626    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 11:13:28.433266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428629    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428632    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428634    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428637    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428640    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428643    2561 flags.go:64] FLAG: --feature-gates=""
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428646    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428649    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428652    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428655    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428658    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428661    2561 flags.go:64] FLAG: --help="false"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428664    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428667    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428670    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428672    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428676    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428679    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428682    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428684    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428687    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428690    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428693    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428696    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 11:13:28.433932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428698    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428701    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428704    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428710    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428712    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428715    2561 flags.go:64] FLAG: --lock-file=""
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428718    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428721    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428724    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428728    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428731    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428734    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428737    2561 flags.go:64] FLAG: --logging-format="text"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428739    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428742    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428745    2561 flags.go:64] FLAG: --manifest-url=""
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428748    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428752    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428755    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428758    2561 flags.go:64] FLAG: --max-pods="110"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428761    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428764    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428767    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428770    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428773    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 11:13:28.434554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428775    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428778    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428786    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428788    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428791    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428794    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428797    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428803    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428805    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428808    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428811    2561 flags.go:64] FLAG: --port="10250"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428815    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428818    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-027b95870a23a303c"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428821    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428824    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428826    2561 flags.go:64] FLAG: --register-node="true"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428829    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428833    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428835    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428838    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428841    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428845    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428848    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428851    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428853    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 11:13:28.435172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428856    2561 flags.go:64] FLAG: --runonce="false"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428859    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428861    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428864    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428867    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428869    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428872    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428875    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428878    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428880    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428883    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428886    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428888    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428891    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428894    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428897    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428902    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428905    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428909    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428913    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428916    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428918    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428921    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428924    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428926    2561 flags.go:64] FLAG: --v="2"
Jul 08 11:13:28.435796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428930    2561 flags.go:64] FLAG: --version="false"
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428934    2561 flags.go:64] FLAG: --vmodule=""
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428939    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.428942    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429054    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429059    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429062    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429064    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429067    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429070    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429072    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429075    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429077    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429080    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429083    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429085    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429087    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429090    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429092    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429095    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 11:13:28.436815 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429097    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429100    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429102    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429105    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429107    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429111    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429113    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429115    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429118    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429120    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429123    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429125    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429128    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429130    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429133    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429136    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429138    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429140    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429144    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 11:13:28.437682 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429148    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429150    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429153    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429156    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429158    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429161    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429163    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429165    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429167    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429170    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429172    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429175    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429177    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429180    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429182    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429184    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429187    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429190    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429193    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429196    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 11:13:28.438370 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429198    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429201    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429204    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429206    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429208    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429210    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429213    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429217    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429219    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429222    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429224    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429226    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429228    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429231    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429233    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429236    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429238    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429240    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429243    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 11:13:28.438934 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429245    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429247    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429250    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429252    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429255    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429257    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429260    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429262    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429266    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429269    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429272    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429276    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429278    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429281    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429283    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429286    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429289    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429291    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429293    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 11:13:28.439643 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429296    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429299    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429302    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429304    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429306    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.429309    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.429927    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.438103    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.438121    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.439155    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.439171    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439257    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439266    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439271    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439276    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 11:13:28.440474 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439281    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439286    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439291    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439296    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439300    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439305    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439309    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439313    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439317    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439322    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439326    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439330    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439334    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439338    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439342    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439346    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439351    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439355    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439359    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 11:13:28.440937 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439363    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439370    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439376    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439380    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439385    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439390    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439396    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439402    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439406    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439411    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439415    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439419    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439424    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439428    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439449    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439454    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439458    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439462    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439466    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439470    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 11:13:28.441623 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439474    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439478    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439483    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439487    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439491    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439495    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439499    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439503    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439507    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439511    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439515    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439520    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439524    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439528    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439532    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439536    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439541    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439546    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439551    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 11:13:28.442475 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439559    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439565    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439571    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439575    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439579    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439583    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439588    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439592    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439596    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439599    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439603    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439608    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439612    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439616    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439620    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439624    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439628    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439632    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439636    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 11:13:28.442982 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439640    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439644    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439647    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439651    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439655    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439659    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439662    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439666    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439672    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439678    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439683    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439687    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439692    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439696    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439701    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439705    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439710    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 11:13:28.443595 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439714    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.439721    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439906    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439914    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439919    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439923    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439928    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439932    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439938    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439942    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439946    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439951    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439955    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439959    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439963    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 11:13:28.444052 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439967    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439973    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439979    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439983    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439988    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439992    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.439996    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440000    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440004    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440008    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440012    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440017    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440021    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440025    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440029    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440035    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440039    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440043    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440047    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 11:13:28.444413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440051    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440055    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440059    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440064    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440068    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440072    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440075    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440079    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440083    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440087    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440091    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440095    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440099    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440103    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440107    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440114    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440119    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440124    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440128    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440132    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 11:13:28.444943 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440136    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440141    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440145    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440149    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440153    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440157    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440161    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440165    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440169    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440174    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440178    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440183    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440187    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440190    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440194    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440199    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440202    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440207    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440210    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440214    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 11:13:28.445421 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440218    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440222    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440226    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440230    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440234    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440238    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440242    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440247    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440252    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440255    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440259    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440263    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440267    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440271    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440275    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440279    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440283    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440287    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440291    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440295    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 11:13:28.445996 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440299    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440303    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440308    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440312    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440316    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440320    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:28.440327    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.440334    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.440494    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.443194    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.444802    2561 server.go:1019] "Starting client certificate rotation"
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.444899    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 11:13:28.446541 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.444935    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 11:13:28.447755 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.447737    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 11:13:28.453901 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.453881    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 11:13:28.468649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.468633    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 08 11:13:28.471938 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.471923    2561 log.go:25] "Validated CRI v1 image API"
Jul 08 11:13:28.472663 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.472637    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 11:13:28.475365 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.475349    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 11:13:28.477385 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.477368    2561 fs.go:135] Filesystem UUIDs: map[338d8f2d-8400-4106-b003-2199a28d68f4:/dev/nvme0n1p4 6146be8b-da24-48b0-98bf-540d2fcc5db3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 08 11:13:28.477450 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.477385    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 11:13:28.481480 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.481365    2561 manager.go:216] Machine: {Timestamp:2026-07-08 11:13:28.480912466 +0000 UTC m=+0.387696044 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101706 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad60224ba168b3d38b7a15d2acfb3 SystemUUID:ec2ad602-24ba-168b-3d38-b7a15d2acfb3 BootID:613046c1-898b-4c65-a858-2ca88bce3645 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:67:87:8f:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:67:87:8f:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:65:d5:19:ce:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 11:13:28.481480 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.481478    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 11:13:28.481591 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.481551    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 11:13:28.484938 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.484913    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 11:13:28.485065 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.484942    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 11:13:28.486300 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.486289    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 11:13:28.486334 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.486303    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 11:13:28.486334 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.486310    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 11:13:28.487184 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.487174    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 11:13:28.488569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.488559    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 11:13:28.496078 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496066    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 11:13:28.496183 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496174    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 11:13:28.496216 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496202    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 11:13:28.496216 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496212    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 11:13:28.496268 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496226    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 11:13:28.496268 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496236    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 08 11:13:28.496268 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496244    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 11:13:28.496582 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496570    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 11:13:28.496653 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.496590    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 11:13:28.499381 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.499365    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 11:13:28.502011 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.501993    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-94wz5"
Jul 08 11:13:28.502985 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.502971    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 11:13:28.503034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.503002    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 11:13:28.504796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504782    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504801    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504812    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504820    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504828    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504833    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504841    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504846    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504853    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504858    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 11:13:28.504864 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504866    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 11:13:28.505117 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.504872    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 11:13:28.505804 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.505787    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 11:13:28.505846 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.505828    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 11:13:28.507814 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.507800    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-94wz5"
Jul 08 11:13:28.508293 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.508282    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 11:13:28.508323 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.508296    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 11:13:28.510181 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.510160    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 11:13:28.511568 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.511556    2561 server.go:1268] "Started kubelet"
Jul 08 11:13:28.511705 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.511650    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 11:13:28.511705 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.511667    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 11:13:28.511835 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.511728    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 11:13:28.512411 ip-10-0-141-201 systemd[1]: Started Kubernetes Kubelet.
Jul 08 11:13:28.513808 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.513787    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 11:13:28.513959 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.513948    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 11:13:28.516902 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.516879    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 11:13:28.521095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521077    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 11:13:28.521095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521077    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 11:13:28.521481 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.521428    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:28.521792 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521778    2561 factory.go:55] Registering systemd factory
Jul 08 11:13:28.521876 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521795    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 08 11:13:28.521958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521934    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 11:13:28.521958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521952    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 11:13:28.522072 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.521933    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 11:13:28.522072 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522046    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 11:13:28.522072 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522054    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 11:13:28.522203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522083    2561 factory.go:153] Registering CRI-O factory
Jul 08 11:13:28.522203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522094    2561 factory.go:223] Registration of the crio container factory successfully
Jul 08 11:13:28.522203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522142    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 11:13:28.522203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522159    2561 factory.go:103] Registering Raw factory
Jul 08 11:13:28.522203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522170    2561 manager.go:1196] Started watching for new ooms in manager
Jul 08 11:13:28.522748 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.522734    2561 manager.go:349] Starting recovery of all containers
Jul 08 11:13:28.526605 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.526581    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 11:13:28.531478 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.531455    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-201.ec2.internal\" not found" node="ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.533950 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.533800    2561 manager.go:354] Recovery completed
Jul 08 11:13:28.538611 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.538595    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.540273 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540258    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.540326 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540285    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.540326 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540295    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.540722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540706    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 11:13:28.540722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540719    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 11:13:28.540722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540722    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.540911 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.540735    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 11:13:28.541299 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.541286    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.541383 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.541314    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.541383 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.541330    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.542276 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.542252    2561 policy_none.go:49] "None policy: Start"
Jul 08 11:13:28.542317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.542287    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 11:13:28.542317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.542300    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 11:13:28.543366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.543353    2561 policy_none.go:47] "Start"
Jul 08 11:13:28.573972 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.573958    2561 manager.go:337] "Starting Device Plugin manager"
Jul 08 11:13:28.574036 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.573993    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 11:13:28.574036 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.574006    2561 server.go:87] "Starting device plugin registration server"
Jul 08 11:13:28.574238 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.574225    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 11:13:28.574308 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.574238    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 11:13:28.574356 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.574325    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 11:13:28.574469 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.574456    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 11:13:28.574469 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.574469    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 11:13:28.574930 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.574912    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 11:13:28.575035 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.574959    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:28.674909 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.674862    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.675932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.675706    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.675932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.675734    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.675932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.675744    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.675932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.675768    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.683302 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.683275    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 11:13:28.684738 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.684721    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 11:13:28.684805 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.684757    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 11:13:28.684805 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.684774    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 11:13:28.684882 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.684804    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 11:13:28.686234 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.686218    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.686338 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.686238    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-201.ec2.internal\": node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:28.687082 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.687065    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 11:13:28.716026 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.716002    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:28.785364 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.785330    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"]
Jul 08 11:13:28.785472 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.785405    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.786181 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.786168    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.786247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.786194    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.786247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.786203    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.787574 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.787562    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.787687 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.787674    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.787732 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.787706    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.788176 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.788161    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.788243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.788177    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.788243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.788189    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.788243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.788200    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.788243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.788217    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.788243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.788202    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.789404 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.789389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.789474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.789420    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 11:13:28.790025 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.790008    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 11:13:28.790025 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.790029    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 11:13:28.790145 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.790039    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeHasSufficientPID"
Jul 08 11:13:28.814014 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.813992    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-201.ec2.internal\" not found" node="ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.816097 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.816076    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:28.817221 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.817208    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-201.ec2.internal\" not found" node="ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.823939 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.823923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac0776b4369a7523c4937d7f88b49b08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal\" (UID: \"ac0776b4369a7523c4937d7f88b49b08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.824023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.823947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac0776b4369a7523c4937d7f88b49b08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal\" (UID: \"ac0776b4369a7523c4937d7f88b49b08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.824023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.823961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bef9c4d9d443de443b3dad3e31ea593a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-201.ec2.internal\" (UID: \"bef9c4d9d443de443b3dad3e31ea593a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.916912 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:28.916880    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:28.924263 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.924243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac0776b4369a7523c4937d7f88b49b08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal\" (UID: \"ac0776b4369a7523c4937d7f88b49b08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.924345 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.924267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac0776b4369a7523c4937d7f88b49b08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal\" (UID: \"ac0776b4369a7523c4937d7f88b49b08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.924345 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.924285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bef9c4d9d443de443b3dad3e31ea593a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-201.ec2.internal\" (UID: \"bef9c4d9d443de443b3dad3e31ea593a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.924345 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.924311    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bef9c4d9d443de443b3dad3e31ea593a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-201.ec2.internal\" (UID: \"bef9c4d9d443de443b3dad3e31ea593a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.924482 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.924349    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac0776b4369a7523c4937d7f88b49b08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal\" (UID: \"ac0776b4369a7523c4937d7f88b49b08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:28.924482 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:28.924353    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac0776b4369a7523c4937d7f88b49b08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal\" (UID: \"ac0776b4369a7523c4937d7f88b49b08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:29.017431 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:29.017339    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.261360 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.261328    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.262435 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.262417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:30.263527 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.263510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:30.362212 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.362178    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.462777 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.462713    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.563265 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.563238    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.587759 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.587739    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 11:13:30.587893 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.587861    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 11:13:30.587951 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.587915    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 11:13:30.655601 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.655563    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 11:08:29 +0000 UTC" deadline="2028-02-18 05:50:39.913417273 +0000 UTC"
Jul 08 11:13:30.655749 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.655615    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14154h37m9.257824893s"
Jul 08 11:13:30.664100 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.664082    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.689849 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.689831    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 11:13:30.764619 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.764597    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.779578 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:30.779551    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef9c4d9d443de443b3dad3e31ea593a.slice/crio-1f536f3b22100f1eec5c109b106284134eda4ab6c42647222224b7305fae0683 WatchSource:0}: Error finding container 1f536f3b22100f1eec5c109b106284134eda4ab6c42647222224b7305fae0683: Status 404 returned error can't find the container with id 1f536f3b22100f1eec5c109b106284134eda4ab6c42647222224b7305fae0683
Jul 08 11:13:30.785361 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.785343    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 11:13:30.832150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:30.832101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal" event={"ID":"bef9c4d9d443de443b3dad3e31ea593a","Type":"ContainerStarted","Data":"1f536f3b22100f1eec5c109b106284134eda4ab6c42647222224b7305fae0683"}
Jul 08 11:13:30.850219 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:30.850196    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0776b4369a7523c4937d7f88b49b08.slice/crio-47cfe9435d84557004999b435842084f94169a935138f6c43e47e75dac9d0eb2 WatchSource:0}: Error finding container 47cfe9435d84557004999b435842084f94169a935138f6c43e47e75dac9d0eb2: Status 404 returned error can't find the container with id 47cfe9435d84557004999b435842084f94169a935138f6c43e47e75dac9d0eb2
Jul 08 11:13:30.865135 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.865119    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:30.965577 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:30.965555    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:31.066164 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.066078    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:31.166851 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.166820    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-201.ec2.internal\" not found"
Jul 08 11:13:31.237117 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.237087    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 11:13:31.265597 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.265565    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:31.281150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.281123    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 11:13:31.282880 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.282847    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal"
Jul 08 11:13:31.291699 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.291675    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 11:13:31.558143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.558118    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 11:13:31.640590 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.640563    2561 apiserver.go:52] "Watching apiserver"
Jul 08 11:13:31.650611 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.650585    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 11:13:31.651134 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.651111    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-lwmjs","openshift-ovn-kubernetes/ovnkube-node-pz758","kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7","openshift-cluster-node-tuning-operator/tuned-9lpsj","openshift-dns/node-resolver-bnkkb","openshift-image-registry/node-ca-2nhll","openshift-multus/multus-additional-cni-plugins-2kp7x","openshift-multus/multus-pf8f6","openshift-network-diagnostics/network-check-target-kb7k6","kube-system/global-pull-secret-syncer-qjxsr","kube-system/konnectivity-agent-959ql","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal","openshift-multus/network-metrics-daemon-4k9pm"]
Jul 08 11:13:31.652940 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.652919    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:31.653044 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.652998    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:31.654101 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.653920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.655406 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.655387    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:31.655508 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.655453    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:31.656592 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.656571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.657234 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.657214    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 11:13:31.657334 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.657261    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9c4fh\""
Jul 08 11:13:31.657334 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.657291    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 11:13:31.657769 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.657750    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.659792 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.659646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.661141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.661122    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.661934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.661913    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7vcqt\""
Jul 08 11:13:31.662021 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.661962    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 11:13:31.662161 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.662142    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.662265 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.661924    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.662383 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.662369    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlhc9\""
Jul 08 11:13:31.662448 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.662430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.662503 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.662455    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.662703 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.662685    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.662941 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.662923    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.664380 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.664363    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gp5hp\""
Jul 08 11:13:31.664519 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.664500    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 11:13:31.664582 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.664545    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w6tdx\""
Jul 08 11:13:31.664673 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.664656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.664735 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.664676    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 11:13:31.665043 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.665030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.666501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.665035    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.666501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.665300    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 11:13:31.666765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.666750    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.671386 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.671368    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 11:13:31.671479 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.671445    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 11:13:31.671676 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.671627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 11:13:31.671913 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.671895    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.671913 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.671907    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9cpb8\""
Jul 08 11:13:31.672318 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.672207    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 11:13:31.672742 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.672598    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 11:13:31.672817 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.672793    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 11:13:31.673210 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.673195    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.673813 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.673416    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.675012 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.674993    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kbhn4\""
Jul 08 11:13:31.675263 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.675227    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.675357 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.675295    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:31.676851 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.676834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.676960 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.676891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-cni-multus\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.676960 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.676931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-multus-certs\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677057 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.676957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00682ea6-c7f0-45db-9154-8538017af12c-hosts-file\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.677057 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.676981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-host\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.677057 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-os-release\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677057 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cnibin\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.677239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.677239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-slash\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-socket-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.677239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9ng6\" (UniqueName: \"kubernetes.io/projected/00682ea6-c7f0-45db-9154-8538017af12c-kube-api-access-w9ng6\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.677239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:31.677239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-ovn\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-node-log\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hfm\" (UniqueName: \"kubernetes.io/projected/3476b4e6-46ea-42b5-93a5-d5fde4db179c-kube-api-access-55hfm\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysctl-conf\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-systemd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-cni-netd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovnkube-script-lib\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts4gd\" (UniqueName: \"kubernetes.io/projected/db85efb0-a3b1-4598-8bb2-32a8b07d1080-kube-api-access-ts4gd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysctl-d\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-tuned\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-cni-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ea356d3-cf05-444a-bc88-1ce1346e7eee-konnectivity-ca\") pod \"konnectivity-agent-959ql\" (UID: \"3ea356d3-cf05-444a-bc88-1ce1346e7eee\") " pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-system-cni-dir\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-system-cni-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-k8s-cni-cncf-io\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-cni-bin\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-conf-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-modprobe-d\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb478183-d50e-4d35-8f46-748fd1af8abd-tmp\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-kubelet\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-os-release\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.677904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-systemd-units\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-etc-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-run-ovn-kubernetes\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-var-lib-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-systemd\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-cnibin\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-netns\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.677985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-daemon-config\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-etc-kubernetes\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-cni-bin\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovnkube-config\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-hostroot\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s69s\" (UniqueName: \"kubernetes.io/projected/39663b3a-a65c-46b4-9455-f4f57b9ac59e-kube-api-access-2s69s\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-log-socket\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovn-node-metrics-cert\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-registration-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.678414 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.678243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6cg\" (UniqueName: \"kubernetes.io/projected/5efd77a9-e881-4032-8674-13c5d8e9acf6-kube-api-access-pb6cg\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.680082 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00682ea6-c7f0-45db-9154-8538017af12c-tmp-dir\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.680175 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ea356d3-cf05-444a-bc88-1ce1346e7eee-agent-certs\") pod \"konnectivity-agent-959ql\" (UID: \"3ea356d3-cf05-444a-bc88-1ce1346e7eee\") " pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.680175 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8hg\" (UniqueName: \"kubernetes.io/projected/bb478183-d50e-4d35-8f46-748fd1af8abd-kube-api-access-gm8hg\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.680272 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.680272 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e9640ba-98da-49bf-82d8-6a1a136fd760-cni-binary-copy\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.680272 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-run-netns\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.680391 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-socket-dir-parent\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.680391 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-run\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.680391 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-var-lib-kubelet\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.680522 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5fzq\" (UniqueName: \"kubernetes.io/projected/2e9640ba-98da-49bf-82d8-6a1a136fd760-kube-api-access-r5fzq\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.680573 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-env-overrides\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.680627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-device-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.680627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.680736 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysconfig\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.680791 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-kubernetes\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.680843 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.680915 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-kubelet\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.680915 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-sys-fs\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.681107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-lib-modules\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.681107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.680990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:31.681107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.681021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.681107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.681055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-sys\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.686921 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.686900    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.687753 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687223    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.687753 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687427    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 11:13:31.687753 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687540    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 11:13:31.687753 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687552    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 11:13:31.687753 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 11:13:31.688015 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687944    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6k5xg\""
Jul 08 11:13:31.688015 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.687981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-52tzq\""
Jul 08 11:13:31.695685 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.695583    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 11:13:31.759264 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.759238    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5m6xf"
Jul 08 11:13:31.760756 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.760732    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 11:13:31.766284 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.766266    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 11:13:31.770824 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.770802    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5m6xf"
Jul 08 11:13:31.781818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hfm\" (UniqueName: \"kubernetes.io/projected/3476b4e6-46ea-42b5-93a5-d5fde4db179c-kube-api-access-55hfm\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:31.781928 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysctl-conf\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.781928 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-systemd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.781928 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-cni-netd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.781928 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovnkube-script-lib\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781929    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-systemd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts4gd\" (UniqueName: \"kubernetes.io/projected/db85efb0-a3b1-4598-8bb2-32a8b07d1080-kube-api-access-ts4gd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysctl-d\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.781983    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-cni-netd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-tuned\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782023    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysctl-conf\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-cni-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b5572f4-4d54-4f11-af5f-3946b41cb37f-kubelet-config\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ba5f34f-e4fc-4660-b916-75f308a7d688-iptables-alerter-script\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782120    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysctl-d\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ea356d3-cf05-444a-bc88-1ce1346e7eee-konnectivity-ca\") pod \"konnectivity-agent-959ql\" (UID: \"3ea356d3-cf05-444a-bc88-1ce1346e7eee\") " pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-system-cni-dir\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-system-cni-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-k8s-cni-cncf-io\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-cni-bin\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-conf-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782338    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-cni-bin\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782352    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-k8s-cni-cncf-io\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782453    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-cni-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782493    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-system-cni-dir\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782544    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-conf-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782567    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovnkube-script-lib\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782592    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-system-cni-dir\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782598    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782658    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ea356d3-cf05-444a-bc88-1ce1346e7eee-konnectivity-ca\") pod \"konnectivity-agent-959ql\" (UID: \"3ea356d3-cf05-444a-bc88-1ce1346e7eee\") " pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-modprobe-d\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.782689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb478183-d50e-4d35-8f46-748fd1af8abd-tmp\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782717    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-kubelet\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782765    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-modprobe-d\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-os-release\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782847    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-kubelet\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-systemd-units\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782930    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-os-release\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-etc-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782981    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-systemd-units\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782996    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.782992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-run-ovn-kubernetes\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783032    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-etc-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-var-lib-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783037    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-run-ovn-kubernetes\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-systemd\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.783130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783072    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-var-lib-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-cnibin\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783121    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-systemd\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-netns\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-daemon-config\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-etc-kubernetes\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783179    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-cnibin\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783182    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-netns\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-cni-bin\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783261    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-cni-bin\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783265    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-etc-kubernetes\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovnkube-config\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-hostroot\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s69s\" (UniqueName: \"kubernetes.io/projected/39663b3a-a65c-46b4-9455-f4f57b9ac59e-kube-api-access-2s69s\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783388    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-hostroot\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-log-socket\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovn-node-metrics-cert\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-registration-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.783945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783716    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-daemon-config\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6cg\" (UniqueName: \"kubernetes.io/projected/5efd77a9-e881-4032-8674-13c5d8e9acf6-kube-api-access-pb6cg\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783979    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-registration-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.783984    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-log-socket\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00682ea6-c7f0-45db-9154-8538017af12c-tmp-dir\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ea356d3-cf05-444a-bc88-1ce1346e7eee-agent-certs\") pod \"konnectivity-agent-959ql\" (UID: \"3ea356d3-cf05-444a-bc88-1ce1346e7eee\") " pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8hg\" (UniqueName: \"kubernetes.io/projected/bb478183-d50e-4d35-8f46-748fd1af8abd-kube-api-access-gm8hg\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm89g\" (UniqueName: \"kubernetes.io/projected/01de7db5-6d86-4170-bf3b-798c52e19c5f-kube-api-access-qm89g\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e9640ba-98da-49bf-82d8-6a1a136fd760-cni-binary-copy\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-run-netns\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgm8d\" (UniqueName: \"kubernetes.io/projected/9ba5f34f-e4fc-4660-b916-75f308a7d688-kube-api-access-cgm8d\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784327    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovnkube-config\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-socket-dir-parent\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784409    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00682ea6-c7f0-45db-9154-8538017af12c-tmp-dir\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-run\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.784757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784482    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-multus-socket-dir-parent\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-var-lib-kubelet\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784504    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-run-netns\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784606    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-var-lib-kubelet\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5fzq\" (UniqueName: \"kubernetes.io/projected/2e9640ba-98da-49bf-82d8-6a1a136fd760-kube-api-access-r5fzq\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-env-overrides\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-device-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysconfig\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-kubernetes\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-kubelet\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-sys-fs\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01de7db5-6d86-4170-bf3b-798c52e19c5f-serviceca\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784947    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e9640ba-98da-49bf-82d8-6a1a136fd760-cni-binary-copy\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-lib-modules\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.784985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:31.785298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785048    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785073    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785152    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-lib-modules\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785198    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-sysconfig\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-sys\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-cni-multus\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-multus-certs\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00682ea6-c7f0-45db-9154-8538017af12c-hosts-file\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-host\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-os-release\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cnibin\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785445    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db85efb0-a3b1-4598-8bb2-32a8b07d1080-env-overrides\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785512    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-slash\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785532    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-kubernetes\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-socket-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.785785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9ng6\" (UniqueName: \"kubernetes.io/projected/00682ea6-c7f0-45db-9154-8538017af12c-kube-api-access-w9ng6\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785572    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b5572f4-4d54-4f11-af5f-3946b41cb37f-dbus\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785606    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-host\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785622    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-run\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785642    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb478183-d50e-4d35-8f46-748fd1af8abd-sys\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-ovn\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785703    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-kubelet\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.785737    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785745    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cnibin\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785771    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-sys-fs\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785787    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-device-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785840    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-os-release\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785898    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-var-lib-cni-multus\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.785925    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:13:32.285893515 +0000 UTC m=+3.049246874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:31.786417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786188    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5efd77a9-e881-4032-8674-13c5d8e9acf6-socket-dir\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786232    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-host-slash\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785514    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e9640ba-98da-49bf-82d8-6a1a136fd760-host-run-multus-certs\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786271    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786291    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-openvswitch\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-run-ovn\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39663b3a-a65c-46b4-9455-f4f57b9ac59e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.785588    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00682ea6-c7f0-45db-9154-8538017af12c-hosts-file\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-node-log\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01de7db5-6d86-4170-bf3b-798c52e19c5f-host\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786421    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db85efb0-a3b1-4598-8bb2-32a8b07d1080-node-log\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ba5f34f-e4fc-4660-b916-75f308a7d688-host-slash\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786510    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb478183-d50e-4d35-8f46-748fd1af8abd-tmp\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.786644    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb478183-d50e-4d35-8f46-748fd1af8abd-etc-tuned\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.787314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.787067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ea356d3-cf05-444a-bc88-1ce1346e7eee-agent-certs\") pod \"konnectivity-agent-959ql\" (UID: \"3ea356d3-cf05-444a-bc88-1ce1346e7eee\") " pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.788264 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.788244    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db85efb0-a3b1-4598-8bb2-32a8b07d1080-ovn-node-metrics-cert\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.802805 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.802783    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6cg\" (UniqueName: \"kubernetes.io/projected/5efd77a9-e881-4032-8674-13c5d8e9acf6-kube-api-access-pb6cg\") pod \"aws-ebs-csi-driver-node-6rqn7\" (UID: \"5efd77a9-e881-4032-8674-13c5d8e9acf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.803418 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.803400    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8hg\" (UniqueName: \"kubernetes.io/projected/bb478183-d50e-4d35-8f46-748fd1af8abd-kube-api-access-gm8hg\") pod \"tuned-9lpsj\" (UID: \"bb478183-d50e-4d35-8f46-748fd1af8abd\") " pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:31.803685 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.803668    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s69s\" (UniqueName: \"kubernetes.io/projected/39663b3a-a65c-46b4-9455-f4f57b9ac59e-kube-api-access-2s69s\") pod \"multus-additional-cni-plugins-2kp7x\" (UID: \"39663b3a-a65c-46b4-9455-f4f57b9ac59e\") " pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:31.803880 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.803843    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hfm\" (UniqueName: \"kubernetes.io/projected/3476b4e6-46ea-42b5-93a5-d5fde4db179c-kube-api-access-55hfm\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:31.804638 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.804620    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9ng6\" (UniqueName: \"kubernetes.io/projected/00682ea6-c7f0-45db-9154-8538017af12c-kube-api-access-w9ng6\") pod \"node-resolver-bnkkb\" (UID: \"00682ea6-c7f0-45db-9154-8538017af12c\") " pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:31.805460 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.805441    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:13:31.805563 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.805465    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:13:31.805563 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.805480    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:31.805563 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.805541    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:32.305520875 +0000 UTC m=+3.068874228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:31.807447 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.807428    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5fzq\" (UniqueName: \"kubernetes.io/projected/2e9640ba-98da-49bf-82d8-6a1a136fd760-kube-api-access-r5fzq\") pod \"multus-pf8f6\" (UID: \"2e9640ba-98da-49bf-82d8-6a1a136fd760\") " pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:31.807984 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.807958    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts4gd\" (UniqueName: \"kubernetes.io/projected/db85efb0-a3b1-4598-8bb2-32a8b07d1080-kube-api-access-ts4gd\") pod \"ovnkube-node-pz758\" (UID: \"db85efb0-a3b1-4598-8bb2-32a8b07d1080\") " pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:31.834137 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.834102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal" event={"ID":"ac0776b4369a7523c4937d7f88b49b08","Type":"ContainerStarted","Data":"47cfe9435d84557004999b435842084f94169a935138f6c43e47e75dac9d0eb2"}
Jul 08 11:13:31.886860 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.886830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgm8d\" (UniqueName: \"kubernetes.io/projected/9ba5f34f-e4fc-4660-b916-75f308a7d688-kube-api-access-cgm8d\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.887013 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.886888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01de7db5-6d86-4170-bf3b-798c52e19c5f-serviceca\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.887107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b5572f4-4d54-4f11-af5f-3946b41cb37f-dbus\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.887107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01de7db5-6d86-4170-bf3b-798c52e19c5f-host\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.887239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ba5f34f-e4fc-4660-b916-75f308a7d688-host-slash\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.887239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887221    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ba5f34f-e4fc-4660-b916-75f308a7d688-host-slash\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.887336 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887242    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01de7db5-6d86-4170-bf3b-798c52e19c5f-host\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.887336 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b5572f4-4d54-4f11-af5f-3946b41cb37f-kubelet-config\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.887336 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ba5f34f-e4fc-4660-b916-75f308a7d688-iptables-alerter-script\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.887336 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887322    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b5572f4-4d54-4f11-af5f-3946b41cb37f-dbus\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.887539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887396    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b5572f4-4d54-4f11-af5f-3946b41cb37f-kubelet-config\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.887539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887399    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:31.887539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887418    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01de7db5-6d86-4170-bf3b-798c52e19c5f-serviceca\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.887539 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.887478    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:31.887539 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:31.887530    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:13:32.387513884 +0000 UTC m=+3.150867238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:31.887793 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm89g\" (UniqueName: \"kubernetes.io/projected/01de7db5-6d86-4170-bf3b-798c52e19c5f-kube-api-access-qm89g\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.887969 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.887946    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ba5f34f-e4fc-4660-b916-75f308a7d688-iptables-alerter-script\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.904492 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.904467    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm89g\" (UniqueName: \"kubernetes.io/projected/01de7db5-6d86-4170-bf3b-798c52e19c5f-kube-api-access-qm89g\") pod \"node-ca-2nhll\" (UID: \"01de7db5-6d86-4170-bf3b-798c52e19c5f\") " pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:31.905223 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.905173    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgm8d\" (UniqueName: \"kubernetes.io/projected/9ba5f34f-e4fc-4660-b916-75f308a7d688-kube-api-access-cgm8d\") pod \"iptables-alerter-lwmjs\" (UID: \"9ba5f34f-e4fc-4660-b916-75f308a7d688\") " pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:31.967366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.967340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:31.987155 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.987134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7"
Jul 08 11:13:31.997241 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:31.997219    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lpsj"
Jul 08 11:13:32.004036 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.004015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bnkkb"
Jul 08 11:13:32.012689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.012671    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pf8f6"
Jul 08 11:13:32.018376 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.018359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2kp7x"
Jul 08 11:13:32.026654 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.026637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:32.034417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.034400    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lwmjs"
Jul 08 11:13:32.039938 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.039920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2nhll"
Jul 08 11:13:32.290037 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.289952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:32.290202 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.290134    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:32.290264 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.290202    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:13:33.29018363 +0000 UTC m=+4.053536977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.390358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.390408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.390508    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.390507    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.390527    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.390540    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:32.390601 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.390590    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:13:33.390565188 +0000 UTC m=+4.153918549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:32.390949 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:32.390612    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:33.390601402 +0000 UTC m=+4.153954745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:32.773436 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.773360    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 11:08:31 +0000 UTC" deadline="2028-02-06 17:39:48.332638119 +0000 UTC"
Jul 08 11:13:32.773436 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.773391    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13878h26m15.559250415s"
Jul 08 11:13:32.829069 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.829046    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb85efb0_a3b1_4598_8bb2_32a8b07d1080.slice/crio-02a8c835119fd19017b1dbe565899bea1e1d93b8768c1d3f52a204557c3cbb39 WatchSource:0}: Error finding container 02a8c835119fd19017b1dbe565899bea1e1d93b8768c1d3f52a204557c3cbb39: Status 404 returned error can't find the container with id 02a8c835119fd19017b1dbe565899bea1e1d93b8768c1d3f52a204557c3cbb39
Jul 08 11:13:32.831263 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.831236    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba5f34f_e4fc_4660_b916_75f308a7d688.slice/crio-c28f8427ebd1d2fa4d6271f542b3627e9de411f1f4cf5a7883f852a9247c4a8d WatchSource:0}: Error finding container c28f8427ebd1d2fa4d6271f542b3627e9de411f1f4cf5a7883f852a9247c4a8d: Status 404 returned error can't find the container with id c28f8427ebd1d2fa4d6271f542b3627e9de411f1f4cf5a7883f852a9247c4a8d
Jul 08 11:13:32.835142 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.835115    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efd77a9_e881_4032_8674_13c5d8e9acf6.slice/crio-d9fcee8466a95e1d16af30277b0a452e1927536216710292d51b86d99bd00470 WatchSource:0}: Error finding container d9fcee8466a95e1d16af30277b0a452e1927536216710292d51b86d99bd00470: Status 404 returned error can't find the container with id d9fcee8466a95e1d16af30277b0a452e1927536216710292d51b86d99bd00470
Jul 08 11:13:32.838224 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.838034    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01de7db5_6d86_4170_bf3b_798c52e19c5f.slice/crio-c6da9043c4dacd8eeacf341d10f194a2e4bf15f1046dd1e5df4a01c96f671332 WatchSource:0}: Error finding container c6da9043c4dacd8eeacf341d10f194a2e4bf15f1046dd1e5df4a01c96f671332: Status 404 returned error can't find the container with id c6da9043c4dacd8eeacf341d10f194a2e4bf15f1046dd1e5df4a01c96f671332
Jul 08 11:13:32.840375 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.839173    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb478183_d50e_4d35_8f46_748fd1af8abd.slice/crio-bd97a3e89283f7e9139e851cdf25489710f593c799fb2cc985b91d39ef234931 WatchSource:0}: Error finding container bd97a3e89283f7e9139e851cdf25489710f593c799fb2cc985b91d39ef234931: Status 404 returned error can't find the container with id bd97a3e89283f7e9139e851cdf25489710f593c799fb2cc985b91d39ef234931
Jul 08 11:13:32.841521 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.841491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lwmjs" event={"ID":"9ba5f34f-e4fc-4660-b916-75f308a7d688","Type":"ContainerStarted","Data":"c28f8427ebd1d2fa4d6271f542b3627e9de411f1f4cf5a7883f852a9247c4a8d"}
Jul 08 11:13:32.843956 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.843804    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea356d3_cf05_444a_bc88_1ce1346e7eee.slice/crio-f3938a858da248703447f8b04b12e45702f089f37fca14e8d24da40313247558 WatchSource:0}: Error finding container f3938a858da248703447f8b04b12e45702f089f37fca14e8d24da40313247558: Status 404 returned error can't find the container with id f3938a858da248703447f8b04b12e45702f089f37fca14e8d24da40313247558
Jul 08 11:13:32.844537 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.844492    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39663b3a_a65c_46b4_9455_f4f57b9ac59e.slice/crio-3c474269138e9cb8f80ca6bf0325572e591e444c911df26e87091c9f28b35943 WatchSource:0}: Error finding container 3c474269138e9cb8f80ca6bf0325572e591e444c911df26e87091c9f28b35943: Status 404 returned error can't find the container with id 3c474269138e9cb8f80ca6bf0325572e591e444c911df26e87091c9f28b35943
Jul 08 11:13:32.845808 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:32.845581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"02a8c835119fd19017b1dbe565899bea1e1d93b8768c1d3f52a204557c3cbb39"}
Jul 08 11:13:32.845975 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:13:32.845827    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00682ea6_c7f0_45db_9154_8538017af12c.slice/crio-580054a07529ab02310c0abd5a4d54196f79bfa252df3c3929f42a8b3fdcfa80 WatchSource:0}: Error finding container 580054a07529ab02310c0abd5a4d54196f79bfa252df3c3929f42a8b3fdcfa80: Status 404 returned error can't find the container with id 580054a07529ab02310c0abd5a4d54196f79bfa252df3c3929f42a8b3fdcfa80
Jul 08 11:13:33.296271 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.296231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:33.296437 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.296409    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:33.296499 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.296485    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:13:35.296464291 +0000 UTC m=+6.059817640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.396897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.396961    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.397139    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.397159    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.397172    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.397232    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:35.397214438 +0000 UTC m=+6.160567783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.397610    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:33.398828 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.397662    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:13:35.397649034 +0000 UTC m=+6.161002381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:33.774005 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.773898    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 11:08:31 +0000 UTC" deadline="2027-12-10 17:56:17.304929346 +0000 UTC"
Jul 08 11:13:33.774005 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.773960    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12486h42m43.530973115s"
Jul 08 11:13:33.829555 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.828986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:33.829555 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.829122    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:33.829555 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.829199    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:33.829555 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.829304    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:33.829555 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.829484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:33.829974 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:33.829604    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:33.855002 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.854967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lpsj" event={"ID":"bb478183-d50e-4d35-8f46-748fd1af8abd","Type":"ContainerStarted","Data":"bd97a3e89283f7e9139e851cdf25489710f593c799fb2cc985b91d39ef234931"}
Jul 08 11:13:33.870775 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.870429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2nhll" event={"ID":"01de7db5-6d86-4170-bf3b-798c52e19c5f","Type":"ContainerStarted","Data":"c6da9043c4dacd8eeacf341d10f194a2e4bf15f1046dd1e5df4a01c96f671332"}
Jul 08 11:13:33.875925 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.875653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal" event={"ID":"bef9c4d9d443de443b3dad3e31ea593a","Type":"ContainerStarted","Data":"587c828fa1db5d124b99dbe66841fa2d4da249121b944169222401b9c50bf868"}
Jul 08 11:13:33.884555 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.884514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerStarted","Data":"3c474269138e9cb8f80ca6bf0325572e591e444c911df26e87091c9f28b35943"}
Jul 08 11:13:33.886268 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.886246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf8f6" event={"ID":"2e9640ba-98da-49bf-82d8-6a1a136fd760","Type":"ContainerStarted","Data":"77a354b1bf9c2b60b7584e54c5129b86d40952309a6f5f4908bb8df1e331fb39"}
Jul 08 11:13:33.888126 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.888101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-959ql" event={"ID":"3ea356d3-cf05-444a-bc88-1ce1346e7eee","Type":"ContainerStarted","Data":"f3938a858da248703447f8b04b12e45702f089f37fca14e8d24da40313247558"}
Jul 08 11:13:33.891400 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.891373    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7" event={"ID":"5efd77a9-e881-4032-8674-13c5d8e9acf6","Type":"ContainerStarted","Data":"d9fcee8466a95e1d16af30277b0a452e1927536216710292d51b86d99bd00470"}
Jul 08 11:13:33.894004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.893979    2561 generic.go:356] "Generic (PLEG): container finished" podID="ac0776b4369a7523c4937d7f88b49b08" containerID="f06c43dc06340c25953a379b9ac022cf52d7e3afed349c8ccd488f9e7df40bcc" exitCode=0
Jul 08 11:13:33.894159 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.894065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal" event={"ID":"ac0776b4369a7523c4937d7f88b49b08","Type":"ContainerDied","Data":"f06c43dc06340c25953a379b9ac022cf52d7e3afed349c8ccd488f9e7df40bcc"}
Jul 08 11:13:33.916503 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.916444    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bnkkb" event={"ID":"00682ea6-c7f0-45db-9154-8538017af12c","Type":"ContainerStarted","Data":"580054a07529ab02310c0abd5a4d54196f79bfa252df3c3929f42a8b3fdcfa80"}
Jul 08 11:13:33.934220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:33.934163    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-201.ec2.internal" podStartSLOduration=2.934141797 podStartE2EDuration="2.934141797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:33.910846887 +0000 UTC m=+4.674200252" watchObservedRunningTime="2026-07-08 11:13:33.934141797 +0000 UTC m=+4.697495164"
Jul 08 11:13:34.927031 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:34.926975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal" event={"ID":"ac0776b4369a7523c4937d7f88b49b08","Type":"ContainerStarted","Data":"115b98e6310fe394e1e4ba266e1bc6e893f8f0dc08a07541284d420706c9129f"}
Jul 08 11:13:35.313514 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:35.313426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:35.313682 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.313603    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:35.313682 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.313669    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:13:39.313648489 +0000 UTC m=+10.077001839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:35.414754 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:35.414718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:35.414981 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:35.414778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:35.414981 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.414953    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:13:35.414981 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.414972    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:13:35.414981 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.414985    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:35.415191 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.415044    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:39.415026521 +0000 UTC m=+10.178379885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:35.415500 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.415431    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:35.415500 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.415488    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:13:39.415472633 +0000 UTC m=+10.178825979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:35.829006 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:35.828973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:35.829184 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.829122    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:35.829287 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:35.829266    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:35.829590 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.829388    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:35.829590 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:35.829436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:35.829590 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:35.829528    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:37.832320 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:37.831609    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:37.832320 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:37.831747    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:37.832320 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:37.831815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:37.832320 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:37.831898    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:37.832320 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:37.831944    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:37.832320 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:37.831996    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:39.347070 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:39.347034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:39.347534 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.347230    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:39.347534 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.347296    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:13:47.347278366 +0000 UTC m=+18.110631707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:39.448027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:39.448092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.448207    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.448260    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.448278    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:13:47.448259012 +0000 UTC m=+18.211612359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.448280    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.448296    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:39.448374 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.448345    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:47.448328197 +0000 UTC m=+18.211681544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:39.829523 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:39.829443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:39.829664 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.829584    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:39.830001 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:39.829981    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:39.830087 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.830070    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:39.830235 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:39.830209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:39.830348 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:39.830310    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:41.829295 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:41.829261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:41.829836 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:41.829386    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:41.829836 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:41.829784    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:41.830005 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:41.829893    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:41.830005 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:41.829954    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:41.830098 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:41.830026    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:43.828818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:43.828785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:43.829261 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:43.828931    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:43.829342 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:43.829326    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:43.829456 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:43.829433    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:43.829623 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:43.829576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:43.829720 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:43.829690    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:45.832151 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:45.832118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:45.832151 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:45.832150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:45.832603 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:45.832149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:45.832603 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:45.832236    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:45.832603 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:45.832346    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:45.832603 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:45.832389    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:47.401576 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:47.401547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:47.402103 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.401671    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:47.402103 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.401737    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:14:03.401722589 +0000 UTC m=+34.165075930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:13:47.502161 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:47.502112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:47.502161 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:47.502158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:47.502382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.502252    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:13:47.502382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.502251    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:47.502382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.502267    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:13:47.502382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.502284    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:47.502382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.502322    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:14:03.502307121 +0000 UTC m=+34.265660465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:13:47.502382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.502337    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:14:03.502330778 +0000 UTC m=+34.265684119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:13:47.829068 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:47.828561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:47.829068 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.828686    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:47.829068 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:47.828942    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:47.829068 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.829043    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:47.829365 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:47.829095    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:47.829365 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:47.829172    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:49.830097 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:49.830043    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:49.830519 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:49.830125    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:49.830519 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:49.830167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:49.830519 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:49.830170    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:49.830519 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:49.830242    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:49.830519 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:49.830342    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:51.829072 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.828816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:51.829415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.828821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:51.829415 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:51.829179    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:51.829415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.828842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:51.829415 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:51.829234    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:51.829415 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:51.829299    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:51.964473 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.964380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"fa0c8eecde90ccd9cf24fa507a179ce45bc7f8d5082307e729b01a7d7f3dc786"}
Jul 08 11:13:51.964618 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.964527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"6236f1c44b6ef0f69308898963abc81f8ded5fd2da14e423f7a04a6fa26d91a1"}
Jul 08 11:13:51.966423 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.966396    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerStarted","Data":"5952f1104c398aa34474a16db393db2807d14cf0c1f1d61669d9bc3038e9cbe0"}
Jul 08 11:13:51.968076 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.968048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf8f6" event={"ID":"2e9640ba-98da-49bf-82d8-6a1a136fd760","Type":"ContainerStarted","Data":"f5d6c36bd546ae1f5fbb6b0942f7595e46804120a7396cd0f9c1451a3ec23d69"}
Jul 08 11:13:51.969698 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.969649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-959ql" event={"ID":"3ea356d3-cf05-444a-bc88-1ce1346e7eee","Type":"ContainerStarted","Data":"f36c915ae95dcded025a0353c1b709009dcba44f63a151c077f834618f464b59"}
Jul 08 11:13:51.971216 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.971194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7" event={"ID":"5efd77a9-e881-4032-8674-13c5d8e9acf6","Type":"ContainerStarted","Data":"9dfa10f33847680063eecf39d95a61e5daa2272465fb0ec43bfc367a7cea7eed"}
Jul 08 11:13:51.975731 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.975708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bnkkb" event={"ID":"00682ea6-c7f0-45db-9154-8538017af12c","Type":"ContainerStarted","Data":"547dcd01451479b22b6bbf4ec76bd714f06b04bbd1083dc407d2b841638f961f"}
Jul 08 11:13:51.977162 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.977132    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lpsj" event={"ID":"bb478183-d50e-4d35-8f46-748fd1af8abd","Type":"ContainerStarted","Data":"ed2462a0507501b834ad382214495860a552fd8f488fdf780d18d1d17d945867"}
Jul 08 11:13:51.981361 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:51.981321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2nhll" event={"ID":"01de7db5-6d86-4170-bf3b-798c52e19c5f","Type":"ContainerStarted","Data":"ed07c36dbea1edfb75191ba388cd6d92f3d46f34206d0737894aa479fc1b3f36"}
Jul 08 11:13:52.007162 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.007118    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-201.ec2.internal" podStartSLOduration=21.007104178 podStartE2EDuration="21.007104178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:34.945027777 +0000 UTC m=+5.708381142" watchObservedRunningTime="2026-07-08 11:13:52.007104178 +0000 UTC m=+22.770457544"
Jul 08 11:13:52.033314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.033262    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bnkkb" podStartSLOduration=4.838655433 podStartE2EDuration="23.033246352s" totalImagesPullingTime="18.194590919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:52.032659142 +0000 UTC m=+22.796012509" watchObservedRunningTime="2026-07-08 11:13:52.033246352 +0000 UTC m=+22.796599715"
Jul 08 11:13:52.071686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.071641    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pf8f6" podStartSLOduration=4.437090609 podStartE2EDuration="23.071625883s" totalImagesPullingTime="18.634535274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:52.071152697 +0000 UTC m=+22.834506062" watchObservedRunningTime="2026-07-08 11:13:52.071625883 +0000 UTC m=+22.834979263"
Jul 08 11:13:52.091687 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.091559    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2nhll" podStartSLOduration=8.148991851 podStartE2EDuration="22.091544175s" totalImagesPullingTime="13.942552324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:52.090974943 +0000 UTC m=+22.854328306" watchObservedRunningTime="2026-07-08 11:13:52.091544175 +0000 UTC m=+22.854897564"
Jul 08 11:13:52.110790 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.110749    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-959ql" podStartSLOduration=9.173112039 podStartE2EDuration="23.110734419s" totalImagesPullingTime="13.93762238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:52.110669055 +0000 UTC m=+22.874022438" watchObservedRunningTime="2026-07-08 11:13:52.110734419 +0000 UTC m=+22.874087782"
Jul 08 11:13:52.906185 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.906154    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bnkkb_00682ea6-c7f0-45db-9154-8538017af12c/dns-node-resolver/0.log"
Jul 08 11:13:52.986473 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.986430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lwmjs" event={"ID":"9ba5f34f-e4fc-4660-b916-75f308a7d688","Type":"ContainerStarted","Data":"b2b41f24f792c5a7e626b1394e19250874e38cfcb08b53b59dd69715ca3c7422"}
Jul 08 11:13:52.989747 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.989725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:13:52.990133 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.990100    2561 generic.go:356] "Generic (PLEG): container finished" podID="db85efb0-a3b1-4598-8bb2-32a8b07d1080" containerID="fa0c8eecde90ccd9cf24fa507a179ce45bc7f8d5082307e729b01a7d7f3dc786" exitCode=1
Jul 08 11:13:52.990228 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.990181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerDied","Data":"fa0c8eecde90ccd9cf24fa507a179ce45bc7f8d5082307e729b01a7d7f3dc786"}
Jul 08 11:13:52.990286 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.990264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"18f7b595d4860f03150d81829247b33756dbf0a3f5cf810e2fd3b7e49acb5eb4"}
Jul 08 11:13:52.990322 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.990296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"5113e95c7010a9cd0c822ad8cbadd79a7e67acf4a0909032249964fef5397aa5"}
Jul 08 11:13:52.990358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.990323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"c6acb22866e90fd637f1a3f0f82f6d4d5c9cd52551fc4a0215c41d28ffc378cb"}
Jul 08 11:13:52.990397 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.990371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"499530221a886bfadeb2598830e61bee3ba788fc3fcf866a83ed8a439a442025"}
Jul 08 11:13:52.991925 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.991903    2561 generic.go:356] "Generic (PLEG): container finished" podID="39663b3a-a65c-46b4-9455-f4f57b9ac59e" containerID="5952f1104c398aa34474a16db393db2807d14cf0c1f1d61669d9bc3038e9cbe0" exitCode=0
Jul 08 11:13:52.992044 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:52.992004    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerDied","Data":"5952f1104c398aa34474a16db393db2807d14cf0c1f1d61669d9bc3038e9cbe0"}
Jul 08 11:13:53.011258 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.011206    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lpsj" podStartSLOduration=5.398251468 podStartE2EDuration="24.011189024s" totalImagesPullingTime="18.612937556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:52.142844053 +0000 UTC m=+22.906197418" watchObservedRunningTime="2026-07-08 11:13:53.011189024 +0000 UTC m=+23.774542387"
Jul 08 11:13:53.011752 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.011720    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lwmjs" podStartSLOduration=5.802750284 podStartE2EDuration="24.011710261s" totalImagesPullingTime="18.208959977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:53.011188801 +0000 UTC m=+23.774542164" watchObservedRunningTime="2026-07-08 11:13:53.011710261 +0000 UTC m=+23.775063624"
Jul 08 11:13:53.084149 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.084124    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 11:13:53.459348 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.459320    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2nhll_01de7db5-6d86-4170-bf3b-798c52e19c5f/node-ca/0.log"
Jul 08 11:13:53.731695 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.731541    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T11:13:53.084143369Z","UUID":"ef0f4f3c-aeba-4eb6-a655-df3dd6b1541a","Handler":null,"Name":"","Endpoint":""}
Jul 08 11:13:53.733588 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.733566    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 11:13:53.733716 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.733602    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 11:13:53.828776 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.828743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:53.828958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.828743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:53.828958 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:53.828881    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:53.828958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.828743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:53.829118 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:53.828959    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:53.829118 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:53.829048    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:53.996542 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:53.996459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7" event={"ID":"5efd77a9-e881-4032-8674-13c5d8e9acf6","Type":"ContainerStarted","Data":"9cc571c614911eac5f758bbcb838d9d28ca985e3d917a8a9735204d053354b9e"}
Jul 08 11:13:55.001883 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:55.001846    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:13:55.002293 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:55.002249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"13eb1d275a40792d587c42908e340d63a7c29f4a2fba700663212732589f8d7f"}
Jul 08 11:13:55.004089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:55.004065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7" event={"ID":"5efd77a9-e881-4032-8674-13c5d8e9acf6","Type":"ContainerStarted","Data":"eaf44d9167b973586bbe58c419d943f3ecdbfa8ce1099c386d58d50961d74868"}
Jul 08 11:13:55.829294 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:55.829114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:55.829483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:55.829121    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:55.829483 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:55.829368    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:55.829483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:55.829180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:55.829483 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:55.829444    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:55.829703 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:55.829506    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:56.455630 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:56.455607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:56.456133 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:56.456120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:56.507743 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:56.507694    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6rqn7" podStartSLOduration=7.03187294 podStartE2EDuration="27.507673263s" totalImagesPullingTime="20.475800323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:55.043827208 +0000 UTC m=+25.807180572" watchObservedRunningTime="2026-07-08 11:13:56.507673263 +0000 UTC m=+27.271026632"
Jul 08 11:13:57.011468 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.011443    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:13:57.011758 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.011732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"72451543e5e375fe30ef88d076cd94759f36d2e780b5815b0e041a3627eaf35c"}
Jul 08 11:13:57.012098 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.012058    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:57.012266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.012248    2561 scope.go:117] "RemoveContainer" containerID="fa0c8eecde90ccd9cf24fa507a179ce45bc7f8d5082307e729b01a7d7f3dc786"
Jul 08 11:13:57.012497 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.012482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-959ql"
Jul 08 11:13:57.829056 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.828858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:57.829655 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.828892    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:57.829655 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:57.829129    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:57.829655 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:57.829200    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:57.829655 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:57.828899    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:57.829655 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:57.829290    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:13:58.017729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.017706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:13:58.018151 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.018123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" event={"ID":"db85efb0-a3b1-4598-8bb2-32a8b07d1080","Type":"ContainerStarted","Data":"e49aadf511dfd41432f5a101565f540795a587933b26beb98fdf42dcc538e532"}
Jul 08 11:13:58.021791 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.018943    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:58.021791 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.019098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:58.021791 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.019218    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:58.036886 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.036845    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:58.037979 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.037963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:13:58.111039 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:58.110965    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" podStartSLOduration=10.42399945 podStartE2EDuration="29.110950786s" totalImagesPullingTime="18.686951336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:58.071034764 +0000 UTC m=+28.834388127" watchObservedRunningTime="2026-07-08 11:13:58.110950786 +0000 UTC m=+28.874304150"
Jul 08 11:13:59.829233 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:59.829198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:13:59.829699 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:59.829315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:13:59.829699 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:13:59.829339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:13:59.829699 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:59.829314    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:13:59.829699 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:59.829418    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:13:59.829699 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:13:59.829526    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:01.026568 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:01.026485    2561 generic.go:356] "Generic (PLEG): container finished" podID="39663b3a-a65c-46b4-9455-f4f57b9ac59e" containerID="3638321a66b050d5f09b98f8844d345a896c17a8fac5da304934208b14c93f92" exitCode=0
Jul 08 11:14:01.026568 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:01.026529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerDied","Data":"3638321a66b050d5f09b98f8844d345a896c17a8fac5da304934208b14c93f92"}
Jul 08 11:14:01.832368 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:01.832341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:01.832535 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:01.832342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:01.832535 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:01.832448    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:01.832535 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:01.832342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:01.832670 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:01.832535    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:01.832670 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:01.832622    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:02.030249 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:02.030221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerStarted","Data":"12da726a00041391b4c830ace2605c4c83e9c2682639dc8b2b9fa881275d85da"}
Jul 08 11:14:03.034765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.034724    2561 generic.go:356] "Generic (PLEG): container finished" podID="39663b3a-a65c-46b4-9455-f4f57b9ac59e" containerID="12da726a00041391b4c830ace2605c4c83e9c2682639dc8b2b9fa881275d85da" exitCode=0
Jul 08 11:14:03.035151 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.034773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerDied","Data":"12da726a00041391b4c830ace2605c4c83e9c2682639dc8b2b9fa881275d85da"}
Jul 08 11:14:03.412103 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.412029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:03.412240 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.412167    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:14:03.412240 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.412220    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:14:35.412203268 +0000 UTC m=+66.175556627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:14:03.513415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.513383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:03.513581 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.513436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:03.513581 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.513537    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:14:03.513581 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.513578    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:14:03.513762 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.513597    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:14:35.513578972 +0000 UTC m=+66.276932314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:14:03.513762 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.513598    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:14:03.513762 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.513617    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:14:03.513762 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.513670    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:14:35.513646508 +0000 UTC m=+66.276999856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:14:03.829271 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.829242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:03.829430 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.829243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:03.829430 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.829342    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:03.829430 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:03.829357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:03.829588 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.829428    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:03.829588 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:03.829523    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:04.038861 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:04.038772    2561 generic.go:356] "Generic (PLEG): container finished" podID="39663b3a-a65c-46b4-9455-f4f57b9ac59e" containerID="ec541d52b0afd0d2c6ff604c3c378b741420b4026176430aab4ac34314b636a9" exitCode=0
Jul 08 11:14:04.038861 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:04.038820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerDied","Data":"ec541d52b0afd0d2c6ff604c3c378b741420b4026176430aab4ac34314b636a9"}
Jul 08 11:14:05.828416 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:05.828384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:05.828416 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:05.828391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:05.828945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:05.828391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:05.828945 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:05.828585    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:05.828945 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:05.828599    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:05.828945 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:05.828664    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:07.828764 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:07.828727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:07.829243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:07.828729    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:07.829243 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:07.828880    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:07.829243 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:07.829008    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:07.829243 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:07.829059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:07.829243 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:07.829172    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:09.830040 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:09.830010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:09.830382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:09.830104    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:09.830382 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:09.830139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:09.830382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:09.830177    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:09.830382 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:09.830198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:09.830382 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:09.830240    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:10.058795 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:10.058765    2561 generic.go:356] "Generic (PLEG): container finished" podID="39663b3a-a65c-46b4-9455-f4f57b9ac59e" containerID="f045817f16445ad926efad4ed2bce7956717c79ab69ce3059101df801112c02d" exitCode=0
Jul 08 11:14:10.058963 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:10.058802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerDied","Data":"f045817f16445ad926efad4ed2bce7956717c79ab69ce3059101df801112c02d"}
Jul 08 11:14:11.064151 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:11.064120    2561 generic.go:356] "Generic (PLEG): container finished" podID="39663b3a-a65c-46b4-9455-f4f57b9ac59e" containerID="a2fce241071d2604d6dbc139b4946144b2a02a53b7f2bbca3e1153916bfb37b1" exitCode=0
Jul 08 11:14:11.064549 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:11.064190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerDied","Data":"a2fce241071d2604d6dbc139b4946144b2a02a53b7f2bbca3e1153916bfb37b1"}
Jul 08 11:14:11.829264 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:11.829229    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:11.829442 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:11.829240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:11.829442 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:11.829240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:11.829442 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:11.829418    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:11.829586 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:11.829326    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:11.829586 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:11.829503    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:12.069391 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:12.069360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" event={"ID":"39663b3a-a65c-46b4-9455-f4f57b9ac59e","Type":"ContainerStarted","Data":"edb34d26aecbf37415ad11d7d1b52cd2b5ad68568878a97e580ed3f22143c253"}
Jul 08 11:14:12.163792 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:12.163700    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2kp7x" podStartSLOduration=10.734999806 podStartE2EDuration="43.163681948s" totalImagesPullingTime="32.428682142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:12.163290478 +0000 UTC m=+42.926643852" watchObservedRunningTime="2026-07-08 11:14:12.163681948 +0000 UTC m=+42.927035314"
Jul 08 11:14:13.829253 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:13.829216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:13.829253 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:13.829237    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:13.829884 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:13.829347    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:13.829884 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:13.829394    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:13.829884 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:13.829436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:13.829884 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:13.829511    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:15.828728 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:15.828698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:15.828728 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:15.828726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:15.829240 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:15.828700    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:15.829240 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:15.828792    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:15.829240 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:15.828924    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:15.829240 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:15.828951    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:17.828765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:17.828729    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:17.828765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:17.828747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:17.828765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:17.828748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:17.829346 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:17.828823    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:17.829346 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:17.828921    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:17.829346 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:17.829000    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:19.829817 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:19.829788    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:19.830207 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:19.829905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:19.830207 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:19.829902    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:19.830207 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:19.829972    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:19.830207 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:19.829994    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:19.830207 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:19.830077    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:21.828919 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:21.828860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:21.828919 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:21.828911    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:21.829460 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:21.829010    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:21.829460 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:21.829060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:21.829460 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:21.829136    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:21.829460 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:21.829243    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:23.829059 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:23.829028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:23.829059 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:23.829050    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:23.829530 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:23.829029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:23.829530 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:23.829122    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:23.829530 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:23.829227    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:23.829530 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:23.829270    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:25.828683 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:25.828650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:25.828683 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:25.828677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:25.829269 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:25.828657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:25.829269 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:25.828769    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:25.829269 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:25.828844    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:25.829269 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:25.828934    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:27.829103 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:27.829067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:27.829103 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:27.829085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:27.829486 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:27.829070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:27.829486 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:27.829187    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:27.829486 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:27.829234    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:27.829486 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:27.829295    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:29.829270 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:29.829236    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:29.829826 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:29.829323    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:29.829826 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:29.829430    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:29.829826 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:29.829529    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:29.829826 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:29.829561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:29.829826 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:29.829633    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:30.032962 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:30.032846    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pz758" podUID="db85efb0-a3b1-4598-8bb2-32a8b07d1080" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 08 11:14:31.828682 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:31.828652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:31.829238 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:31.828737    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:31.829238 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:31.828656    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:31.829238 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:31.828816    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:31.829238 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:31.828652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:31.829238 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:31.828934    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:33.829108 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:33.829074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:33.829501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:33.829069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:33.829501 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:33.829174    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:33.829501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:33.829194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:33.829501 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:33.829282    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:33.829501 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:33.829350    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:35.455014 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:35.454981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:35.455399 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.455103    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:14:35.455399 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.455153    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs podName:3476b4e6-46ea-42b5-93a5-d5fde4db179c nodeName:}" failed. No retries permitted until 2026-07-08 11:15:39.45514023 +0000 UTC m=+130.218493572 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs") pod "network-metrics-daemon-4k9pm" (UID: "3476b4e6-46ea-42b5-93a5-d5fde4db179c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 11:14:35.555515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:35.555484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:35.555627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:35.555521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:35.555627 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.555619    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 11:14:35.555697 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.555632    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 11:14:35.555697 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.555645    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 11:14:35.555697 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.555654    2561 projected.go:196] Error preparing data for projected volume kube-api-access-nx4lz for pod openshift-network-diagnostics/network-check-target-kb7k6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:14:35.555697 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.555679    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret podName:4b5572f4-4d54-4f11-af5f-3946b41cb37f nodeName:}" failed. No retries permitted until 2026-07-08 11:15:39.555664772 +0000 UTC m=+130.319018113 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret") pod "global-pull-secret-syncer-qjxsr" (UID: "4b5572f4-4d54-4f11-af5f-3946b41cb37f") : object "kube-system"/"original-pull-secret" not registered
Jul 08 11:14:35.555697 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.555696    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz podName:60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3 nodeName:}" failed. No retries permitted until 2026-07-08 11:15:39.555685536 +0000 UTC m=+130.319038878 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nx4lz" (UniqueName: "kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz") pod "network-check-target-kb7k6" (UID: "60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 11:14:35.828397 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:35.828362    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:35.828397 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:35.828387    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:35.828599 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:35.828370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:35.828599 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.828465    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:35.828599 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.828536    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:35.828695 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:35.828634    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:37.122592 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.122565    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:14:37.123157 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.122608    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e9640ba-98da-49bf-82d8-6a1a136fd760" containerID="f5d6c36bd546ae1f5fbb6b0942f7595e46804120a7396cd0f9c1451a3ec23d69" exitCode=1
Jul 08 11:14:37.123157 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.122639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf8f6" event={"ID":"2e9640ba-98da-49bf-82d8-6a1a136fd760","Type":"ContainerDied","Data":"f5d6c36bd546ae1f5fbb6b0942f7595e46804120a7396cd0f9c1451a3ec23d69"}
Jul 08 11:14:37.123157 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.123086    2561 scope.go:117] "RemoveContainer" containerID="f5d6c36bd546ae1f5fbb6b0942f7595e46804120a7396cd0f9c1451a3ec23d69"
Jul 08 11:14:37.829287 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.829250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:37.829481 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.829250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:37.829481 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:37.829346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:37.829481 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:37.829341    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:37.829481 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:37.829429    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:37.829708 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:37.829493    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:38.126381 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:38.126307    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:14:38.126381 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:38.126362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf8f6" event={"ID":"2e9640ba-98da-49bf-82d8-6a1a136fd760","Type":"ContainerStarted","Data":"3ec1deffcb5097f6efa0b5d54597854e52bca3d498fee8cd5d24de7a722e5e7d"}
Jul 08 11:14:39.829188 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:39.829151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:39.829611 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:39.829250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:39.829611 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:39.829312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:39.829611 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:39.829397    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:39.829611 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:39.829428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:39.829611 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:39.829515    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:41.828838 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:41.828647    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:41.829209 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:41.828648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:41.829209 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:41.828941    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:41.829209 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:41.828697    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:41.829209 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:41.829015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:41.829209 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:41.829088    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:41.876482 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:41.876452    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kb7k6"]
Jul 08 11:14:41.879166 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:41.879136    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4k9pm"]
Jul 08 11:14:41.882722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:41.882700    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qjxsr"]
Jul 08 11:14:42.135128 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:42.135101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:42.135128 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:42.135129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:42.135342 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:42.135213    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:42.135342 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:42.135227    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:42.135342 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:42.135280    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:42.135492 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:42.135433    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:43.828914 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:43.828860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:43.828914 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:43.828904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:43.829370 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:43.829005    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:43.829370 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:43.829055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:43.829370 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:43.829119    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:43.829370 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:43.829210    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:45.829366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:45.829335    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:45.829366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:45.829357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:45.829763 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:45.829335    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:45.829763 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:45.829445    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kb7k6" podUID="60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3"
Jul 08 11:14:45.829763 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:45.829507    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjxsr" podUID="4b5572f4-4d54-4f11-af5f-3946b41cb37f"
Jul 08 11:14:45.829763 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:45.829591    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4k9pm" podUID="3476b4e6-46ea-42b5-93a5-d5fde4db179c"
Jul 08 11:14:46.004509 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.004479    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-201.ec2.internal" event="NodeReady"
Jul 08 11:14:46.004641 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.004587    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 11:14:46.086761 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.086692    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zslfs"]
Jul 08 11:14:46.088399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.088384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.095833 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.095813    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cp6jk\""
Jul 08 11:14:46.096254 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.096232    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dd6tr"]
Jul 08 11:14:46.096443 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.096429    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 11:14:46.098037 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.098024    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.102300 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.102265    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 11:14:46.102407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.102325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 11:14:46.102504 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.102489    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 11:14:46.102558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.102494    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 11:14:46.102558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.102516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5prrl\""
Jul 08 11:14:46.107715 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.107700    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 11:14:46.115195 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.115161    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd6tr"]
Jul 08 11:14:46.116006 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.115985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zslfs"]
Jul 08 11:14:46.179918 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.179891    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d7lrq"]
Jul 08 11:14:46.181505 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.181489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.185110 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.185090    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 11:14:46.185220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.185090    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 11:14:46.185220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.185169    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 11:14:46.185462 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.185447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkr92\""
Jul 08 11:14:46.199795 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.199771    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d7lrq"]
Jul 08 11:14:46.236138 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-config-volume\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.236241 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rtc\" (UniqueName: \"kubernetes.io/projected/750c064b-9e8a-4f79-9d09-cf047b2e05e8-kube-api-access-s8rtc\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.236241 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-tmp-dir\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.236313 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-metrics-tls\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.236346 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45z75\" (UniqueName: \"kubernetes.io/projected/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-kube-api-access-45z75\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.236379 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/750c064b-9e8a-4f79-9d09-cf047b2e05e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.236417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/750c064b-9e8a-4f79-9d09-cf047b2e05e8-crio-socket\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.236417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/750c064b-9e8a-4f79-9d09-cf047b2e05e8-data-volume\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.236476 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.236431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/750c064b-9e8a-4f79-9d09-cf047b2e05e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.336915 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.336829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/750c064b-9e8a-4f79-9d09-cf047b2e05e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.336915 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.336887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-config-volume\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.337089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.336914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rtc\" (UniqueName: \"kubernetes.io/projected/750c064b-9e8a-4f79-9d09-cf047b2e05e8-kube-api-access-s8rtc\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.336953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-tmp-dir\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.337089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.336993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-metrics-tls\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.337089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45z75\" (UniqueName: \"kubernetes.io/projected/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-kube-api-access-45z75\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.337089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/750c064b-9e8a-4f79-9d09-cf047b2e05e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/750c064b-9e8a-4f79-9d09-cf047b2e05e8-crio-socket\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/750c064b-9e8a-4f79-9d09-cf047b2e05e8-data-volume\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53b10f49-0798-44ad-a5ef-aee1c07d7f6d-cert\") pod \"ingress-canary-d7lrq\" (UID: \"53b10f49-0798-44ad-a5ef-aee1c07d7f6d\") " pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.337335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw57h\" (UniqueName: \"kubernetes.io/projected/53b10f49-0798-44ad-a5ef-aee1c07d7f6d-kube-api-access-zw57h\") pod \"ingress-canary-d7lrq\" (UID: \"53b10f49-0798-44ad-a5ef-aee1c07d7f6d\") " pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.337527 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337384    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/750c064b-9e8a-4f79-9d09-cf047b2e05e8-crio-socket\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337527 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337503    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/750c064b-9e8a-4f79-9d09-cf047b2e05e8-data-volume\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337655 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337622    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-config-volume\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.337770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337709    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/750c064b-9e8a-4f79-9d09-cf047b2e05e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.337819 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.337777    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-tmp-dir\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.341120 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.341096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-metrics-tls\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.341219 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.341097    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/750c064b-9e8a-4f79-9d09-cf047b2e05e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.353200 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.353175    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45z75\" (UniqueName: \"kubernetes.io/projected/7a195fc6-882c-4e50-8b6d-aa4d9a64c964-kube-api-access-45z75\") pod \"dns-default-zslfs\" (UID: \"7a195fc6-882c-4e50-8b6d-aa4d9a64c964\") " pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.353301 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.353249    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rtc\" (UniqueName: \"kubernetes.io/projected/750c064b-9e8a-4f79-9d09-cf047b2e05e8-kube-api-access-s8rtc\") pod \"insights-runtime-extractor-dd6tr\" (UID: \"750c064b-9e8a-4f79-9d09-cf047b2e05e8\") " pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.397293 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.397268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:46.406054 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.405945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd6tr"
Jul 08 11:14:46.438023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.437992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53b10f49-0798-44ad-a5ef-aee1c07d7f6d-cert\") pod \"ingress-canary-d7lrq\" (UID: \"53b10f49-0798-44ad-a5ef-aee1c07d7f6d\") " pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.438023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.438028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw57h\" (UniqueName: \"kubernetes.io/projected/53b10f49-0798-44ad-a5ef-aee1c07d7f6d-kube-api-access-zw57h\") pod \"ingress-canary-d7lrq\" (UID: \"53b10f49-0798-44ad-a5ef-aee1c07d7f6d\") " pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.440826 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.440806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53b10f49-0798-44ad-a5ef-aee1c07d7f6d-cert\") pod \"ingress-canary-d7lrq\" (UID: \"53b10f49-0798-44ad-a5ef-aee1c07d7f6d\") " pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.449119 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.449096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw57h\" (UniqueName: \"kubernetes.io/projected/53b10f49-0798-44ad-a5ef-aee1c07d7f6d-kube-api-access-zw57h\") pod \"ingress-canary-d7lrq\" (UID: \"53b10f49-0798-44ad-a5ef-aee1c07d7f6d\") " pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.489331 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.489296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d7lrq"
Jul 08 11:14:46.564832 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.564798    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zslfs"]
Jul 08 11:14:46.566141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.566113    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd6tr"]
Jul 08 11:14:46.574043 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:46.574017    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a195fc6_882c_4e50_8b6d_aa4d9a64c964.slice/crio-a1ec077acbddaded56262b4a2a01e94da3e600bf5dd8ae109bbebc6c205afa3b WatchSource:0}: Error finding container a1ec077acbddaded56262b4a2a01e94da3e600bf5dd8ae109bbebc6c205afa3b: Status 404 returned error can't find the container with id a1ec077acbddaded56262b4a2a01e94da3e600bf5dd8ae109bbebc6c205afa3b
Jul 08 11:14:46.627469 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:46.627385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d7lrq"]
Jul 08 11:14:46.630720 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:46.630695    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b10f49_0798_44ad_a5ef_aee1c07d7f6d.slice/crio-6cd51bcaa664df2560c030d35fd56ffeb556c7b1b8ccc75af74afe0a900c9791 WatchSource:0}: Error finding container 6cd51bcaa664df2560c030d35fd56ffeb556c7b1b8ccc75af74afe0a900c9791: Status 404 returned error can't find the container with id 6cd51bcaa664df2560c030d35fd56ffeb556c7b1b8ccc75af74afe0a900c9791
Jul 08 11:14:47.149833 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.149789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d7lrq" event={"ID":"53b10f49-0798-44ad-a5ef-aee1c07d7f6d","Type":"ContainerStarted","Data":"6cd51bcaa664df2560c030d35fd56ffeb556c7b1b8ccc75af74afe0a900c9791"}
Jul 08 11:14:47.152082 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.152050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd6tr" event={"ID":"750c064b-9e8a-4f79-9d09-cf047b2e05e8","Type":"ContainerStarted","Data":"643904b40d3e32550b52053ffba21e112092c1c2dbe9c7f7f4c0b6a9d11eddc0"}
Jul 08 11:14:47.155430 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.155360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zslfs" event={"ID":"7a195fc6-882c-4e50-8b6d-aa4d9a64c964","Type":"ContainerStarted","Data":"a1ec077acbddaded56262b4a2a01e94da3e600bf5dd8ae109bbebc6c205afa3b"}
Jul 08 11:14:47.833588 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.833558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:14:47.833782 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.833558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:14:47.833907 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.833562    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:14:47.837939 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.837921    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 11:14:47.838767 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.838750    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 11:14:47.839067 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.839017    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wnzzp\""
Jul 08 11:14:47.839067 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.839049    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 11:14:47.839230 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.839069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-469dh\""
Jul 08 11:14:47.839230 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:47.839095    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 11:14:49.860019 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.859889    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"]
Jul 08 11:14:49.871358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.871328    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:49.886123 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.886100    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 11:14:49.886267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.886133    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2dhvn\""
Jul 08 11:14:49.886267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.886102    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 11:14:49.886267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.886227    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 11:14:49.886267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.886100    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 11:14:49.886472 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.886343    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 11:14:49.905407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.905141    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"]
Jul 08 11:14:49.905799 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.905779    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7lgng"]
Jul 08 11:14:49.910144 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.910124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:49.918132 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.917988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 11:14:49.918132 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.918127    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bm97j\""
Jul 08 11:14:49.918264 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.918233    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 11:14:49.918470 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.918435    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 11:14:49.964343 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.964311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwhkk\" (UniqueName: \"kubernetes.io/projected/516693f1-7417-4b5b-8f49-d56ee966eb5d-kube-api-access-lwhkk\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:49.964539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.964361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/516693f1-7417-4b5b-8f49-d56ee966eb5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:49.964539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.964392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/516693f1-7417-4b5b-8f49-d56ee966eb5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:49.964539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.964415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/516693f1-7417-4b5b-8f49-d56ee966eb5d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:49.982785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.982753    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"]
Jul 08 11:14:49.988343 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.988313    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:49.991283 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.991259    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-56tzj\""
Jul 08 11:14:49.991573 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.991543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 11:14:49.991689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.991576    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 11:14:49.991689 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:49.991577    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 11:14:50.012459 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.012432    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"]
Jul 08 11:14:50.065703 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a23de9a-2b17-4cf2-9b90-24639d7e0367-metrics-client-ca\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.065918 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwhkk\" (UniqueName: \"kubernetes.io/projected/516693f1-7417-4b5b-8f49-d56ee966eb5d-kube-api-access-lwhkk\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.065918 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.065918 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdh5\" (UniqueName: \"kubernetes.io/projected/1a23de9a-2b17-4cf2-9b90-24639d7e0367-kube-api-access-dxdh5\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.065918 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/516693f1-7417-4b5b-8f49-d56ee966eb5d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.065979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-root\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.066158 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066149    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-tls\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.066483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-textfile\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/516693f1-7417-4b5b-8f49-d56ee966eb5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.066483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88blb\" (UniqueName: \"kubernetes.io/projected/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-api-access-88blb\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.066483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-wtmp\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/516693f1-7417-4b5b-8f49-d56ee966eb5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.066686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-sys\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.066739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.066691    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/516693f1-7417-4b5b-8f49-d56ee966eb5d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.069443 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.069417    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/516693f1-7417-4b5b-8f49-d56ee966eb5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.069554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.069416    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/516693f1-7417-4b5b-8f49-d56ee966eb5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.091678 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.091654    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwhkk\" (UniqueName: \"kubernetes.io/projected/516693f1-7417-4b5b-8f49-d56ee966eb5d-kube-api-access-lwhkk\") pod \"openshift-state-metrics-54cf96dfcf-xw5vf\" (UID: \"516693f1-7417-4b5b-8f49-d56ee966eb5d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.167739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-sys\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.167739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a23de9a-2b17-4cf2-9b90-24639d7e0367-metrics-client-ca\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdh5\" (UniqueName: \"kubernetes.io/projected/1a23de9a-2b17-4cf2-9b90-24639d7e0367-kube-api-access-dxdh5\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167854    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-sys\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-root\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.167979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-tls\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-textfile\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88blb\" (UniqueName: \"kubernetes.io/projected/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-api-access-88blb\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.168203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-wtmp\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168570 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168265    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a23de9a-2b17-4cf2-9b90-24639d7e0367-metrics-client-ca\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168570 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168313    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-wtmp\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168570 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168388    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-accelerators-collector-config\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168588    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-textfile\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.168729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168686    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.168729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168687    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a23de9a-2b17-4cf2-9b90-24639d7e0367-root\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.168729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.168727    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.170681 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.170654    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.171247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.171170    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.171247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.171218    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a23de9a-2b17-4cf2-9b90-24639d7e0367-node-exporter-tls\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.171510 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.171249    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.181788 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.181757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"
Jul 08 11:14:50.195201 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.195179    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88blb\" (UniqueName: \"kubernetes.io/projected/ea676d20-78ec-4f4f-b2b7-52f61b6f7eda-kube-api-access-88blb\") pod \"kube-state-metrics-7c9dbb8b7d-jr86n\" (UID: \"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:50.196252 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.196231    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdh5\" (UniqueName: \"kubernetes.io/projected/1a23de9a-2b17-4cf2-9b90-24639d7e0367-kube-api-access-dxdh5\") pod \"node-exporter-7lgng\" (UID: \"1a23de9a-2b17-4cf2-9b90-24639d7e0367\") " pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.221928 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.221906    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7lgng"
Jul 08 11:14:50.300150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:50.300117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"
Jul 08 11:14:51.823428 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:51.823250    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a23de9a_2b17_4cf2_9b90_24639d7e0367.slice/crio-26b53359e2a608eb3f2a6165e108e2067f3a6bbb084993f19018fa0ea2d9c641 WatchSource:0}: Error finding container 26b53359e2a608eb3f2a6165e108e2067f3a6bbb084993f19018fa0ea2d9c641: Status 404 returned error can't find the container with id 26b53359e2a608eb3f2a6165e108e2067f3a6bbb084993f19018fa0ea2d9c641
Jul 08 11:14:52.003239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.003205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf"]
Jul 08 11:14:52.008941 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:52.008912    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516693f1_7417_4b5b_8f49_d56ee966eb5d.slice/crio-536d7e99553b1ce628ece9d2c16dbd0ab7190a1138422d326cfbdcf92bc3d80f WatchSource:0}: Error finding container 536d7e99553b1ce628ece9d2c16dbd0ab7190a1138422d326cfbdcf92bc3d80f: Status 404 returned error can't find the container with id 536d7e99553b1ce628ece9d2c16dbd0ab7190a1138422d326cfbdcf92bc3d80f
Jul 08 11:14:52.094703 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.094480    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n"]
Jul 08 11:14:52.098851 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:52.098829    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea676d20_78ec_4f4f_b2b7_52f61b6f7eda.slice/crio-071a758d77493d853c5609029381fbd413110beed2971b785311da38e44ef71c WatchSource:0}: Error finding container 071a758d77493d853c5609029381fbd413110beed2971b785311da38e44ef71c: Status 404 returned error can't find the container with id 071a758d77493d853c5609029381fbd413110beed2971b785311da38e44ef71c
Jul 08 11:14:52.174552 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.174520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d7lrq" event={"ID":"53b10f49-0798-44ad-a5ef-aee1c07d7f6d","Type":"ContainerStarted","Data":"9699e788cbbb2e607cc7017b023a7ba8ee901673e5a881bea970b69d6b113103"}
Jul 08 11:14:52.175677 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.175651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lgng" event={"ID":"1a23de9a-2b17-4cf2-9b90-24639d7e0367","Type":"ContainerStarted","Data":"26b53359e2a608eb3f2a6165e108e2067f3a6bbb084993f19018fa0ea2d9c641"}
Jul 08 11:14:52.177563 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.177540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf" event={"ID":"516693f1-7417-4b5b-8f49-d56ee966eb5d","Type":"ContainerStarted","Data":"2f92510d2dc67d2e634061653bf00d6ad5523bf28233ee4a7eebd2b7cca2b410"}
Jul 08 11:14:52.177679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.177592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf" event={"ID":"516693f1-7417-4b5b-8f49-d56ee966eb5d","Type":"ContainerStarted","Data":"e6b381e63fc21d399e863f70ee958632a538b502e7d9aff67020b61abaf6a693"}
Jul 08 11:14:52.177679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.177622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf" event={"ID":"516693f1-7417-4b5b-8f49-d56ee966eb5d","Type":"ContainerStarted","Data":"536d7e99553b1ce628ece9d2c16dbd0ab7190a1138422d326cfbdcf92bc3d80f"}
Jul 08 11:14:52.182142 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.182120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zslfs" event={"ID":"7a195fc6-882c-4e50-8b6d-aa4d9a64c964","Type":"ContainerStarted","Data":"4b5eacbd70e0823fa096940be51943b7d8931def049330f7e3252418aefae3a0"}
Jul 08 11:14:52.182247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.182159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zslfs" event={"ID":"7a195fc6-882c-4e50-8b6d-aa4d9a64c964","Type":"ContainerStarted","Data":"1f1cc9252be7bb8bfff9a8fa84e1468415f92f626c3a1e0a2a5d50431dcb0f79"}
Jul 08 11:14:52.182303 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.182252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zslfs"
Jul 08 11:14:52.184237 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.184201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n" event={"ID":"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda","Type":"ContainerStarted","Data":"071a758d77493d853c5609029381fbd413110beed2971b785311da38e44ef71c"}
Jul 08 11:14:52.185812 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.185791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd6tr" event={"ID":"750c064b-9e8a-4f79-9d09-cf047b2e05e8","Type":"ContainerStarted","Data":"29451023662fe71e570444e4fda71c2fcd99e7e1e1c4d33fcac761572928fa20"}
Jul 08 11:14:52.271731 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.271684    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d7lrq" podStartSLOduration=1.080568662 podStartE2EDuration="6.271668209s" totalImagesPullingTime="5.191099547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:52.230987013 +0000 UTC m=+82.994340378" watchObservedRunningTime="2026-07-08 11:14:52.271668209 +0000 UTC m=+83.035021551"
Jul 08 11:14:52.271909 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:52.271797    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zslfs" podStartSLOduration=1.033181498 podStartE2EDuration="6.271791206s" totalImagesPullingTime="5.238609708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:52.271300862 +0000 UTC m=+83.034654227" watchObservedRunningTime="2026-07-08 11:14:52.271791206 +0000 UTC m=+83.035144569"
Jul 08 11:14:53.191554 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:53.191508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd6tr" event={"ID":"750c064b-9e8a-4f79-9d09-cf047b2e05e8","Type":"ContainerStarted","Data":"ec255a91c1254ed0593eccf92da1b719af1a0d59d1f6832abe2e3a47e1fca97f"}
Jul 08 11:14:53.193302 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:53.193276    2561 generic.go:356] "Generic (PLEG): container finished" podID="1a23de9a-2b17-4cf2-9b90-24639d7e0367" containerID="7739f03f77a8f4b6bc01299a44fac09a64ad33d0302e43f0d4a59c8cc9a915a8" exitCode=0
Jul 08 11:14:53.193429 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:53.193371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lgng" event={"ID":"1a23de9a-2b17-4cf2-9b90-24639d7e0367","Type":"ContainerDied","Data":"7739f03f77a8f4b6bc01299a44fac09a64ad33d0302e43f0d4a59c8cc9a915a8"}
Jul 08 11:14:54.202333 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.201986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n" event={"ID":"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda","Type":"ContainerStarted","Data":"96e60b804bdd84a05cecfc8c52cdd3d7b07567ae5b95aa92378efb5ddc089702"}
Jul 08 11:14:54.208034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.203176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n" event={"ID":"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda","Type":"ContainerStarted","Data":"12132068e4d64c54792ee3a5af3f6ef8469e388720db6e7edf2e7b6b53770c8c"}
Jul 08 11:14:54.208034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.203307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n" event={"ID":"ea676d20-78ec-4f4f-b2b7-52f61b6f7eda","Type":"ContainerStarted","Data":"88842f9e3a8d9292e47b3170bf2713d91aa64699914043f98c2e1578b0319a02"}
Jul 08 11:14:54.208034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.206072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lgng" event={"ID":"1a23de9a-2b17-4cf2-9b90-24639d7e0367","Type":"ContainerStarted","Data":"d1aa5be3fbd6ef8dcddb16fd29dbfabdf0d2ef4b890aecca0bf6233d558d39f3"}
Jul 08 11:14:54.208034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.206151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7lgng" event={"ID":"1a23de9a-2b17-4cf2-9b90-24639d7e0367","Type":"ContainerStarted","Data":"25e8b04391fc7e599c77c90ee537e5c62cf0c13265df24d18f49f42918241c71"}
Jul 08 11:14:54.209710 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.209682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf" event={"ID":"516693f1-7417-4b5b-8f49-d56ee966eb5d","Type":"ContainerStarted","Data":"d76a30da5878e5e2afbe74c0b3e098cad74f9b99a8c707e1ccc4fa128189e593"}
Jul 08 11:14:54.270972 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.270936    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"]
Jul 08 11:14:54.274307 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.274281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:54.294386 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.294357    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 11:14:54.294553 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.294537    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cdd4p\""
Jul 08 11:14:54.294889 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.294829    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jr86n" podStartSLOduration=3.554707145 podStartE2EDuration="5.294815946s" totalImagesPullingTime="1.740108801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:54.294476085 +0000 UTC m=+85.057829450" watchObservedRunningTime="2026-07-08 11:14:54.294815946 +0000 UTC m=+85.058169288"
Jul 08 11:14:54.301405 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.301377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"]
Jul 08 11:14:54.408879 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.408787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:54.409040 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.408907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt69z\" (UniqueName: \"kubernetes.io/projected/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-kube-api-access-mt69z\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:54.478444 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.478384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xw5vf" podStartSLOduration=3.796075118 podStartE2EDuration="5.478365493s" totalImagesPullingTime="1.682290375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:54.385377867 +0000 UTC m=+85.148731233" watchObservedRunningTime="2026-07-08 11:14:54.478365493 +0000 UTC m=+85.241718856"
Jul 08 11:14:54.478634 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.478515    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7lgng" podStartSLOduration=4.479765033 podStartE2EDuration="5.478505089s" totalImagesPullingTime="927.152007ms" totalInitContainerRuntime="71.588049ms" isStatefulPod=true podCreationTimestamp="2026-07-08 11:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:54.468110493 +0000 UTC m=+85.231463857" watchObservedRunningTime="2026-07-08 11:14:54.478505089 +0000 UTC m=+85.241858453"
Jul 08 11:14:54.509967 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.509931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt69z\" (UniqueName: \"kubernetes.io/projected/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-kube-api-access-mt69z\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:54.510146 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.510003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:54.510210 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:54.510163    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 11:14:54.510247 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:14:54.510223    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-monitoring-plugin-cert podName:5920737f-2fdb-4be8-b4c7-aabdb1787b1e nodeName:}" failed. No retries permitted until 2026-07-08 11:14:55.010206591 +0000 UTC m=+85.773559953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-jxwb7" (UID: "5920737f-2fdb-4be8-b4c7-aabdb1787b1e") : secret "monitoring-plugin-cert" not found
Jul 08 11:14:54.541197 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.541163    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt69z\" (UniqueName: \"kubernetes.io/projected/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-kube-api-access-mt69z\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:54.602182 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.602150    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b5659f4-wg7bx"]
Jul 08 11:14:54.607334 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.606800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.615470 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.615444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 11:14:54.615470 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.615462    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 11:14:54.615660 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.615444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 11:14:54.615975 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.615959    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 11:14:54.618014 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.617997    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ljfw4\""
Jul 08 11:14:54.627599 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.627573    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8q6ik3c76ejie\""
Jul 08 11:14:54.660828 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.660759    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b5659f4-wg7bx"]
Jul 08 11:14:54.711445 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-client-ca-bundle\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.711445 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-secret-metrics-server-client-certs\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.711445 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-audit-log\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.711739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf5bs\" (UniqueName: \"kubernetes.io/projected/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-kube-api-access-cf5bs\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.711739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.711739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-metrics-server-audit-profiles\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.711739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.711658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-secret-metrics-server-tls\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813022 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.812985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-audit-log\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813022 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf5bs\" (UniqueName: \"kubernetes.io/projected/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-kube-api-access-cf5bs\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-metrics-server-audit-profiles\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-secret-metrics-server-tls\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813267 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-client-ca-bundle\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813442 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-secret-metrics-server-client-certs\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.813442 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.813399    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-audit-log\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.814326 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.814298    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.814490 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.814466    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-metrics-server-audit-profiles\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.816206 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.816179    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-secret-metrics-server-client-certs\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.816297 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.816192    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-secret-metrics-server-tls\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.816297 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.816229    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-client-ca-bundle\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.828104 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.828079    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf5bs\" (UniqueName: \"kubernetes.io/projected/50a7b652-5b98-4b44-961b-4a6bbc0a72e8-kube-api-access-cf5bs\") pod \"metrics-server-5b5659f4-wg7bx\" (UID: \"50a7b652-5b98-4b44-961b-4a6bbc0a72e8\") " pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:54.917429 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:54.917340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:14:55.015192 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.015163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:55.017975 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.017950    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5920737f-2fdb-4be8-b4c7-aabdb1787b1e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-jxwb7\" (UID: \"5920737f-2fdb-4be8-b4c7-aabdb1787b1e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:55.186407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.186321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:55.190595 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.190567    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"]
Jul 08 11:14:55.195331 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.195309    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.198390 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.198364    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 11:14:55.198510 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.198423    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 11:14:55.198578 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.198507    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 11:14:55.198906 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.198886    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 11:14:55.198906 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.198897    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jgpwv\""
Jul 08 11:14:55.199067 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.198948    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 11:14:55.207009 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.206989    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 11:14:55.230361 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.230334    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"]
Jul 08 11:14:55.318188 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.318148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-federate-client-tls\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.318483 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.318429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.319062 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.319020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-serving-certs-ca-bundle\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.319181 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.319101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdjc\" (UniqueName: \"kubernetes.io/projected/61e52fa5-8962-4714-9e22-f4fe7bffe133-kube-api-access-hsdjc\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.319257 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.319164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-telemeter-client-tls\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.319257 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.319227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.319366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.319355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-secret-telemeter-client\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.319435 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.319413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-metrics-client-ca\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.420923 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.420884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421082 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.420964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-serving-certs-ca-bundle\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421082 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.420991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdjc\" (UniqueName: \"kubernetes.io/projected/61e52fa5-8962-4714-9e22-f4fe7bffe133-kube-api-access-hsdjc\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421082 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.421035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-telemeter-client-tls\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421225 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.421084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421225 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.421121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-secret-telemeter-client\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421225 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.421177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-metrics-client-ca\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.421272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-federate-client-tls\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.421828 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.421496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-serving-certs-ca-bundle\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.422127 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.422083    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-metrics-client-ca\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.422601 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.422457    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e52fa5-8962-4714-9e22-f4fe7bffe133-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.424453 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.424425    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.424846 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.424823    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-federate-client-tls\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.425296 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.425272    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-telemeter-client-tls\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.425447 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.425425    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61e52fa5-8962-4714-9e22-f4fe7bffe133-secret-telemeter-client\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.446635 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.444961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdjc\" (UniqueName: \"kubernetes.io/projected/61e52fa5-8962-4714-9e22-f4fe7bffe133-kube-api-access-hsdjc\") pod \"telemeter-client-c9dd655dc-6lt7k\" (UID: \"61e52fa5-8962-4714-9e22-f4fe7bffe133\") " pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.507190 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.506040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"
Jul 08 11:14:55.541914 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.541738    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"]
Jul 08 11:14:55.543413 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:55.543379    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5920737f_2fdb_4be8_b4c7_aabdb1787b1e.slice/crio-02eb0336eb19ace15f63d56f9b0738a14727489d6952fce69a35d31fbf96a17c WatchSource:0}: Error finding container 02eb0336eb19ace15f63d56f9b0738a14727489d6952fce69a35d31fbf96a17c: Status 404 returned error can't find the container with id 02eb0336eb19ace15f63d56f9b0738a14727489d6952fce69a35d31fbf96a17c
Jul 08 11:14:55.549543 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.549520    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b5659f4-wg7bx"]
Jul 08 11:14:55.552480 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:55.552457    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a7b652_5b98_4b44_961b_4a6bbc0a72e8.slice/crio-7f79aeb748ac148fb0f8e90126e252b79220bd38f3731e4a73a5af14b05b6ff0 WatchSource:0}: Error finding container 7f79aeb748ac148fb0f8e90126e252b79220bd38f3731e4a73a5af14b05b6ff0: Status 404 returned error can't find the container with id 7f79aeb748ac148fb0f8e90126e252b79220bd38f3731e4a73a5af14b05b6ff0
Jul 08 11:14:55.651817 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:55.651793    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c9dd655dc-6lt7k"]
Jul 08 11:14:55.653615 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:14:55.653590    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e52fa5_8962_4714_9e22_f4fe7bffe133.slice/crio-74d05c1fa81e441b9a055077b7097682bfaec598b754ddd77148230259fe301c WatchSource:0}: Error finding container 74d05c1fa81e441b9a055077b7097682bfaec598b754ddd77148230259fe301c: Status 404 returned error can't find the container with id 74d05c1fa81e441b9a055077b7097682bfaec598b754ddd77148230259fe301c
Jul 08 11:14:56.220824 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:56.220781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd6tr" event={"ID":"750c064b-9e8a-4f79-9d09-cf047b2e05e8","Type":"ContainerStarted","Data":"8cd632b486d0417eb29e470af211fdc64a7a651e335dff538e53db4117fc38a2"}
Jul 08 11:14:56.222095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:56.222066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k" event={"ID":"61e52fa5-8962-4714-9e22-f4fe7bffe133","Type":"ContainerStarted","Data":"74d05c1fa81e441b9a055077b7097682bfaec598b754ddd77148230259fe301c"}
Jul 08 11:14:56.223444 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:56.223421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx" event={"ID":"50a7b652-5b98-4b44-961b-4a6bbc0a72e8","Type":"ContainerStarted","Data":"7f79aeb748ac148fb0f8e90126e252b79220bd38f3731e4a73a5af14b05b6ff0"}
Jul 08 11:14:56.224549 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:56.224526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7" event={"ID":"5920737f-2fdb-4be8-b4c7-aabdb1787b1e","Type":"ContainerStarted","Data":"02eb0336eb19ace15f63d56f9b0738a14727489d6952fce69a35d31fbf96a17c"}
Jul 08 11:14:57.232115 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:57.231998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7" event={"ID":"5920737f-2fdb-4be8-b4c7-aabdb1787b1e","Type":"ContainerStarted","Data":"85f6c3c5b4c4fcdc17a8ccd82a2863786005d6b7754d327394be9074c48dfc02"}
Jul 08 11:14:57.232840 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:57.232244    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:57.238762 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:57.238688    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7"
Jul 08 11:14:57.260713 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:57.260536    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dd6tr" podStartSLOduration=2.550562358 podStartE2EDuration="11.260498766s" totalImagesPullingTime="8.709936408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:14:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:56.259153234 +0000 UTC m=+87.022506611" watchObservedRunningTime="2026-07-08 11:14:57.260498766 +0000 UTC m=+88.023852127"
Jul 08 11:14:57.300332 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:57.300276    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-jxwb7" podStartSLOduration=1.9373451560000001 podStartE2EDuration="3.300255349s" totalImagesPullingTime="1.362910193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:57.261553267 +0000 UTC m=+88.024906632" watchObservedRunningTime="2026-07-08 11:14:57.300255349 +0000 UTC m=+88.063608719"
Jul 08 11:14:58.237036 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:58.236993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k" event={"ID":"61e52fa5-8962-4714-9e22-f4fe7bffe133","Type":"ContainerStarted","Data":"bfaac75029aedcaf3034a7fb0fb9d06e2c13d988a4a9656a29af8478a8e2af11"}
Jul 08 11:14:58.238641 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:58.238618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx" event={"ID":"50a7b652-5b98-4b44-961b-4a6bbc0a72e8","Type":"ContainerStarted","Data":"a63537778d1d8567afaa80938482b2960dbcd662abe16bde371efabd35eff9b7"}
Jul 08 11:14:58.272575 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:58.272529    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx" podStartSLOduration=1.824970497 podStartE2EDuration="4.272514708s" totalImagesPullingTime="2.447544211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:58.272251772 +0000 UTC m=+89.035605137" watchObservedRunningTime="2026-07-08 11:14:58.272514708 +0000 UTC m=+89.035868072"
Jul 08 11:14:59.243724 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:14:59.243686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k" event={"ID":"61e52fa5-8962-4714-9e22-f4fe7bffe133","Type":"ContainerStarted","Data":"e634e2343138ae3decf9aad5e853ff1d11fe01ccddf48e5d27d90813a792f6c6"}
Jul 08 11:15:00.033484 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:00.033455    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pz758"
Jul 08 11:15:00.248373 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:00.248340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k" event={"ID":"61e52fa5-8962-4714-9e22-f4fe7bffe133","Type":"ContainerStarted","Data":"2cbb580c5c2bf3346bf03ce9a3fbf8a3f14f42adf3a3ff21443e3dff4803bf25"}
Jul 08 11:15:00.288149 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:00.288041    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c9dd655dc-6lt7k" podStartSLOduration=1.871617828 podStartE2EDuration="5.288026299s" totalImagesPullingTime="3.416408471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:00.286778822 +0000 UTC m=+91.050132208" watchObservedRunningTime="2026-07-08 11:15:00.288026299 +0000 UTC m=+91.051379663"
Jul 08 11:15:02.196625 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:02.196595    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zslfs"
Jul 08 11:15:14.918137 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:14.918086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:15:14.918739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:14.918170    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:15:34.922852 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:34.922822    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:15:34.926580 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:34.926557    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b5659f4-wg7bx"
Jul 08 11:15:39.007432 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.007397    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4c66bf54-j2lcm"]
Jul 08 11:15:39.010284 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.010261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.023781 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.023761    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 11:15:39.023937 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.023917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 11:15:39.024796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.024778    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pbw6c\""
Jul 08 11:15:39.024932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.024914    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 11:15:39.025012 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.024930    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 11:15:39.025012 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.024954    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 11:15:39.027176 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.027163    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 11:15:39.028644 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.028632    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 11:15:39.082437 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.082413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4c66bf54-j2lcm"]
Jul 08 11:15:39.167742 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.167705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-config\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.167788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-oauth-serving-cert\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.167815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdc2\" (UniqueName: \"kubernetes.io/projected/249f9088-0de8-4a3b-851e-ded4a4c4376e-kube-api-access-hrdc2\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.167934 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.167836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-service-ca\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.168078 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.167935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-oauth-config\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.168078 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.167971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-serving-cert\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.269166 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-config\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.269166 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-oauth-serving-cert\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.269166 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdc2\" (UniqueName: \"kubernetes.io/projected/249f9088-0de8-4a3b-851e-ded4a4c4376e-kube-api-access-hrdc2\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.269776 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-service-ca\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.269776 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-oauth-config\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.269776 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-serving-cert\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.270084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269962    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-config\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.270084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.269982    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-oauth-serving-cert\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.270084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.270067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-service-ca\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.272834 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.272807    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-oauth-config\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.272948 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.272913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-serving-cert\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.285494 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.285475    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdc2\" (UniqueName: \"kubernetes.io/projected/249f9088-0de8-4a3b-851e-ded4a4c4376e-kube-api-access-hrdc2\") pod \"console-6f4c66bf54-j2lcm\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") " pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.319170 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.319141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:39.466174 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.466143    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4c66bf54-j2lcm"]
Jul 08 11:15:39.471277 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.471256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:15:39.471726 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:15:39.471696    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249f9088_0de8_4a3b_851e_ded4a4c4376e.slice/crio-6668baa834337dbf1d66e3b747d76599836d1c28843073375e9785a7fd9861ea WatchSource:0}: Error finding container 6668baa834337dbf1d66e3b747d76599836d1c28843073375e9785a7fd9861ea: Status 404 returned error can't find the container with id 6668baa834337dbf1d66e3b747d76599836d1c28843073375e9785a7fd9861ea
Jul 08 11:15:39.473736 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.473719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 11:15:39.484477 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.484448    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3476b4e6-46ea-42b5-93a5-d5fde4db179c-metrics-certs\") pod \"network-metrics-daemon-4k9pm\" (UID: \"3476b4e6-46ea-42b5-93a5-d5fde4db179c\") " pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:15:39.572677 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.572603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:15:39.572677 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.572643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:15:39.577448 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.577432    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 11:15:39.577552 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.577533    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 11:15:39.585626 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.585607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b5572f4-4d54-4f11-af5f-3946b41cb37f-original-pull-secret\") pod \"global-pull-secret-syncer-qjxsr\" (UID: \"4b5572f4-4d54-4f11-af5f-3946b41cb37f\") " pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:15:39.588624 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.588605    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 11:15:39.595533 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.595510    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx4lz\" (UniqueName: \"kubernetes.io/projected/60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3-kube-api-access-nx4lz\") pod \"network-check-target-kb7k6\" (UID: \"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3\") " pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:15:39.748955 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.748916    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-469dh\""
Jul 08 11:15:39.756991 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.756972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:15:39.758955 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.758939    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wnzzp\""
Jul 08 11:15:39.759059 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.759039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjxsr"
Jul 08 11:15:39.764484 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.764468    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4k9pm"
Jul 08 11:15:39.948031 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:39.947999    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4k9pm"]
Jul 08 11:15:39.951476 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:15:39.951451    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3476b4e6_46ea_42b5_93a5_d5fde4db179c.slice/crio-78c650ba630b0f2a43855b006440fd395a378a3729c9fccb0a41d945f393f288 WatchSource:0}: Error finding container 78c650ba630b0f2a43855b006440fd395a378a3729c9fccb0a41d945f393f288: Status 404 returned error can't find the container with id 78c650ba630b0f2a43855b006440fd395a378a3729c9fccb0a41d945f393f288
Jul 08 11:15:40.017735 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.017697    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f85f444d6-nfbkh"]
Jul 08 11:15:40.020890 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.020853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.032233 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.032210    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 11:15:40.063749 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.063721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f85f444d6-nfbkh"]
Jul 08 11:15:40.178399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-service-ca\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.178399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-oauth-serving-cert\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.178399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2vp\" (UniqueName: \"kubernetes.io/projected/f372c4ac-cafa-472e-b12c-f5940aafd050-kube-api-access-pr2vp\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.178717 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-serving-cert\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.178717 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-trusted-ca-bundle\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.178717 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-oauth-config\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.178717 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.178540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-console-config\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.179212 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.179011    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qjxsr"]
Jul 08 11:15:40.179967 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.179949    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kb7k6"]
Jul 08 11:15:40.181012 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:15:40.180988    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5572f4_4d54_4f11_af5f_3946b41cb37f.slice/crio-d9489c88eac9df050b1c802fab87fb3649c0b4fcae03cde65e9129e98feba738 WatchSource:0}: Error finding container d9489c88eac9df050b1c802fab87fb3649c0b4fcae03cde65e9129e98feba738: Status 404 returned error can't find the container with id d9489c88eac9df050b1c802fab87fb3649c0b4fcae03cde65e9129e98feba738
Jul 08 11:15:40.183966 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:15:40.183947    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f9de4a_75c3_4b09_adf4_5c2ad1bb14c3.slice/crio-010ae0889a727270f3354bb84fc8870446296f18cd2f388701c713d4dd392e84 WatchSource:0}: Error finding container 010ae0889a727270f3354bb84fc8870446296f18cd2f388701c713d4dd392e84: Status 404 returned error can't find the container with id 010ae0889a727270f3354bb84fc8870446296f18cd2f388701c713d4dd392e84
Jul 08 11:15:40.279431 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-serving-cert\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.279596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-trusted-ca-bundle\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.279596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-oauth-config\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.279596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-console-config\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.279596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-service-ca\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.279596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-oauth-serving-cert\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.279839 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.279594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2vp\" (UniqueName: \"kubernetes.io/projected/f372c4ac-cafa-472e-b12c-f5940aafd050-kube-api-access-pr2vp\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.280663 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.280628    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-service-ca\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.280783 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.280630    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-oauth-serving-cert\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.280783 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.280681    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-console-config\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.281180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.281155    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-trusted-ca-bundle\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.282585 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.282554    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-serving-cert\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.282860 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.282834    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-oauth-config\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.319049 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.319012    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2vp\" (UniqueName: \"kubernetes.io/projected/f372c4ac-cafa-472e-b12c-f5940aafd050-kube-api-access-pr2vp\") pod \"console-f85f444d6-nfbkh\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") " pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.329714 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.329661    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:40.381318 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.381239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kb7k6" event={"ID":"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3","Type":"ContainerStarted","Data":"010ae0889a727270f3354bb84fc8870446296f18cd2f388701c713d4dd392e84"}
Jul 08 11:15:40.382701 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.382602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qjxsr" event={"ID":"4b5572f4-4d54-4f11-af5f-3946b41cb37f","Type":"ContainerStarted","Data":"d9489c88eac9df050b1c802fab87fb3649c0b4fcae03cde65e9129e98feba738"}
Jul 08 11:15:40.385188 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.384764    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4c66bf54-j2lcm" event={"ID":"249f9088-0de8-4a3b-851e-ded4a4c4376e","Type":"ContainerStarted","Data":"6668baa834337dbf1d66e3b747d76599836d1c28843073375e9785a7fd9861ea"}
Jul 08 11:15:40.387386 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.387242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4k9pm" event={"ID":"3476b4e6-46ea-42b5-93a5-d5fde4db179c","Type":"ContainerStarted","Data":"78c650ba630b0f2a43855b006440fd395a378a3729c9fccb0a41d945f393f288"}
Jul 08 11:15:40.520954 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:40.520921    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f85f444d6-nfbkh"]
Jul 08 11:15:40.523737 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:15:40.523705    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf372c4ac_cafa_472e_b12c_f5940aafd050.slice/crio-fe9b6df2e22ebbc711d5232a1e6ac74b5cd589b8da3da8e9b123e78ba2e9bef6 WatchSource:0}: Error finding container fe9b6df2e22ebbc711d5232a1e6ac74b5cd589b8da3da8e9b123e78ba2e9bef6: Status 404 returned error can't find the container with id fe9b6df2e22ebbc711d5232a1e6ac74b5cd589b8da3da8e9b123e78ba2e9bef6
Jul 08 11:15:41.396157 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:41.396115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f85f444d6-nfbkh" event={"ID":"f372c4ac-cafa-472e-b12c-f5940aafd050","Type":"ContainerStarted","Data":"fe9b6df2e22ebbc711d5232a1e6ac74b5cd589b8da3da8e9b123e78ba2e9bef6"}
Jul 08 11:15:42.404546 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:42.404458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4k9pm" event={"ID":"3476b4e6-46ea-42b5-93a5-d5fde4db179c","Type":"ContainerStarted","Data":"1a78dcd10e7338170fc872bd8af07bfadb3a52fbcfe99835702ec5e599af9d84"}
Jul 08 11:15:42.404546 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:42.404529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4k9pm" event={"ID":"3476b4e6-46ea-42b5-93a5-d5fde4db179c","Type":"ContainerStarted","Data":"81b5850e13179113fc87ecccbdc6322071ed0818998f87dca9d339b0e8d0b2e8"}
Jul 08 11:15:42.442209 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:42.442149    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4k9pm" podStartSLOduration=131.514546521 podStartE2EDuration="2m13.442125104s" totalImagesPullingTime="1.927578583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:42.441231802 +0000 UTC m=+133.204585168" watchObservedRunningTime="2026-07-08 11:15:42.442125104 +0000 UTC m=+133.205478469"
Jul 08 11:15:46.428451 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.428409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qjxsr" event={"ID":"4b5572f4-4d54-4f11-af5f-3946b41cb37f","Type":"ContainerStarted","Data":"a7cd6bdaf7035de81a6ee2747484475983aa5b09b69a31a17914e733ca25882e"}
Jul 08 11:15:46.430162 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.430134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4c66bf54-j2lcm" event={"ID":"249f9088-0de8-4a3b-851e-ded4a4c4376e","Type":"ContainerStarted","Data":"e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39"}
Jul 08 11:15:46.431731 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.431707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f85f444d6-nfbkh" event={"ID":"f372c4ac-cafa-472e-b12c-f5940aafd050","Type":"ContainerStarted","Data":"561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716"}
Jul 08 11:15:46.433273 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.433249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kb7k6" event={"ID":"60f9de4a-75c3-4b09-adf4-5c2ad1bb14c3","Type":"ContainerStarted","Data":"8275408eb268d98fb3221f44c7f91ab5647b6b0a27dc40a04e1c24fa05cd7649"}
Jul 08 11:15:46.433388 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.433369    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:15:46.452318 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.452279    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qjxsr" podStartSLOduration=130.60000445 podStartE2EDuration="2m16.452266157s" totalImagesPullingTime="5.852261707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:46.451796024 +0000 UTC m=+137.215149389" watchObservedRunningTime="2026-07-08 11:15:46.452266157 +0000 UTC m=+137.215619522"
Jul 08 11:15:46.472323 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.472276    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f85f444d6-nfbkh" podStartSLOduration=1.967458672 podStartE2EDuration="7.472249413s" totalImagesPullingTime="5.504790741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:46.47222516 +0000 UTC m=+137.235578524" watchObservedRunningTime="2026-07-08 11:15:46.472249413 +0000 UTC m=+137.235602777"
Jul 08 11:15:46.489654 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.489616    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kb7k6" podStartSLOduration=131.638991628 podStartE2EDuration="2m17.489603738s" totalImagesPullingTime="5.85061211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:46.488701332 +0000 UTC m=+137.252054719" watchObservedRunningTime="2026-07-08 11:15:46.489603738 +0000 UTC m=+137.252957138"
Jul 08 11:15:46.508832 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:46.508795    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4c66bf54-j2lcm" podStartSLOduration=1.956811828 podStartE2EDuration="8.508781969s" totalImagesPullingTime="6.551970141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:46.50758856 +0000 UTC m=+137.270941945" watchObservedRunningTime="2026-07-08 11:15:46.508781969 +0000 UTC m=+137.272135332"
Jul 08 11:15:49.319820 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:49.319783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:49.320270 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:49.319848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:49.324407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:49.324388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:49.446907 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:49.446882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:15:50.330812 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:50.330769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:50.331254 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:50.330863    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:50.335455 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:50.335435    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:50.449844 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:50.449813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:15:50.537740 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:15:50.537698    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4c66bf54-j2lcm"]
Jul 08 11:16:16.469252 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.469195    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f4c66bf54-j2lcm" podUID="249f9088-0de8-4a3b-851e-ded4a4c4376e" containerName="console" containerID="cri-o://e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39" gracePeriod=15
Jul 08 11:16:16.731180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.731123    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:16:16.745060 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-oauth-config\") pod \"249f9088-0de8-4a3b-851e-ded4a4c4376e\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") "
Jul 08 11:16:16.745150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-oauth-serving-cert\") pod \"249f9088-0de8-4a3b-851e-ded4a4c4376e\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") "
Jul 08 11:16:16.745150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745124    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-config\") pod \"249f9088-0de8-4a3b-851e-ded4a4c4376e\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") "
Jul 08 11:16:16.745221 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-serving-cert\") pod \"249f9088-0de8-4a3b-851e-ded4a4c4376e\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") "
Jul 08 11:16:16.745221 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745185    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrdc2\" (UniqueName: \"kubernetes.io/projected/249f9088-0de8-4a3b-851e-ded4a4c4376e-kube-api-access-hrdc2\") pod \"249f9088-0de8-4a3b-851e-ded4a4c4376e\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") "
Jul 08 11:16:16.745322 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745220    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-service-ca\") pod \"249f9088-0de8-4a3b-851e-ded4a4c4376e\" (UID: \"249f9088-0de8-4a3b-851e-ded4a4c4376e\") "
Jul 08 11:16:16.745465 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745445    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "249f9088-0de8-4a3b-851e-ded4a4c4376e" (UID: "249f9088-0de8-4a3b-851e-ded4a4c4376e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:16:16.745533 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745499    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-config" (OuterVolumeSpecName: "console-config") pod "249f9088-0de8-4a3b-851e-ded4a4c4376e" (UID: "249f9088-0de8-4a3b-851e-ded4a4c4376e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:16:16.745756 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.745730    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-service-ca" (OuterVolumeSpecName: "service-ca") pod "249f9088-0de8-4a3b-851e-ded4a4c4376e" (UID: "249f9088-0de8-4a3b-851e-ded4a4c4376e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:16:16.747568 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.747542    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "249f9088-0de8-4a3b-851e-ded4a4c4376e" (UID: "249f9088-0de8-4a3b-851e-ded4a4c4376e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:16:16.747568 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.747551    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/249f9088-0de8-4a3b-851e-ded4a4c4376e-kube-api-access-hrdc2" (OuterVolumeSpecName: "kube-api-access-hrdc2") pod "249f9088-0de8-4a3b-851e-ded4a4c4376e" (UID: "249f9088-0de8-4a3b-851e-ded4a4c4376e"). InnerVolumeSpecName "kube-api-access-hrdc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:16:16.747688 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.747595    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "249f9088-0de8-4a3b-851e-ded4a4c4376e" (UID: "249f9088-0de8-4a3b-851e-ded4a4c4376e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:16:16.846237 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.846212    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-config\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:16:16.846237 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.846236    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-serving-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:16:16.846407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.846246    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrdc2\" (UniqueName: \"kubernetes.io/projected/249f9088-0de8-4a3b-851e-ded4a4c4376e-kube-api-access-hrdc2\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:16:16.846407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.846255    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:16:16.846407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.846263    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/249f9088-0de8-4a3b-851e-ded4a4c4376e-console-oauth-config\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:16:16.846407 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:16.846271    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/249f9088-0de8-4a3b-851e-ded4a4c4376e-oauth-serving-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:16:17.439321 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.439294    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kb7k6"
Jul 08 11:16:17.546366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.546334    2561 generic.go:356] "Generic (PLEG): container finished" podID="249f9088-0de8-4a3b-851e-ded4a4c4376e" containerID="e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39" exitCode=0
Jul 08 11:16:17.546757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.546381    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4c66bf54-j2lcm"
Jul 08 11:16:17.546757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.546420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4c66bf54-j2lcm" event={"ID":"249f9088-0de8-4a3b-851e-ded4a4c4376e","Type":"ContainerDied","Data":"e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39"}
Jul 08 11:16:17.546757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.546472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4c66bf54-j2lcm" event={"ID":"249f9088-0de8-4a3b-851e-ded4a4c4376e","Type":"ContainerDied","Data":"6668baa834337dbf1d66e3b747d76599836d1c28843073375e9785a7fd9861ea"}
Jul 08 11:16:17.546757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.546497    2561 scope.go:117] "RemoveContainer" containerID="e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39"
Jul 08 11:16:17.557539 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.557523    2561 scope.go:117] "RemoveContainer" containerID="e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39"
Jul 08 11:16:17.557956 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:16:17.557932    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39\": container with ID starting with e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39 not found: ID does not exist" containerID="e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39"
Jul 08 11:16:17.558052 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.557963    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39"} err="failed to get container status \"e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39\": rpc error: code = NotFound desc = could not find container \"e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39\": container with ID starting with e2ef44a0a0ab4fe33835ad0503b9f9295d5c3e7e0767500787383ac263776a39 not found: ID does not exist"
Jul 08 11:16:17.568140 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.568107    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4c66bf54-j2lcm"]
Jul 08 11:16:17.571635 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.571616    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4c66bf54-j2lcm"]
Jul 08 11:16:17.833470 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:16:17.833442    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="249f9088-0de8-4a3b-851e-ded4a4c4376e" path="/var/lib/kubelet/pods/249f9088-0de8-4a3b-851e-ded4a4c4376e/volumes"
Jul 08 11:18:29.674801 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:18:29.674772    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:18:29.678740 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:18:29.678718    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:18:29.679711 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:18:29.679689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:18:29.681383 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:18:29.681366    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 11:18:29.683945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:18:29.683929    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:19:53.608606 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.608580    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 11:19:53.608986 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.608849    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="249f9088-0de8-4a3b-851e-ded4a4c4376e" containerName="console"
Jul 08 11:19:53.608986 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.608880    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="249f9088-0de8-4a3b-851e-ded4a4c4376e" containerName="console"
Jul 08 11:19:53.608986 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.608949    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="249f9088-0de8-4a3b-851e-ded4a4c4376e" containerName="console"
Jul 08 11:19:53.611447 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.611432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.613818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.613784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 11:19:53.613818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.613812    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 11:19:53.614029 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.613831    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qhbnd\""
Jul 08 11:19:53.614029 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.613793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 11:19:53.614141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.614034    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 11:19:53.614141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.614040    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 11:19:53.614141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.614113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 11:19:53.614141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.614124    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 11:19:53.614141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.614134    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 11:19:53.619393 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.619378    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 11:19:53.636659 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.636639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 11:19:53.733732 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nxph\" (UniqueName: \"kubernetes.io/projected/5042306a-033f-4185-a720-c22b51678783-kube-api-access-9nxph\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.733732 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5042306a-033f-4185-a720-c22b51678783-config-out\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.733964 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.733964 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5042306a-033f-4185-a720-c22b51678783-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.733964 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.733964 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.733964 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5042306a-033f-4185-a720-c22b51678783-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.734164 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.733975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.734164 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.734021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5042306a-033f-4185-a720-c22b51678783-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.734164 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.734051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.734164 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.734067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-web-config\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.734164 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.734085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5042306a-033f-4185-a720-c22b51678783-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.734164 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.734115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-config-volume\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.834959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nxph\" (UniqueName: \"kubernetes.io/projected/5042306a-033f-4185-a720-c22b51678783-kube-api-access-9nxph\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5042306a-033f-4185-a720-c22b51678783-config-out\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5042306a-033f-4185-a720-c22b51678783-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5042306a-033f-4185-a720-c22b51678783-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5042306a-033f-4185-a720-c22b51678783-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835534 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-web-config\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835534 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5042306a-033f-4185-a720-c22b51678783-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.835534 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.835314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-config-volume\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.836440 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.836312    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5042306a-033f-4185-a720-c22b51678783-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.836840 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.836812    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5042306a-033f-4185-a720-c22b51678783-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.836840 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.836829    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5042306a-033f-4185-a720-c22b51678783-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.838346 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.838319    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5042306a-033f-4185-a720-c22b51678783-config-out\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.838544 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.838499    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.838769 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.838741    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-web-config\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.839222 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.839197    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.839313 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.839222    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.839373 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.839320    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-config-volume\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.839373 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.839363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5042306a-033f-4185-a720-c22b51678783-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.839590 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.839574    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.840555 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.840535    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5042306a-033f-4185-a720-c22b51678783-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.842120 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.842101    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nxph\" (UniqueName: \"kubernetes.io/projected/5042306a-033f-4185-a720-c22b51678783-kube-api-access-9nxph\") pod \"alertmanager-main-0\" (UID: \"5042306a-033f-4185-a720-c22b51678783\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:53.921270 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:53.921257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 11:19:54.055014 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.054987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 11:19:54.058000 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:19:54.057974    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5042306a_033f_4185_a720_c22b51678783.slice/crio-fb22bb93b74c8376764ef75449a65a87d31f3862937d70555db57edf1f5eceeb WatchSource:0}: Error finding container fb22bb93b74c8376764ef75449a65a87d31f3862937d70555db57edf1f5eceeb: Status 404 returned error can't find the container with id fb22bb93b74c8376764ef75449a65a87d31f3862937d70555db57edf1f5eceeb
Jul 08 11:19:54.268485 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.268456    2561 generic.go:356] "Generic (PLEG): container finished" podID="5042306a-033f-4185-a720-c22b51678783" containerID="f8fe02db0acf4d9924009acb78166faafc069f3ce5ca6145bee177e4e4c8c980" exitCode=0
Jul 08 11:19:54.268647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.268542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerDied","Data":"f8fe02db0acf4d9924009acb78166faafc069f3ce5ca6145bee177e4e4c8c980"}
Jul 08 11:19:54.268647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.268615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"fb22bb93b74c8376764ef75449a65a87d31f3862937d70555db57edf1f5eceeb"}
Jul 08 11:19:54.269679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.269662    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 11:19:54.615001 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.614968    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"]
Jul 08 11:19:54.618136 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.618119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.620415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620393    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 11:19:54.620519 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620476    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-divvh1k569ihm\""
Jul 08 11:19:54.620519 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620467    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 11:19:54.620713 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620696    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 11:19:54.620786 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620768    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 11:19:54.620922 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620901    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p56b7\""
Jul 08 11:19:54.620975 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.620949    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 11:19:54.630047 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.630026    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"]
Jul 08 11:19:54.741379 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-tls\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741379 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-grpc-tls\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf610ecb-4996-499e-a40a-0538b7920b52-metrics-client-ca\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.741822 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.741701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p222t\" (UniqueName: \"kubernetes.io/projected/cf610ecb-4996-499e-a40a-0538b7920b52-kube-api-access-p222t\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842299 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842299 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-grpc-tls\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf610ecb-4996-499e-a40a-0538b7920b52-metrics-client-ca\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p222t\" (UniqueName: \"kubernetes.io/projected/cf610ecb-4996-499e-a40a-0538b7920b52-kube-api-access-p222t\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-tls\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.842775 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.842584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.843225 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.843155    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf610ecb-4996-499e-a40a-0538b7920b52-metrics-client-ca\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.845543 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.845518    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-grpc-tls\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.845789 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.845765    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.845909 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.845859    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.845966 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.845941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-tls\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.846457 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.846433    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.846532 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.846485    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf610ecb-4996-499e-a40a-0538b7920b52-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.850835 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.850813    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p222t\" (UniqueName: \"kubernetes.io/projected/cf610ecb-4996-499e-a40a-0538b7920b52-kube-api-access-p222t\") pod \"thanos-querier-7cddf8d44b-2scnd\" (UID: \"cf610ecb-4996-499e-a40a-0538b7920b52\") " pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:54.927291 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:54.927216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:55.066167 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:55.066140    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"]
Jul 08 11:19:55.068303 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:19:55.068273    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf610ecb_4996_499e_a40a_0538b7920b52.slice/crio-b8e4a18d1492e917d369a5cd20343728a6b807a708f34f7f65b52ba5991916ee WatchSource:0}: Error finding container b8e4a18d1492e917d369a5cd20343728a6b807a708f34f7f65b52ba5991916ee: Status 404 returned error can't find the container with id b8e4a18d1492e917d369a5cd20343728a6b807a708f34f7f65b52ba5991916ee
Jul 08 11:19:55.274167 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:55.274128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"b8e4a18d1492e917d369a5cd20343728a6b807a708f34f7f65b52ba5991916ee"}
Jul 08 11:19:56.281764 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:56.281711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"34422ab981fccd0d4dd48181145750a4c925763dd55bc74352bea14ee9c9784e"}
Jul 08 11:19:57.294258 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:57.294218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"569be2a20e51128518513de767a47d41100c467e5027d9902f506909052bff79"}
Jul 08 11:19:57.294596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:57.294337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"403063a25f516b529179fd14b1de216b0b70f643b80285600ebda65765aaac48"}
Jul 08 11:19:57.294596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:57.294393    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"66ec5159a09d8db58a988ba0cef99d6509f54a8547b2d5e76ffbed93fccb4300"}
Jul 08 11:19:57.294596 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:57.294418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"937119b3fab5821630992e3273c6637f02b42f42f01285b59ded769d1411787e"}
Jul 08 11:19:57.296181 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:57.296160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"491fec1f884118e62afab272a8b0bdb2561decae1d87f517531701ba3eeb027b"}
Jul 08 11:19:58.302757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.302725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"48cabea7c2ee9933f447a24b4ec75e38abef0ca561800e957f9db4f521a4a4f8"}
Jul 08 11:19:58.303239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.302789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"46d885d7aa463d63f3a28e15cda172c66c4483653eece5403c6207cabc3f96c9"}
Jul 08 11:19:58.303239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.302818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"09ace4e0ce30b3342a8aa22f9dbc02c014be1ee0bade73381daae6f144371b70"}
Jul 08 11:19:58.303239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.302859    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:19:58.303239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.302913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"4f1de9c331060cc135ed52b85fc7519542d60e680cc7ab3ad202ad2da1592578"}
Jul 08 11:19:58.303239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.302939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" event={"ID":"cf610ecb-4996-499e-a40a-0538b7920b52","Type":"ContainerStarted","Data":"0b5c5a804072096aa90520a670196972102110db7ed4f51d6523196139192f45"}
Jul 08 11:19:58.305956 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.305933    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5042306a-033f-4185-a720-c22b51678783","Type":"ContainerStarted","Data":"5716d1fda830cc2faac5dd4e52b986e677012593e5e5636ba5036dffa6c20001"}
Jul 08 11:19:58.323292 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.323248    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd" podStartSLOduration=1.817442625 podStartE2EDuration="4.323236545s" totalImagesPullingTime="2.50579392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:19:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:19:58.322222187 +0000 UTC m=+389.085575551" watchObservedRunningTime="2026-07-08 11:19:58.323236545 +0000 UTC m=+389.086589909"
Jul 08 11:19:58.347297 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.347250    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3193210300000002 podStartE2EDuration="5.347236295s" totalImagesPullingTime="3.011990657s" totalInitContainerRuntime="15.924608ms" isStatefulPod=false podCreationTimestamp="2026-07-08 11:19:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:19:58.345412404 +0000 UTC m=+389.108765770" watchObservedRunningTime="2026-07-08 11:19:58.347236295 +0000 UTC m=+389.110589658"
Jul 08 11:19:58.727061 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.726981    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 11:19:58.730040 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.730018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.732325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.732301    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 11:19:58.732325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.732318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 11:19:58.732475 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.732405    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 11:19:58.732602 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.732584    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 11:19:58.733143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733119    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 11:19:58.733143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7qd7boh95a71\""
Jul 08 11:19:58.733287 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733128    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 11:19:58.733287 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733132    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 11:19:58.733437 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 11:19:58.733563 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733545    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 11:19:58.733650 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.733634    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zschh\""
Jul 08 11:19:58.734056 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.734025    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 11:19:58.734173 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.734128    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 11:19:58.734173 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.734136    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 11:19:58.735587 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.735573    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 11:19:58.739409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.739392    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 11:19:58.750515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.750493    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 11:19:58.878286 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878286 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zcq\" (UniqueName: \"kubernetes.io/projected/a860a654-29d1-417e-b5c1-68e785f497ec-kube-api-access-s5zcq\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878515 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-config\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.878778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.879095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.879095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a860a654-29d1-417e-b5c1-68e785f497ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.879095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.878835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a860a654-29d1-417e-b5c1-68e785f497ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a860a654-29d1-417e-b5c1-68e785f497ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a860a654-29d1-417e-b5c1-68e785f497ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980143 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zcq\" (UniqueName: \"kubernetes.io/projected/a860a654-29d1-417e-b5c1-68e785f497ec-kube-api-access-s5zcq\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980394 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980394 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980489 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980489 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980489 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980926 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980776    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980926 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980926 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980934    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980926 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.980926 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.980989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981578 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-config\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981578 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.981578 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983044 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981950    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983044 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.981983    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983044 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.982404    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983044 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.982856    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983044 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.983006    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983733 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.983707    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a860a654-29d1-417e-b5c1-68e785f497ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.983814 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.983800    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a860a654-29d1-417e-b5c1-68e785f497ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.984154 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.984129    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.984294 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.984270    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.984714 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.984691    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a860a654-29d1-417e-b5c1-68e785f497ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.985730 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.985701    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.985983 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.985938    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.986099 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.986081    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-config\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.986161 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.986145    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.986367 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.986341    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.986494 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.986473    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.987154 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.987135    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a860a654-29d1-417e-b5c1-68e785f497ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:58.989107 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:58.989091    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zcq\" (UniqueName: \"kubernetes.io/projected/a860a654-29d1-417e-b5c1-68e785f497ec-kube-api-access-s5zcq\") pod \"prometheus-k8s-0\" (UID: \"a860a654-29d1-417e-b5c1-68e785f497ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:59.040833 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:59.040786    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:19:59.177765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:59.177711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 11:19:59.181121 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:19:59.181095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda860a654_29d1_417e_b5c1_68e785f497ec.slice/crio-ad131d2a2c6d308727ad974d44d0a30cf2f7a728a1f8b6baf7dd323195dbed71 WatchSource:0}: Error finding container ad131d2a2c6d308727ad974d44d0a30cf2f7a728a1f8b6baf7dd323195dbed71: Status 404 returned error can't find the container with id ad131d2a2c6d308727ad974d44d0a30cf2f7a728a1f8b6baf7dd323195dbed71
Jul 08 11:19:59.311648 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:59.311614    2561 generic.go:356] "Generic (PLEG): container finished" podID="a860a654-29d1-417e-b5c1-68e785f497ec" containerID="96ee61af4023a60c53f1dd3faee6b5a66acaeb0a105ccede0f3f0b30f5e25006" exitCode=0
Jul 08 11:19:59.312001 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:59.311700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerDied","Data":"96ee61af4023a60c53f1dd3faee6b5a66acaeb0a105ccede0f3f0b30f5e25006"}
Jul 08 11:19:59.312001 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:19:59.311800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"ad131d2a2c6d308727ad974d44d0a30cf2f7a728a1f8b6baf7dd323195dbed71"}
Jul 08 11:20:03.333203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.333167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"c35d8023c8086c5df9839e580a2f258aaac9e35c327aba2864e817754fa8897c"}
Jul 08 11:20:03.333617 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.333251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"c9e2226a8f2da41459fd8e46bb9dce7b80b02b70b9ad7b4b5f64d178d68bfbc0"}
Jul 08 11:20:03.333617 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.333278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"d9c20b8c004d827b7f685e4bdb7c1dc843e7b8ca36d2c3ae9eca44e65ef04caa"}
Jul 08 11:20:03.333617 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.333303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"5f597f90b5ffd4dcccd22ecad7bcafdddf35d029a3da5134283456d5f0216495"}
Jul 08 11:20:03.333617 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.333325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"91817e2ed1d426a6501420852fbd7dc3cbc9a2d52980bfb64e40d526b2a812aa"}
Jul 08 11:20:03.333617 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.333348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a860a654-29d1-417e-b5c1-68e785f497ec","Type":"ContainerStarted","Data":"197986a034fe6669355db1314230fa38fa4124007d5502b5e07f18d57da24a2b"}
Jul 08 11:20:03.365929 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:03.365885    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.2033325599999998 podStartE2EDuration="5.365855692s" totalImagesPullingTime="3.142809157s" totalInitContainerRuntime="19.713975ms" isStatefulPod=false podCreationTimestamp="2026-07-08 11:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:20:03.363736214 +0000 UTC m=+394.127089581" watchObservedRunningTime="2026-07-08 11:20:03.365855692 +0000 UTC m=+394.129209057"
Jul 08 11:20:04.041545 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:04.041495    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:20:04.318325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:04.318254    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cddf8d44b-2scnd"
Jul 08 11:20:59.041876 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:59.041833    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:20:59.061438 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:59.061414    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:20:59.563427 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:20:59.563403    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 11:21:49.193129 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.193102    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78cd99bc7-frl4x"]
Jul 08 11:21:49.195565 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.195550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.206470 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.206447    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78cd99bc7-frl4x"]
Jul 08 11:21:49.344698 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-config\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.344698 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-serving-cert\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.344849 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rbn\" (UniqueName: \"kubernetes.io/projected/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-kube-api-access-w4rbn\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.344849 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-service-ca\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.344849 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-oauth-serving-cert\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.344973 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-oauth-config\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.344973 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.344930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-trusted-ca-bundle\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.445951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-oauth-config\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.445975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-trusted-ca-bundle\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-config\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446254 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-serving-cert\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446254 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rbn\" (UniqueName: \"kubernetes.io/projected/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-kube-api-access-w4rbn\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446254 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-service-ca\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446254 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-oauth-serving-cert\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.446736 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446703    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-config\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.447042 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446808    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-trusted-ca-bundle\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.447042 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.446912    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-oauth-serving-cert\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.447169 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.447075    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-service-ca\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.448581 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.448559    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-oauth-config\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.448702 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.448682    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-serving-cert\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.455788 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.455769    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rbn\" (UniqueName: \"kubernetes.io/projected/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-kube-api-access-w4rbn\") pod \"console-78cd99bc7-frl4x\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") " pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.504722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.504696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:49.643436 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.643413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78cd99bc7-frl4x"]
Jul 08 11:21:49.645924 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:21:49.645894    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c055c9_5b46_4226_89f5_c6a2eb4f6b19.slice/crio-e18cb78578fc52f5749f8511382db785a135acb082c816256b934270c29e113c WatchSource:0}: Error finding container e18cb78578fc52f5749f8511382db785a135acb082c816256b934270c29e113c: Status 404 returned error can't find the container with id e18cb78578fc52f5749f8511382db785a135acb082c816256b934270c29e113c
Jul 08 11:21:49.748474 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.748440    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd99bc7-frl4x" event={"ID":"54c055c9-5b46-4226-89f5-c6a2eb4f6b19","Type":"ContainerStarted","Data":"eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463"}
Jul 08 11:21:49.748636 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.748488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd99bc7-frl4x" event={"ID":"54c055c9-5b46-4226-89f5-c6a2eb4f6b19","Type":"ContainerStarted","Data":"e18cb78578fc52f5749f8511382db785a135acb082c816256b934270c29e113c"}
Jul 08 11:21:49.776726 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:49.776681    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78cd99bc7-frl4x" podStartSLOduration=0.776666024 podStartE2EDuration="776.666024ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:21:49.77564655 +0000 UTC m=+500.538999943" watchObservedRunningTime="2026-07-08 11:21:49.776666024 +0000 UTC m=+500.540019389"
Jul 08 11:21:59.505642 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:59.505612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:59.506052 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:59.505685    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:59.510138 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:59.510113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:59.792292 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:59.792262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:21:59.835959 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:21:59.835932    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f85f444d6-nfbkh"]
Jul 08 11:22:24.409516 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.409430    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xq967"]
Jul 08 11:22:24.416144 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.416115    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.418638 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.418615    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v52v6\""
Jul 08 11:22:24.418780 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.418615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 11:22:24.418780 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.418656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 11:22:24.421795 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.421775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xq967"]
Jul 08 11:22:24.539449 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.539408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/574d13d8-9c4d-4862-b992-2de4071e28dc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xq967\" (UID: \"574d13d8-9c4d-4862-b992-2de4071e28dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.539449 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.539455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k44kq\" (UniqueName: \"kubernetes.io/projected/574d13d8-9c4d-4862-b992-2de4071e28dc-kube-api-access-k44kq\") pod \"cert-manager-cainjector-559cdd8c87-xq967\" (UID: \"574d13d8-9c4d-4862-b992-2de4071e28dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.640117 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.640086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k44kq\" (UniqueName: \"kubernetes.io/projected/574d13d8-9c4d-4862-b992-2de4071e28dc-kube-api-access-k44kq\") pod \"cert-manager-cainjector-559cdd8c87-xq967\" (UID: \"574d13d8-9c4d-4862-b992-2de4071e28dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.640266 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.640181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/574d13d8-9c4d-4862-b992-2de4071e28dc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xq967\" (UID: \"574d13d8-9c4d-4862-b992-2de4071e28dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.650924 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.650892    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/574d13d8-9c4d-4862-b992-2de4071e28dc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xq967\" (UID: \"574d13d8-9c4d-4862-b992-2de4071e28dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.651249 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.651231    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k44kq\" (UniqueName: \"kubernetes.io/projected/574d13d8-9c4d-4862-b992-2de4071e28dc-kube-api-access-k44kq\") pod \"cert-manager-cainjector-559cdd8c87-xq967\" (UID: \"574d13d8-9c4d-4862-b992-2de4071e28dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.738570 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.738492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967"
Jul 08 11:22:24.862501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.862478    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xq967"]
Jul 08 11:22:24.863145 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.863086    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f85f444d6-nfbkh" podUID="f372c4ac-cafa-472e-b12c-f5940aafd050" containerName="console" containerID="cri-o://561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716" gracePeriod=15
Jul 08 11:22:24.864789 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:22:24.864760    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod574d13d8_9c4d_4862_b992_2de4071e28dc.slice/crio-1c91508a0be0dc35969c79114ce3741813ff9713b3ea508a8a3fbb53126f6488 WatchSource:0}: Error finding container 1c91508a0be0dc35969c79114ce3741813ff9713b3ea508a8a3fbb53126f6488: Status 404 returned error can't find the container with id 1c91508a0be0dc35969c79114ce3741813ff9713b3ea508a8a3fbb53126f6488
Jul 08 11:22:24.889591 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:24.889567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967" event={"ID":"574d13d8-9c4d-4862-b992-2de4071e28dc","Type":"ContainerStarted","Data":"1c91508a0be0dc35969c79114ce3741813ff9713b3ea508a8a3fbb53126f6488"}
Jul 08 11:22:25.090459 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.090437    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:22:25.145752 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-serving-cert\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.145932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145761    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr2vp\" (UniqueName: \"kubernetes.io/projected/f372c4ac-cafa-472e-b12c-f5940aafd050-kube-api-access-pr2vp\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.145932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-console-config\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.145932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145854    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-trusted-ca-bundle\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.145932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145909    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-oauth-serving-cert\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.146148 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145947    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-oauth-config\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.146148 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.145997    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-service-ca\") pod \"f372c4ac-cafa-472e-b12c-f5940aafd050\" (UID: \"f372c4ac-cafa-472e-b12c-f5940aafd050\") "
Jul 08 11:22:25.146236 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.146217    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-console-config" (OuterVolumeSpecName: "console-config") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:22:25.146285 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.146257    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:22:25.146325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.146303    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:22:25.146579 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.146558    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-service-ca" (OuterVolumeSpecName: "service-ca") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:22:25.148210 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.148182    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:22:25.148302 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.148215    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f372c4ac-cafa-472e-b12c-f5940aafd050-kube-api-access-pr2vp" (OuterVolumeSpecName: "kube-api-access-pr2vp") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "kube-api-access-pr2vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:22:25.148302 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.148219    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f372c4ac-cafa-472e-b12c-f5940aafd050" (UID: "f372c4ac-cafa-472e-b12c-f5940aafd050"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:22:25.246656 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246624    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.246656 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246653    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-serving-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.246656 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246663    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr2vp\" (UniqueName: \"kubernetes.io/projected/f372c4ac-cafa-472e-b12c-f5940aafd050-kube-api-access-pr2vp\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.246893 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246672    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-console-config\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.246893 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246681    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-trusted-ca-bundle\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.246893 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246689    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f372c4ac-cafa-472e-b12c-f5940aafd050-oauth-serving-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.246893 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.246699    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f372c4ac-cafa-472e-b12c-f5940aafd050-console-oauth-config\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:22:25.894359 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.894324    2561 generic.go:356] "Generic (PLEG): container finished" podID="f372c4ac-cafa-472e-b12c-f5940aafd050" containerID="561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716" exitCode=0
Jul 08 11:22:25.894770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.894375    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f85f444d6-nfbkh"
Jul 08 11:22:25.894770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.894409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f85f444d6-nfbkh" event={"ID":"f372c4ac-cafa-472e-b12c-f5940aafd050","Type":"ContainerDied","Data":"561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716"}
Jul 08 11:22:25.894770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.894463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f85f444d6-nfbkh" event={"ID":"f372c4ac-cafa-472e-b12c-f5940aafd050","Type":"ContainerDied","Data":"fe9b6df2e22ebbc711d5232a1e6ac74b5cd589b8da3da8e9b123e78ba2e9bef6"}
Jul 08 11:22:25.894770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.894485    2561 scope.go:117] "RemoveContainer" containerID="561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716"
Jul 08 11:22:25.902463 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.902447    2561 scope.go:117] "RemoveContainer" containerID="561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716"
Jul 08 11:22:25.902718 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:22:25.902699    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716\": container with ID starting with 561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716 not found: ID does not exist" containerID="561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716"
Jul 08 11:22:25.902781 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.902727    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716"} err="failed to get container status \"561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716\": rpc error: code = NotFound desc = could not find container \"561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716\": container with ID starting with 561f593958812115baecbdccf5074935525bd3a130277a9c107e5ddc59e36716 not found: ID does not exist"
Jul 08 11:22:25.910687 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.910620    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f85f444d6-nfbkh"]
Jul 08 11:22:25.912319 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:25.912301    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f85f444d6-nfbkh"]
Jul 08 11:22:27.833955 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:27.833922    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f372c4ac-cafa-472e-b12c-f5940aafd050" path="/var/lib/kubelet/pods/f372c4ac-cafa-472e-b12c-f5940aafd050/volumes"
Jul 08 11:22:32.040687 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.040661    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"]
Jul 08 11:22:32.041163 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.041118    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f372c4ac-cafa-472e-b12c-f5940aafd050" containerName="console"
Jul 08 11:22:32.041163 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.041135    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f372c4ac-cafa-472e-b12c-f5940aafd050" containerName="console"
Jul 08 11:22:32.041275 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.041245    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f372c4ac-cafa-472e-b12c-f5940aafd050" containerName="console"
Jul 08 11:22:32.044220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.044200    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.046782 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.046743    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 11:22:32.046926 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.046829    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 11:22:32.047592 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.047579    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h5csr\""
Jul 08 11:22:32.053722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.053702    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"]
Jul 08 11:22:32.101277 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.101247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hctr\" (UniqueName: \"kubernetes.io/projected/cae4c549-3d51-4490-be38-b16f87af9026-kube-api-access-5hctr\") pod \"openshift-lws-operator-fd8ccff4c-c9f4c\" (UID: \"cae4c549-3d51-4490-be38-b16f87af9026\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.101378 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.101281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cae4c549-3d51-4490-be38-b16f87af9026-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c9f4c\" (UID: \"cae4c549-3d51-4490-be38-b16f87af9026\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.202490 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.202464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hctr\" (UniqueName: \"kubernetes.io/projected/cae4c549-3d51-4490-be38-b16f87af9026-kube-api-access-5hctr\") pod \"openshift-lws-operator-fd8ccff4c-c9f4c\" (UID: \"cae4c549-3d51-4490-be38-b16f87af9026\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.202600 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.202496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cae4c549-3d51-4490-be38-b16f87af9026-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c9f4c\" (UID: \"cae4c549-3d51-4490-be38-b16f87af9026\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.202812 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.202795    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cae4c549-3d51-4490-be38-b16f87af9026-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c9f4c\" (UID: \"cae4c549-3d51-4490-be38-b16f87af9026\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.211031 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.211007    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hctr\" (UniqueName: \"kubernetes.io/projected/cae4c549-3d51-4490-be38-b16f87af9026-kube-api-access-5hctr\") pod \"openshift-lws-operator-fd8ccff4c-c9f4c\" (UID: \"cae4c549-3d51-4490-be38-b16f87af9026\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.353218 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.353152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"
Jul 08 11:22:32.481462 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.481435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c"]
Jul 08 11:22:32.483294 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:22:32.483257    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcae4c549_3d51_4490_be38_b16f87af9026.slice/crio-f4b8f65881b125500d470355551ee0ae613c2a951f2b8c7cdaa14bd331a231f9 WatchSource:0}: Error finding container f4b8f65881b125500d470355551ee0ae613c2a951f2b8c7cdaa14bd331a231f9: Status 404 returned error can't find the container with id f4b8f65881b125500d470355551ee0ae613c2a951f2b8c7cdaa14bd331a231f9
Jul 08 11:22:32.921102 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:32.921068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c" event={"ID":"cae4c549-3d51-4490-be38-b16f87af9026","Type":"ContainerStarted","Data":"f4b8f65881b125500d470355551ee0ae613c2a951f2b8c7cdaa14bd331a231f9"}
Jul 08 11:22:34.931727 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:34.931696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c" event={"ID":"cae4c549-3d51-4490-be38-b16f87af9026","Type":"ContainerStarted","Data":"be1bc7cfae574c4a8ca2d26f8d04e4e7bd443d66be7696b2bcdd32da9e128bbe"}
Jul 08 11:22:34.954046 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:34.953952    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c9f4c" podStartSLOduration=0.73985439 podStartE2EDuration="2.953932091s" totalImagesPullingTime="2.214077701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:22:34.951006475 +0000 UTC m=+545.714359851" watchObservedRunningTime="2026-07-08 11:22:34.953932091 +0000 UTC m=+545.717285452"
Jul 08 11:22:42.965945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:42.965912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967" event={"ID":"574d13d8-9c4d-4862-b992-2de4071e28dc","Type":"ContainerStarted","Data":"80eb1ecc2eb3ab8c5561c4bcb412589dc7a83a45703d4db8e902145b2079387f"}
Jul 08 11:22:42.981720 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:42.981652    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq967" podStartSLOduration=1.6091979109999999 podStartE2EDuration="18.981638224s" totalImagesPullingTime="17.372440313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:22:42.980446143 +0000 UTC m=+553.743799529" watchObservedRunningTime="2026-07-08 11:22:42.981638224 +0000 UTC m=+553.744991587"
Jul 08 11:22:52.856649 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.856620    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"]
Jul 08 11:22:52.859135 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.859119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:52.864101 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.864080    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 11:22:52.864399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.864374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 11:22:52.864492 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.864431    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 11:22:52.864716 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.864699    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bhz7d\""
Jul 08 11:22:52.864829 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.864754    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 11:22:52.887668 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.887647    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"]
Jul 08 11:22:52.974154 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.974128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b577cfb-bc0b-4a25-af74-90f21347eacd-tmp\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:52.974258 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.974172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b577cfb-bc0b-4a25-af74-90f21347eacd-manifests\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:52.974258 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.974188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b577cfb-bc0b-4a25-af74-90f21347eacd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:52.974258 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.974240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b577cfb-bc0b-4a25-af74-90f21347eacd-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:52.974410 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:52.974288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8cg\" (UniqueName: \"kubernetes.io/projected/6b577cfb-bc0b-4a25-af74-90f21347eacd-kube-api-access-tm8cg\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.075624 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.075605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b577cfb-bc0b-4a25-af74-90f21347eacd-manifests\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.075715 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.075632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b577cfb-bc0b-4a25-af74-90f21347eacd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.075715 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.075653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b577cfb-bc0b-4a25-af74-90f21347eacd-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.075715 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.075672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8cg\" (UniqueName: \"kubernetes.io/projected/6b577cfb-bc0b-4a25-af74-90f21347eacd-kube-api-access-tm8cg\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.075715 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.075708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b577cfb-bc0b-4a25-af74-90f21347eacd-tmp\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.076053 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.076031    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b577cfb-bc0b-4a25-af74-90f21347eacd-manifests\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.077993 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.077973    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b577cfb-bc0b-4a25-af74-90f21347eacd-tmp\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.078129 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.078112    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b577cfb-bc0b-4a25-af74-90f21347eacd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.078248 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.078231    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b577cfb-bc0b-4a25-af74-90f21347eacd-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.094184 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.094161    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8cg\" (UniqueName: \"kubernetes.io/projected/6b577cfb-bc0b-4a25-af74-90f21347eacd-kube-api-access-tm8cg\") pod \"opendatahub-operator-controller-manager-79c9b86684-njlv2\" (UID: \"6b577cfb-bc0b-4a25-af74-90f21347eacd\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.168774 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.168720    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:53.304156 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:53.304119    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"]
Jul 08 11:22:53.307408 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:22:53.307380    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b577cfb_bc0b_4a25_af74_90f21347eacd.slice/crio-49a53e2fd231918ddd778854bca50a27cfebe5e6550631da92f04b2ab8d401aa WatchSource:0}: Error finding container 49a53e2fd231918ddd778854bca50a27cfebe5e6550631da92f04b2ab8d401aa: Status 404 returned error can't find the container with id 49a53e2fd231918ddd778854bca50a27cfebe5e6550631da92f04b2ab8d401aa
Jul 08 11:22:54.010552 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:54.010260    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2" event={"ID":"6b577cfb-bc0b-4a25-af74-90f21347eacd","Type":"ContainerStarted","Data":"49a53e2fd231918ddd778854bca50a27cfebe5e6550631da92f04b2ab8d401aa"}
Jul 08 11:22:57.026172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:57.026133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2" event={"ID":"6b577cfb-bc0b-4a25-af74-90f21347eacd","Type":"ContainerStarted","Data":"85bb68f43ba34d127429126f68729f0d2a32aff97bb303578f327e6acad0afc7"}
Jul 08 11:22:58.033630 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:58.033596    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b577cfb-bc0b-4a25-af74-90f21347eacd" containerID="85bb68f43ba34d127429126f68729f0d2a32aff97bb303578f327e6acad0afc7" exitCode=0
Jul 08 11:22:58.034047 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:58.033732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2" event={"ID":"6b577cfb-bc0b-4a25-af74-90f21347eacd","Type":"ContainerDied","Data":"85bb68f43ba34d127429126f68729f0d2a32aff97bb303578f327e6acad0afc7"}
Jul 08 11:22:59.039802 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:59.039767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2" event={"ID":"6b577cfb-bc0b-4a25-af74-90f21347eacd","Type":"ContainerStarted","Data":"980634b446e73f0646004529fd31791b6a981acd9ab01e7f77d6859482b15859"}
Jul 08 11:22:59.040224 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:59.039910    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:22:59.071424 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:22:59.071382    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2" podStartSLOduration=2.729856878 podStartE2EDuration="7.071367647s" totalImagesPullingTime="3.36409436s" totalInitContainerRuntime="977.416409ms" isStatefulPod=false podCreationTimestamp="2026-07-08 11:22:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:22:59.069379249 +0000 UTC m=+569.832732637" watchObservedRunningTime="2026-07-08 11:22:59.071367647 +0000 UTC m=+569.834721010"
Jul 08 11:23:10.045839 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.045810    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-njlv2"
Jul 08 11:23:10.773679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.773648    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"]
Jul 08 11:23:10.781440 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.781395    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.784654 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.784632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xmk2w\""
Jul 08 11:23:10.784654 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.784642    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 11:23:10.784895 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.784633    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 11:23:10.784895 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.784632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 11:23:10.790063 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.790038    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"]
Jul 08 11:23:10.819316 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.819291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48cb74ef-b64c-473c-91a9-aab667d92db0-metrics-cert\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.819415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.819325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48cb74ef-b64c-473c-91a9-aab667d92db0-manager-config\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.819415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.819357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48cb74ef-b64c-473c-91a9-aab667d92db0-cert\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.819493 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.819447    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqjm\" (UniqueName: \"kubernetes.io/projected/48cb74ef-b64c-473c-91a9-aab667d92db0-kube-api-access-lhqjm\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.920491 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.920472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48cb74ef-b64c-473c-91a9-aab667d92db0-cert\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.920591 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.920512    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqjm\" (UniqueName: \"kubernetes.io/projected/48cb74ef-b64c-473c-91a9-aab667d92db0-kube-api-access-lhqjm\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.920651 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.920610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48cb74ef-b64c-473c-91a9-aab667d92db0-metrics-cert\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.920651 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.920638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48cb74ef-b64c-473c-91a9-aab667d92db0-manager-config\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.921317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.921300    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48cb74ef-b64c-473c-91a9-aab667d92db0-manager-config\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.923145 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.923125    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48cb74ef-b64c-473c-91a9-aab667d92db0-metrics-cert\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.923281 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.923263    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48cb74ef-b64c-473c-91a9-aab667d92db0-cert\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:10.928605 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:10.928583    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqjm\" (UniqueName: \"kubernetes.io/projected/48cb74ef-b64c-473c-91a9-aab667d92db0-kube-api-access-lhqjm\") pod \"lws-controller-manager-574bb547d7-hqk6m\" (UID: \"48cb74ef-b64c-473c-91a9-aab667d92db0\") " pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:11.091388 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:11.091340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:11.223423 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:11.223286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"]
Jul 08 11:23:11.225708 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:23:11.225677    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cb74ef_b64c_473c_91a9_aab667d92db0.slice/crio-505b214c7e624290fe8a6f5e37e0eb7628fe50d202b4c60018af1ae2ce4404db WatchSource:0}: Error finding container 505b214c7e624290fe8a6f5e37e0eb7628fe50d202b4c60018af1ae2ce4404db: Status 404 returned error can't find the container with id 505b214c7e624290fe8a6f5e37e0eb7628fe50d202b4c60018af1ae2ce4404db
Jul 08 11:23:12.096215 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:12.096179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m" event={"ID":"48cb74ef-b64c-473c-91a9-aab667d92db0","Type":"ContainerStarted","Data":"505b214c7e624290fe8a6f5e37e0eb7628fe50d202b4c60018af1ae2ce4404db"}
Jul 08 11:23:13.245327 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.245295    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf876f85-flnts"]
Jul 08 11:23:13.271770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.271741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf876f85-flnts"]
Jul 08 11:23:13.271961 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.271833    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.274501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.274472    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 11:23:13.274805 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.274784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 11:23:13.275765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.275710    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 11:23:13.275899 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.275779    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4d6q4\""
Jul 08 11:23:13.278781 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.278762    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 11:23:13.340695 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.340630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-tmp\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.340695 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.340659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-tls-certs\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.340695 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.340677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrd8\" (UniqueName: \"kubernetes.io/projected/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-kube-api-access-4qrd8\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.441744 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.441713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-tmp\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.441909 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.441748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-tls-certs\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.441909 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.441786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrd8\" (UniqueName: \"kubernetes.io/projected/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-kube-api-access-4qrd8\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.443989 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.443962    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-tmp\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.444198 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.444181    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-tls-certs\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.453246 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.453227    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrd8\" (UniqueName: \"kubernetes.io/projected/efb0b325-0725-4a2e-adfb-3bef0fbfe61f-kube-api-access-4qrd8\") pod \"kube-auth-proxy-9cf876f85-flnts\" (UID: \"efb0b325-0725-4a2e-adfb-3bef0fbfe61f\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.582260 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.582240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts"
Jul 08 11:23:13.711723 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:13.711666    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf876f85-flnts"]
Jul 08 11:23:13.713807 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:23:13.713754    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb0b325_0725_4a2e_adfb_3bef0fbfe61f.slice/crio-b1a3e28e130343682c5bea2141207a1948901cc3311e7a86feb2cb9914247f29 WatchSource:0}: Error finding container b1a3e28e130343682c5bea2141207a1948901cc3311e7a86feb2cb9914247f29: Status 404 returned error can't find the container with id b1a3e28e130343682c5bea2141207a1948901cc3311e7a86feb2cb9914247f29
Jul 08 11:23:14.108374 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:14.107252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m" event={"ID":"48cb74ef-b64c-473c-91a9-aab667d92db0","Type":"ContainerStarted","Data":"d1125118fb8ac5e9b6057bfc47c23b9a32cff5f94674722f5a1e7c73a1c1cb88"}
Jul 08 11:23:14.108374 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:14.108301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:14.110023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:14.109998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts" event={"ID":"efb0b325-0725-4a2e-adfb-3bef0fbfe61f","Type":"ContainerStarted","Data":"b1a3e28e130343682c5bea2141207a1948901cc3311e7a86feb2cb9914247f29"}
Jul 08 11:23:14.135861 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:14.135819    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m" podStartSLOduration=2.309093557 podStartE2EDuration="4.135800043s" totalImagesPullingTime="1.826706486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:14.135214005 +0000 UTC m=+584.898567361" watchObservedRunningTime="2026-07-08 11:23:14.135800043 +0000 UTC m=+584.899153407"
Jul 08 11:23:17.131335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:17.131303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts" event={"ID":"efb0b325-0725-4a2e-adfb-3bef0fbfe61f","Type":"ContainerStarted","Data":"f6fa6823bdcb221f583b4517e9e9c37bd6d74902eddd263fa2918ebc9329ec3b"}
Jul 08 11:23:17.148580 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:17.148540    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9cf876f85-flnts" podStartSLOduration=1.108309805 podStartE2EDuration="4.148524313s" totalImagesPullingTime="3.040214508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:17.147756833 +0000 UTC m=+587.911110194" watchObservedRunningTime="2026-07-08 11:23:17.148524313 +0000 UTC m=+587.911877669"
Jul 08 11:23:26.127932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:26.127902    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-574bb547d7-hqk6m"
Jul 08 11:23:29.712065 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:29.712041    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:23:29.712486 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:29.712045    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:23:29.716247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:29.716228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:23:29.716359 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:23:29.716311    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:25:00.618789 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.618758    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"]
Jul 08 11:25:00.621983 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.621968    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.624390 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.624374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 11:25:00.624604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.624591    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 11:25:00.624955 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.624940    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 11:25:00.625460 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.625444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 11:25:00.625495 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.625448    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qq5gw\""
Jul 08 11:25:00.631743 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.631722    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"]
Jul 08 11:25:00.759262 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.759236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rw7\" (UniqueName: \"kubernetes.io/projected/4565cdc7-f0fd-45a5-a134-91188739bc89-kube-api-access-w6rw7\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.759351 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.759271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4565cdc7-f0fd-45a5-a134-91188739bc89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.759351 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.759341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4565cdc7-f0fd-45a5-a134-91188739bc89-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.860189 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.860166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rw7\" (UniqueName: \"kubernetes.io/projected/4565cdc7-f0fd-45a5-a134-91188739bc89-kube-api-access-w6rw7\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.860277 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.860199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4565cdc7-f0fd-45a5-a134-91188739bc89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.860277 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.860234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4565cdc7-f0fd-45a5-a134-91188739bc89-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.860367 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:25:00.860316    2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 08 11:25:00.860404 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:25:00.860374    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4565cdc7-f0fd-45a5-a134-91188739bc89-plugin-serving-cert podName:4565cdc7-f0fd-45a5-a134-91188739bc89 nodeName:}" failed. No retries permitted until 2026-07-08 11:25:01.360354761 +0000 UTC m=+692.123708104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/4565cdc7-f0fd-45a5-a134-91188739bc89-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-dzl98" (UID: "4565cdc7-f0fd-45a5-a134-91188739bc89") : secret "plugin-serving-cert" not found
Jul 08 11:25:00.860807 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.860791    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4565cdc7-f0fd-45a5-a134-91188739bc89-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:00.869087 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:00.869041    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rw7\" (UniqueName: \"kubernetes.io/projected/4565cdc7-f0fd-45a5-a134-91188739bc89-kube-api-access-w6rw7\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:01.364246 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:01.364215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4565cdc7-f0fd-45a5-a134-91188739bc89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:01.366646 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:01.366612    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4565cdc7-f0fd-45a5-a134-91188739bc89-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dzl98\" (UID: \"4565cdc7-f0fd-45a5-a134-91188739bc89\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:01.530523 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:01.530501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"
Jul 08 11:25:01.669502 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:01.669429    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98"]
Jul 08 11:25:01.672599 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:25:01.672572    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4565cdc7_f0fd_45a5_a134_91188739bc89.slice/crio-abcb02881042153646bb21ddb049791307b8e94108ea68bfaaa2181f9a5d41c6 WatchSource:0}: Error finding container abcb02881042153646bb21ddb049791307b8e94108ea68bfaaa2181f9a5d41c6: Status 404 returned error can't find the container with id abcb02881042153646bb21ddb049791307b8e94108ea68bfaaa2181f9a5d41c6
Jul 08 11:25:01.674249 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:01.674228    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 11:25:02.585064 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:02.585008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98" event={"ID":"4565cdc7-f0fd-45a5-a134-91188739bc89","Type":"ContainerStarted","Data":"abcb02881042153646bb21ddb049791307b8e94108ea68bfaaa2181f9a5d41c6"}
Jul 08 11:25:11.308944 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.308906    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"]
Jul 08 11:25:11.319245 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.319199    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.321627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.321602    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-trpgp\""
Jul 08 11:25:11.324785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.324726    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"]
Jul 08 11:25:11.460794 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.460758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdtl\" (UniqueName: \"kubernetes.io/projected/23cb28ba-72b1-40c6-99ec-2e418143b161-kube-api-access-pwdtl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qqmh8\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.460988 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.460919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23cb28ba-72b1-40c6-99ec-2e418143b161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qqmh8\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.561519 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.561441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdtl\" (UniqueName: \"kubernetes.io/projected/23cb28ba-72b1-40c6-99ec-2e418143b161-kube-api-access-pwdtl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qqmh8\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.561672 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.561534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23cb28ba-72b1-40c6-99ec-2e418143b161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qqmh8\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.561989 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.561961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23cb28ba-72b1-40c6-99ec-2e418143b161-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qqmh8\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.583111 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.583089    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdtl\" (UniqueName: \"kubernetes.io/projected/23cb28ba-72b1-40c6-99ec-2e418143b161-kube-api-access-pwdtl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qqmh8\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:11.633986 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:11.633959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:23.964756 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:23.964732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"]
Jul 08 11:25:23.966176 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:25:23.966152    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23cb28ba_72b1_40c6_99ec_2e418143b161.slice/crio-0b180d389911dd1c22c2602360a3e2810fa19a5af50b3b5d5d62637b0da3e0d8 WatchSource:0}: Error finding container 0b180d389911dd1c22c2602360a3e2810fa19a5af50b3b5d5d62637b0da3e0d8: Status 404 returned error can't find the container with id 0b180d389911dd1c22c2602360a3e2810fa19a5af50b3b5d5d62637b0da3e0d8
Jul 08 11:25:24.702685 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:24.702643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8" event={"ID":"23cb28ba-72b1-40c6-99ec-2e418143b161","Type":"ContainerStarted","Data":"0b180d389911dd1c22c2602360a3e2810fa19a5af50b3b5d5d62637b0da3e0d8"}
Jul 08 11:25:24.704372 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:24.704340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98" event={"ID":"4565cdc7-f0fd-45a5-a134-91188739bc89","Type":"ContainerStarted","Data":"4f26903584bbd33a1e947cefdd32a200ccc7d8b55d61c745434127a7e7155e4f"}
Jul 08 11:25:24.732141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:24.732095    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dzl98" podStartSLOduration=2.519234909 podStartE2EDuration="24.732079358s" totalImagesPullingTime="22.212844449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:25:24.731292233 +0000 UTC m=+715.494645595" watchObservedRunningTime="2026-07-08 11:25:24.732079358 +0000 UTC m=+715.495432720"
Jul 08 11:25:28.340357 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:28.340319    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"]
Jul 08 11:25:29.728331 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:29.728251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8" event={"ID":"23cb28ba-72b1-40c6-99ec-2e418143b161","Type":"ContainerStarted","Data":"aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9"}
Jul 08 11:25:29.728736 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:29.728352    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8" podUID="23cb28ba-72b1-40c6-99ec-2e418143b161" containerName="manager" containerID="cri-o://aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9" gracePeriod=10
Jul 08 11:25:29.728736 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:29.728421    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:29.748652 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:29.748606    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8" podStartSLOduration=13.379886717 podStartE2EDuration="18.748590175s" totalImagesPullingTime="5.368703458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:25:29.746050562 +0000 UTC m=+720.509403926" watchObservedRunningTime="2026-07-08 11:25:29.748590175 +0000 UTC m=+720.511943537"
Jul 08 11:25:30.070560 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.070537    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:30.124615 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.124587    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23cb28ba-72b1-40c6-99ec-2e418143b161-extensions-socket-volume\") pod \"23cb28ba-72b1-40c6-99ec-2e418143b161\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") "
Jul 08 11:25:30.124742 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.124654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwdtl\" (UniqueName: \"kubernetes.io/projected/23cb28ba-72b1-40c6-99ec-2e418143b161-kube-api-access-pwdtl\") pod \"23cb28ba-72b1-40c6-99ec-2e418143b161\" (UID: \"23cb28ba-72b1-40c6-99ec-2e418143b161\") "
Jul 08 11:25:30.124954 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.124932    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cb28ba-72b1-40c6-99ec-2e418143b161-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "23cb28ba-72b1-40c6-99ec-2e418143b161" (UID: "23cb28ba-72b1-40c6-99ec-2e418143b161"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 11:25:30.126812 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.126791    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23cb28ba-72b1-40c6-99ec-2e418143b161-kube-api-access-pwdtl" (OuterVolumeSpecName: "kube-api-access-pwdtl") pod "23cb28ba-72b1-40c6-99ec-2e418143b161" (UID: "23cb28ba-72b1-40c6-99ec-2e418143b161"). InnerVolumeSpecName "kube-api-access-pwdtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:25:30.225347 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.225325    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwdtl\" (UniqueName: \"kubernetes.io/projected/23cb28ba-72b1-40c6-99ec-2e418143b161-kube-api-access-pwdtl\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:25:30.225347 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.225347    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23cb28ba-72b1-40c6-99ec-2e418143b161-extensions-socket-volume\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:25:30.733042 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.733011    2561 generic.go:356] "Generic (PLEG): container finished" podID="23cb28ba-72b1-40c6-99ec-2e418143b161" containerID="aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9" exitCode=0
Jul 08 11:25:30.733399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.733053    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"
Jul 08 11:25:30.733399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.733061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8" event={"ID":"23cb28ba-72b1-40c6-99ec-2e418143b161","Type":"ContainerDied","Data":"aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9"}
Jul 08 11:25:30.733399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.733103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8" event={"ID":"23cb28ba-72b1-40c6-99ec-2e418143b161","Type":"ContainerDied","Data":"0b180d389911dd1c22c2602360a3e2810fa19a5af50b3b5d5d62637b0da3e0d8"}
Jul 08 11:25:30.733399 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.733124    2561 scope.go:117] "RemoveContainer" containerID="aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9"
Jul 08 11:25:30.742196 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.742179    2561 scope.go:117] "RemoveContainer" containerID="aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9"
Jul 08 11:25:30.742460 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:25:30.742441    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9\": container with ID starting with aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9 not found: ID does not exist" containerID="aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9"
Jul 08 11:25:30.742520 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.742472    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9"} err="failed to get container status \"aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9\": rpc error: code = NotFound desc = could not find container \"aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9\": container with ID starting with aaf03a9bdb97fa7c06dd0e0d79ea00a7cda68e8232707d12971b84e500bed9d9 not found: ID does not exist"
Jul 08 11:25:30.765709 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.765677    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"]
Jul 08 11:25:30.771591 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:30.771572    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qqmh8"]
Jul 08 11:25:31.833682 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:31.833653    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23cb28ba-72b1-40c6-99ec-2e418143b161" path="/var/lib/kubelet/pods/23cb28ba-72b1-40c6-99ec-2e418143b161/volumes"
Jul 08 11:25:46.449695 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.449662    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:25:46.450138 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.450043    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cb28ba-72b1-40c6-99ec-2e418143b161" containerName="manager"
Jul 08 11:25:46.450138 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.450058    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cb28ba-72b1-40c6-99ec-2e418143b161" containerName="manager"
Jul 08 11:25:46.450206 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.450140    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="23cb28ba-72b1-40c6-99ec-2e418143b161" containerName="manager"
Jul 08 11:25:46.655833 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.655803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:25:46.655833 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.655837    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:25:46.656040 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.655941    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.658398 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.658379    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 11:25:46.759690 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.759663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f69131-fe81-4a16-9b48-5079f7c5aa48-config-file\") pod \"limitador-limitador-64c94fd64f-hpm2c\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.759818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.759704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbjhl\" (UniqueName: \"kubernetes.io/projected/d7f69131-fe81-4a16-9b48-5079f7c5aa48-kube-api-access-sbjhl\") pod \"limitador-limitador-64c94fd64f-hpm2c\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.860521 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.860493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f69131-fe81-4a16-9b48-5079f7c5aa48-config-file\") pod \"limitador-limitador-64c94fd64f-hpm2c\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.860645 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.860530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbjhl\" (UniqueName: \"kubernetes.io/projected/d7f69131-fe81-4a16-9b48-5079f7c5aa48-kube-api-access-sbjhl\") pod \"limitador-limitador-64c94fd64f-hpm2c\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.861120 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.861103    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f69131-fe81-4a16-9b48-5079f7c5aa48-config-file\") pod \"limitador-limitador-64c94fd64f-hpm2c\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.872298 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.872272    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbjhl\" (UniqueName: \"kubernetes.io/projected/d7f69131-fe81-4a16-9b48-5079f7c5aa48-kube-api-access-sbjhl\") pod \"limitador-limitador-64c94fd64f-hpm2c\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:46.965398 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:46.965379    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:47.164754 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.164732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:25:47.166678 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:25:47.166653    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f69131_fe81_4a16_9b48_5079f7c5aa48.slice/crio-0a5fb6060b4f2dac6af59db372e99d19d82d2c3ac0e802f7047f4d7a15edd6f4 WatchSource:0}: Error finding container 0a5fb6060b4f2dac6af59db372e99d19d82d2c3ac0e802f7047f4d7a15edd6f4: Status 404 returned error can't find the container with id 0a5fb6060b4f2dac6af59db372e99d19d82d2c3ac0e802f7047f4d7a15edd6f4
Jul 08 11:25:47.489183 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.486651    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cwf2"]
Jul 08 11:25:47.513182 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.513157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cwf2"]
Jul 08 11:25:47.513312 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.513236    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:25:47.515373 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.515356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lpkf8\""
Jul 08 11:25:47.567251 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.567225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hcr7\" (UniqueName: \"kubernetes.io/projected/66c1d3b4-6f87-4a26-957c-00102e4343a5-kube-api-access-6hcr7\") pod \"authorino-75d556bd77-8cwf2\" (UID: \"66c1d3b4-6f87-4a26-957c-00102e4343a5\") " pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:25:47.668354 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.668327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hcr7\" (UniqueName: \"kubernetes.io/projected/66c1d3b4-6f87-4a26-957c-00102e4343a5-kube-api-access-6hcr7\") pod \"authorino-75d556bd77-8cwf2\" (UID: \"66c1d3b4-6f87-4a26-957c-00102e4343a5\") " pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:25:47.676498 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.676475    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hcr7\" (UniqueName: \"kubernetes.io/projected/66c1d3b4-6f87-4a26-957c-00102e4343a5-kube-api-access-6hcr7\") pod \"authorino-75d556bd77-8cwf2\" (UID: \"66c1d3b4-6f87-4a26-957c-00102e4343a5\") " pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:25:47.808200 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.808169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c" event={"ID":"d7f69131-fe81-4a16-9b48-5079f7c5aa48","Type":"ContainerStarted","Data":"0a5fb6060b4f2dac6af59db372e99d19d82d2c3ac0e802f7047f4d7a15edd6f4"}
Jul 08 11:25:47.822391 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.822372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:25:47.963133 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:47.963105    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cwf2"]
Jul 08 11:25:47.965844 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:25:47.965816    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66c1d3b4_6f87_4a26_957c_00102e4343a5.slice/crio-fab6956b6fa3935ab4e07f4841e85c475a7195974912cbcc0e7315d6844fb5e9 WatchSource:0}: Error finding container fab6956b6fa3935ab4e07f4841e85c475a7195974912cbcc0e7315d6844fb5e9: Status 404 returned error can't find the container with id fab6956b6fa3935ab4e07f4841e85c475a7195974912cbcc0e7315d6844fb5e9
Jul 08 11:25:48.819413 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:48.819347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cwf2" event={"ID":"66c1d3b4-6f87-4a26-957c-00102e4343a5","Type":"ContainerStarted","Data":"fab6956b6fa3935ab4e07f4841e85c475a7195974912cbcc0e7315d6844fb5e9"}
Jul 08 11:25:53.845019 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:53.844930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cwf2" event={"ID":"66c1d3b4-6f87-4a26-957c-00102e4343a5","Type":"ContainerStarted","Data":"3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f"}
Jul 08 11:25:53.846389 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:53.846363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c" event={"ID":"d7f69131-fe81-4a16-9b48-5079f7c5aa48","Type":"ContainerStarted","Data":"7a9e284a3e4366b34f4267d3a46a3eadf2ccb752f10014790fe19ab19e882aa1"}
Jul 08 11:25:53.846502 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:53.846436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:25:53.861282 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:53.861242    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8cwf2" podStartSLOduration=1.265437555 podStartE2EDuration="6.861228381s" totalImagesPullingTime="5.595790826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:25:53.860329445 +0000 UTC m=+744.623682830" watchObservedRunningTime="2026-07-08 11:25:53.861228381 +0000 UTC m=+744.624581742"
Jul 08 11:25:53.881014 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:25:53.880957    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c" podStartSLOduration=1.5006522279999999 podStartE2EDuration="7.880939018s" totalImagesPullingTime="6.38028679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:25:53.879376822 +0000 UTC m=+744.642730197" watchObservedRunningTime="2026-07-08 11:25:53.880939018 +0000 UTC m=+744.644292383"
Jul 08 11:26:01.388933 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:01.388902    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:26:01.389308 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:01.389060    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c" podUID="d7f69131-fe81-4a16-9b48-5079f7c5aa48" containerName="limitador" containerID="cri-o://7a9e284a3e4366b34f4267d3a46a3eadf2ccb752f10014790fe19ab19e882aa1" gracePeriod=30
Jul 08 11:26:01.391248 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:01.391230    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:26:01.881468 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:01.881435    2561 generic.go:356] "Generic (PLEG): container finished" podID="d7f69131-fe81-4a16-9b48-5079f7c5aa48" containerID="7a9e284a3e4366b34f4267d3a46a3eadf2ccb752f10014790fe19ab19e882aa1" exitCode=0
Jul 08 11:26:01.881586 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:01.881497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c" event={"ID":"d7f69131-fe81-4a16-9b48-5079f7c5aa48","Type":"ContainerDied","Data":"7a9e284a3e4366b34f4267d3a46a3eadf2ccb752f10014790fe19ab19e882aa1"}
Jul 08 11:26:01.925013 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:01.924993    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:26:02.089085 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.089062    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f69131-fe81-4a16-9b48-5079f7c5aa48-config-file\") pod \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") "
Jul 08 11:26:02.089193 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.089101    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbjhl\" (UniqueName: \"kubernetes.io/projected/d7f69131-fe81-4a16-9b48-5079f7c5aa48-kube-api-access-sbjhl\") pod \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\" (UID: \"d7f69131-fe81-4a16-9b48-5079f7c5aa48\") "
Jul 08 11:26:02.089441 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.089419    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f69131-fe81-4a16-9b48-5079f7c5aa48-config-file" (OuterVolumeSpecName: "config-file") pod "d7f69131-fe81-4a16-9b48-5079f7c5aa48" (UID: "d7f69131-fe81-4a16-9b48-5079f7c5aa48"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:26:02.091152 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.091132    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f69131-fe81-4a16-9b48-5079f7c5aa48-kube-api-access-sbjhl" (OuterVolumeSpecName: "kube-api-access-sbjhl") pod "d7f69131-fe81-4a16-9b48-5079f7c5aa48" (UID: "d7f69131-fe81-4a16-9b48-5079f7c5aa48"). InnerVolumeSpecName "kube-api-access-sbjhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:26:02.190325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.190306    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f69131-fe81-4a16-9b48-5079f7c5aa48-config-file\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:26:02.190325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.190325    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbjhl\" (UniqueName: \"kubernetes.io/projected/d7f69131-fe81-4a16-9b48-5079f7c5aa48-kube-api-access-sbjhl\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:26:02.887352 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.887316    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c" event={"ID":"d7f69131-fe81-4a16-9b48-5079f7c5aa48","Type":"ContainerDied","Data":"0a5fb6060b4f2dac6af59db372e99d19d82d2c3ac0e802f7047f4d7a15edd6f4"}
Jul 08 11:26:02.887352 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.887353    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"
Jul 08 11:26:02.887781 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.887373    2561 scope.go:117] "RemoveContainer" containerID="7a9e284a3e4366b34f4267d3a46a3eadf2ccb752f10014790fe19ab19e882aa1"
Jul 08 11:26:02.907851 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.907827    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:26:02.915681 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:02.915662    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hpm2c"]
Jul 08 11:26:03.060008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.059983    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"]
Jul 08 11:26:03.060522 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.060507    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f69131-fe81-4a16-9b48-5079f7c5aa48" containerName="limitador"
Jul 08 11:26:03.060569 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.060526    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f69131-fe81-4a16-9b48-5079f7c5aa48" containerName="limitador"
Jul 08 11:26:03.060616 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.060605    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f69131-fe81-4a16-9b48-5079f7c5aa48" containerName="limitador"
Jul 08 11:26:03.063529 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.063510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.066085 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.066066    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 11:26:03.066085 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.066069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-d7zw4\""
Jul 08 11:26:03.066233 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.066178    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 11:26:03.066439 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.066425    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 11:26:03.071500 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.071478    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"]
Jul 08 11:26:03.197334 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.197276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/b4aba2df-b28a-4e03-b884-c528c0e9b755-kube-api-access-cl5kk\") pod \"postgres-69fb4594cf-hqkn4\" (UID: \"b4aba2df-b28a-4e03-b884-c528c0e9b755\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.197443 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.197334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b4aba2df-b28a-4e03-b884-c528c0e9b755-data\") pod \"postgres-69fb4594cf-hqkn4\" (UID: \"b4aba2df-b28a-4e03-b884-c528c0e9b755\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.297627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.297604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b4aba2df-b28a-4e03-b884-c528c0e9b755-data\") pod \"postgres-69fb4594cf-hqkn4\" (UID: \"b4aba2df-b28a-4e03-b884-c528c0e9b755\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.297749 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.297668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/b4aba2df-b28a-4e03-b884-c528c0e9b755-kube-api-access-cl5kk\") pod \"postgres-69fb4594cf-hqkn4\" (UID: \"b4aba2df-b28a-4e03-b884-c528c0e9b755\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.299564 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.298218    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b4aba2df-b28a-4e03-b884-c528c0e9b755-data\") pod \"postgres-69fb4594cf-hqkn4\" (UID: \"b4aba2df-b28a-4e03-b884-c528c0e9b755\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.307379 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.307356    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5kk\" (UniqueName: \"kubernetes.io/projected/b4aba2df-b28a-4e03-b884-c528c0e9b755-kube-api-access-cl5kk\") pod \"postgres-69fb4594cf-hqkn4\" (UID: \"b4aba2df-b28a-4e03-b884-c528c0e9b755\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.374287 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.374265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:03.496816 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.496791    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"]
Jul 08 11:26:03.499239 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:26:03.499212    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4aba2df_b28a_4e03_b884_c528c0e9b755.slice/crio-94a4f3a641974e77634784bd232b286433fab2f1f831531befc42ce914a921a4 WatchSource:0}: Error finding container 94a4f3a641974e77634784bd232b286433fab2f1f831531befc42ce914a921a4: Status 404 returned error can't find the container with id 94a4f3a641974e77634784bd232b286433fab2f1f831531befc42ce914a921a4
Jul 08 11:26:03.834993 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.834962    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f69131-fe81-4a16-9b48-5079f7c5aa48" path="/var/lib/kubelet/pods/d7f69131-fe81-4a16-9b48-5079f7c5aa48/volumes"
Jul 08 11:26:03.893418 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:03.893392    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4" event={"ID":"b4aba2df-b28a-4e03-b884-c528c0e9b755","Type":"ContainerStarted","Data":"94a4f3a641974e77634784bd232b286433fab2f1f831531befc42ce914a921a4"}
Jul 08 11:26:08.922417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:08.922381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4" event={"ID":"b4aba2df-b28a-4e03-b884-c528c0e9b755","Type":"ContainerStarted","Data":"da53f1ff1b2ffebcdb105d246c892f2e943112d79ef4dd538ab06a7bb858bc24"}
Jul 08 11:26:08.922764 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:08.922443    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:08.940294 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:08.940241    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4" podStartSLOduration=1.030015042 podStartE2EDuration="5.940227022s" totalImagesPullingTime="4.91021198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:26:08.93918913 +0000 UTC m=+759.702542493" watchObservedRunningTime="2026-07-08 11:26:08.940227022 +0000 UTC m=+759.703580385"
Jul 08 11:26:14.955086 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:14.955059    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hqkn4"
Jul 08 11:26:15.920812 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:15.920777    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5456798b48-dcm2q"]
Jul 08 11:26:15.924171 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:15.924149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:15.926435 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:15.926419    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 11:26:15.933094 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:15.933067    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5456798b48-dcm2q"]
Jul 08 11:26:16.108504 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.108476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqlh8\" (UniqueName: \"kubernetes.io/projected/22dc1064-b238-4818-9602-2051d8de9cb3-kube-api-access-jqlh8\") pod \"authorino-5456798b48-dcm2q\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") " pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.108504 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.108506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/22dc1064-b238-4818-9602-2051d8de9cb3-tls-cert\") pod \"authorino-5456798b48-dcm2q\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") " pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.209136 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.209084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqlh8\" (UniqueName: \"kubernetes.io/projected/22dc1064-b238-4818-9602-2051d8de9cb3-kube-api-access-jqlh8\") pod \"authorino-5456798b48-dcm2q\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") " pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.209136 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.209111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/22dc1064-b238-4818-9602-2051d8de9cb3-tls-cert\") pod \"authorino-5456798b48-dcm2q\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") " pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.211625 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.211605    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/22dc1064-b238-4818-9602-2051d8de9cb3-tls-cert\") pod \"authorino-5456798b48-dcm2q\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") " pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.216149 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.216128    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqlh8\" (UniqueName: \"kubernetes.io/projected/22dc1064-b238-4818-9602-2051d8de9cb3-kube-api-access-jqlh8\") pod \"authorino-5456798b48-dcm2q\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") " pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.233963 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.233943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:26:16.359034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.358942    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5456798b48-dcm2q"]
Jul 08 11:26:16.360955 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:26:16.360926    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22dc1064_b238_4818_9602_2051d8de9cb3.slice/crio-6e5610b5af9c7e2d7e7ee2d49d178fc98578a164780cae82c622d6a3fefff25a WatchSource:0}: Error finding container 6e5610b5af9c7e2d7e7ee2d49d178fc98578a164780cae82c622d6a3fefff25a: Status 404 returned error can't find the container with id 6e5610b5af9c7e2d7e7ee2d49d178fc98578a164780cae82c622d6a3fefff25a
Jul 08 11:26:16.966578 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.966482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5456798b48-dcm2q" event={"ID":"22dc1064-b238-4818-9602-2051d8de9cb3","Type":"ContainerStarted","Data":"d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e"}
Jul 08 11:26:16.966578 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.966531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5456798b48-dcm2q" event={"ID":"22dc1064-b238-4818-9602-2051d8de9cb3","Type":"ContainerStarted","Data":"6e5610b5af9c7e2d7e7ee2d49d178fc98578a164780cae82c622d6a3fefff25a"}
Jul 08 11:26:16.982777 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:16.982729    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5456798b48-dcm2q" podStartSLOduration=1.679176671 podStartE2EDuration="1.98271289s" totalImagesPullingTime="303.536219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:26:16.981978482 +0000 UTC m=+767.745331846" watchObservedRunningTime="2026-07-08 11:26:16.98271289 +0000 UTC m=+767.746066285"
Jul 08 11:26:17.007184 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.007157    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cwf2"]
Jul 08 11:26:17.007325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.007307    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8cwf2" podUID="66c1d3b4-6f87-4a26-957c-00102e4343a5" containerName="authorino" containerID="cri-o://3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f" gracePeriod=30
Jul 08 11:26:17.236690 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.236669    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:26:17.421479 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.421434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hcr7\" (UniqueName: \"kubernetes.io/projected/66c1d3b4-6f87-4a26-957c-00102e4343a5-kube-api-access-6hcr7\") pod \"66c1d3b4-6f87-4a26-957c-00102e4343a5\" (UID: \"66c1d3b4-6f87-4a26-957c-00102e4343a5\") "
Jul 08 11:26:17.423677 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.423651    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c1d3b4-6f87-4a26-957c-00102e4343a5-kube-api-access-6hcr7" (OuterVolumeSpecName: "kube-api-access-6hcr7") pod "66c1d3b4-6f87-4a26-957c-00102e4343a5" (UID: "66c1d3b4-6f87-4a26-957c-00102e4343a5"). InnerVolumeSpecName "kube-api-access-6hcr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:26:17.522465 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.522445    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hcr7\" (UniqueName: \"kubernetes.io/projected/66c1d3b4-6f87-4a26-957c-00102e4343a5-kube-api-access-6hcr7\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:26:17.972039 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.971995    2561 generic.go:356] "Generic (PLEG): container finished" podID="66c1d3b4-6f87-4a26-957c-00102e4343a5" containerID="3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f" exitCode=0
Jul 08 11:26:17.972039 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.972040    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cwf2"
Jul 08 11:26:17.972215 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.972080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cwf2" event={"ID":"66c1d3b4-6f87-4a26-957c-00102e4343a5","Type":"ContainerDied","Data":"3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f"}
Jul 08 11:26:17.972215 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.972120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cwf2" event={"ID":"66c1d3b4-6f87-4a26-957c-00102e4343a5","Type":"ContainerDied","Data":"fab6956b6fa3935ab4e07f4841e85c475a7195974912cbcc0e7315d6844fb5e9"}
Jul 08 11:26:17.972215 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.972136    2561 scope.go:117] "RemoveContainer" containerID="3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f"
Jul 08 11:26:17.980725 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.980708    2561 scope.go:117] "RemoveContainer" containerID="3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f"
Jul 08 11:26:17.980999 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:26:17.980982    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f\": container with ID starting with 3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f not found: ID does not exist" containerID="3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f"
Jul 08 11:26:17.981066 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.981019    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f"} err="failed to get container status \"3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f\": rpc error: code = NotFound desc = could not find container \"3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f\": container with ID starting with 3510f4d2f2d284be4119212f8bb50296fc75be9af1e623d50c0cee77a518a87f not found: ID does not exist"
Jul 08 11:26:17.987650 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.987631    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cwf2"]
Jul 08 11:26:17.992458 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:17.992440    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cwf2"]
Jul 08 11:26:19.839433 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:26:19.836730    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66c1d3b4-6f87-4a26-957c-00102e4343a5" path="/var/lib/kubelet/pods/66c1d3b4-6f87-4a26-957c-00102e4343a5/volumes"
Jul 08 11:27:12.681975 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.681949    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"]
Jul 08 11:27:12.682409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.682293    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c1d3b4-6f87-4a26-957c-00102e4343a5" containerName="authorino"
Jul 08 11:27:12.682409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.682302    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c1d3b4-6f87-4a26-957c-00102e4343a5" containerName="authorino"
Jul 08 11:27:12.682409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.682356    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c1d3b4-6f87-4a26-957c-00102e4343a5" containerName="authorino"
Jul 08 11:27:12.684679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.684663    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.685240 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.685214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.685366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.685289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.685366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.685314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.685366 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.685354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.685493 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.685373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.685493 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.685390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gcv\" (UniqueName: \"kubernetes.io/projected/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-kube-api-access-84gcv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.687775 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.687754    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 11:27:12.688006 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.687821    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 11:27:12.688098 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.687883    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5mvkj\""
Jul 08 11:27:12.688098 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.687860    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 11:27:12.694710 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.694691    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"]
Jul 08 11:27:12.785850 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.785822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gcv\" (UniqueName: \"kubernetes.io/projected/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-kube-api-access-84gcv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.785986 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.785856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786049 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.785992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786049 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.786029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786156 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.786062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786156 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.786096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786300 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.786276    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786357 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.786334    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.786459 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.786438    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.788206 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.788186    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.788479 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.788461    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.793408 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.793385    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gcv\" (UniqueName: \"kubernetes.io/projected/d53733ac-0ae7-4fe2-a9ff-e47e617caba3-kube-api-access-84gcv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq\" (UID: \"d53733ac-0ae7-4fe2-a9ff-e47e617caba3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:12.995386 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:12.995303    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:13.152093 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:13.152059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"]
Jul 08 11:27:13.153114 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:27:13.153083    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53733ac_0ae7_4fe2_a9ff_e47e617caba3.slice/crio-6384807abc670ec1a6434e91ef8f4eec1faf92245db032aa914987e7d1e8d603 WatchSource:0}: Error finding container 6384807abc670ec1a6434e91ef8f4eec1faf92245db032aa914987e7d1e8d603: Status 404 returned error can't find the container with id 6384807abc670ec1a6434e91ef8f4eec1faf92245db032aa914987e7d1e8d603
Jul 08 11:27:13.215296 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:13.215259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq" event={"ID":"d53733ac-0ae7-4fe2-a9ff-e47e617caba3","Type":"ContainerStarted","Data":"6384807abc670ec1a6434e91ef8f4eec1faf92245db032aa914987e7d1e8d603"}
Jul 08 11:27:15.227041 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:15.227005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq" event={"ID":"d53733ac-0ae7-4fe2-a9ff-e47e617caba3","Type":"ContainerStarted","Data":"a18e033f2f1c51a1c0f4a4815067d4e2f0c5e74dc76e880d1732aaaf4b579d3f"}
Jul 08 11:27:15.245114 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:15.245064    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq" podStartSLOduration=2.125854981 podStartE2EDuration="3.245048997s" totalImagesPullingTime="1.119194016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:27:15.242783454 +0000 UTC m=+826.006136816" watchObservedRunningTime="2026-07-08 11:27:15.245048997 +0000 UTC m=+826.008402360"
Jul 08 11:27:22.995944 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:22.995907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:22.996279 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:22.995969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:23.010226 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:23.010203    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:23.274213 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:23.274194    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq"
Jul 08 11:27:40.200190 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.200160    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"]
Jul 08 11:27:40.203524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.203501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.206049 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.206029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 11:27:40.215342 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.215320    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"]
Jul 08 11:27:40.300265 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.300243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.300358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.300285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.300358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.300299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bf6157-4516-4db5-91bd-88a78a32da49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.300439 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.300376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.300439 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.300397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.300439 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.300422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5l7m\" (UniqueName: \"kubernetes.io/projected/b0bf6157-4516-4db5-91bd-88a78a32da49-kube-api-access-z5l7m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401303 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401411 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401411 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bf6157-4516-4db5-91bd-88a78a32da49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401411 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401411 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401620 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5l7m\" (UniqueName: \"kubernetes.io/projected/b0bf6157-4516-4db5-91bd-88a78a32da49-kube-api-access-z5l7m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401676 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401638    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401748 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401727    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.401790 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.401768    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.403477 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.403459    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0bf6157-4516-4db5-91bd-88a78a32da49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.403839 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.403824    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bf6157-4516-4db5-91bd-88a78a32da49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.412117 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.412096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5l7m\" (UniqueName: \"kubernetes.io/projected/b0bf6157-4516-4db5-91bd-88a78a32da49-kube-api-access-z5l7m\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ngbvc\" (UID: \"b0bf6157-4516-4db5-91bd-88a78a32da49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.516563 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.516541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:40.647921 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:40.647897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"]
Jul 08 11:27:40.650401 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:27:40.650379    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0bf6157_4516_4db5_91bd_88a78a32da49.slice/crio-9c433ff448f6c6b5eb851de1b67a851ffba570ccf5124ac4a0ee1e1264a246a9 WatchSource:0}: Error finding container 9c433ff448f6c6b5eb851de1b67a851ffba570ccf5124ac4a0ee1e1264a246a9: Status 404 returned error can't find the container with id 9c433ff448f6c6b5eb851de1b67a851ffba570ccf5124ac4a0ee1e1264a246a9
Jul 08 11:27:41.348675 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:41.348640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc" event={"ID":"b0bf6157-4516-4db5-91bd-88a78a32da49","Type":"ContainerStarted","Data":"d268d309a33b444f63e31fb38f666aaaf513b03ab40d1f9f03f68d2c786cc591"}
Jul 08 11:27:41.349153 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:41.348698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc" event={"ID":"b0bf6157-4516-4db5-91bd-88a78a32da49","Type":"ContainerStarted","Data":"9c433ff448f6c6b5eb851de1b67a851ffba570ccf5124ac4a0ee1e1264a246a9"}
Jul 08 11:27:41.367391 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:41.367319    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc" podStartSLOduration=1.168889979 podStartE2EDuration="1.367299804s" totalImagesPullingTime="198.409825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:27:41.366444337 +0000 UTC m=+852.129797702" watchObservedRunningTime="2026-07-08 11:27:41.367299804 +0000 UTC m=+852.130653167"
Jul 08 11:27:50.517401 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:50.517362    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:50.518023 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:50.517419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:50.530101 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:50.530079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:27:51.407467 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:27:51.407442    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ngbvc"
Jul 08 11:28:29.741726 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:28:29.741647    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:28:29.742644 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:28:29.742622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:28:29.746036 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:28:29.746017    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:28:29.746759 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:28:29.746737    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:29:04.868306 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:04.868275    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-649794b7f7-kzwxr"]
Jul 08 11:29:04.871644 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:04.871625    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:04.879431 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:04.879412    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-649794b7f7-kzwxr"]
Jul 08 11:29:05.018065 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.018034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8adf2d8f-7b0e-41e2-a36a-066ebcb61076-tls-cert\") pod \"authorino-649794b7f7-kzwxr\" (UID: \"8adf2d8f-7b0e-41e2-a36a-066ebcb61076\") " pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.018216 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.018094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntq9\" (UniqueName: \"kubernetes.io/projected/8adf2d8f-7b0e-41e2-a36a-066ebcb61076-kube-api-access-8ntq9\") pod \"authorino-649794b7f7-kzwxr\" (UID: \"8adf2d8f-7b0e-41e2-a36a-066ebcb61076\") " pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.119229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.119169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8adf2d8f-7b0e-41e2-a36a-066ebcb61076-tls-cert\") pod \"authorino-649794b7f7-kzwxr\" (UID: \"8adf2d8f-7b0e-41e2-a36a-066ebcb61076\") " pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.119229 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.119223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntq9\" (UniqueName: \"kubernetes.io/projected/8adf2d8f-7b0e-41e2-a36a-066ebcb61076-kube-api-access-8ntq9\") pod \"authorino-649794b7f7-kzwxr\" (UID: \"8adf2d8f-7b0e-41e2-a36a-066ebcb61076\") " pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.121319 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.121304    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8adf2d8f-7b0e-41e2-a36a-066ebcb61076-tls-cert\") pod \"authorino-649794b7f7-kzwxr\" (UID: \"8adf2d8f-7b0e-41e2-a36a-066ebcb61076\") " pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.126841 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.126824    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntq9\" (UniqueName: \"kubernetes.io/projected/8adf2d8f-7b0e-41e2-a36a-066ebcb61076-kube-api-access-8ntq9\") pod \"authorino-649794b7f7-kzwxr\" (UID: \"8adf2d8f-7b0e-41e2-a36a-066ebcb61076\") " pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.181932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.181898    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-649794b7f7-kzwxr"
Jul 08 11:29:05.313379 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.313352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-649794b7f7-kzwxr"]
Jul 08 11:29:05.315515 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:29:05.315490    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8adf2d8f_7b0e_41e2_a36a_066ebcb61076.slice/crio-7e9563aa340c761d6fed40ef71084ba056cc2a2c5d5719d79e5e659d84fdc9a0 WatchSource:0}: Error finding container 7e9563aa340c761d6fed40ef71084ba056cc2a2c5d5719d79e5e659d84fdc9a0: Status 404 returned error can't find the container with id 7e9563aa340c761d6fed40ef71084ba056cc2a2c5d5719d79e5e659d84fdc9a0
Jul 08 11:29:05.748790 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:05.748758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-649794b7f7-kzwxr" event={"ID":"8adf2d8f-7b0e-41e2-a36a-066ebcb61076","Type":"ContainerStarted","Data":"7e9563aa340c761d6fed40ef71084ba056cc2a2c5d5719d79e5e659d84fdc9a0"}
Jul 08 11:29:06.756252 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:06.756212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-649794b7f7-kzwxr" event={"ID":"8adf2d8f-7b0e-41e2-a36a-066ebcb61076","Type":"ContainerStarted","Data":"5cd440efc8b497fff6a14ae9134abb3d5743d564806a31f18e90b8728c6f1af9"}
Jul 08 11:29:06.778116 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:06.778028    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-649794b7f7-kzwxr" podStartSLOduration=2.367930707 podStartE2EDuration="2.77800626s" totalImagesPullingTime="410.075553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:29:06.774649102 +0000 UTC m=+937.538002467" watchObservedRunningTime="2026-07-08 11:29:06.77800626 +0000 UTC m=+937.541359624"
Jul 08 11:29:06.812150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:06.812113    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5456798b48-dcm2q"]
Jul 08 11:29:06.812543 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:06.812514    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5456798b48-dcm2q" podUID="22dc1064-b238-4818-9602-2051d8de9cb3" containerName="authorino" containerID="cri-o://d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e" gracePeriod=30
Jul 08 11:29:07.116255 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.116220    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:29:07.239305 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.239273    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqlh8\" (UniqueName: \"kubernetes.io/projected/22dc1064-b238-4818-9602-2051d8de9cb3-kube-api-access-jqlh8\") pod \"22dc1064-b238-4818-9602-2051d8de9cb3\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") "
Jul 08 11:29:07.239468 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.239315    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/22dc1064-b238-4818-9602-2051d8de9cb3-tls-cert\") pod \"22dc1064-b238-4818-9602-2051d8de9cb3\" (UID: \"22dc1064-b238-4818-9602-2051d8de9cb3\") "
Jul 08 11:29:07.241550 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.241520    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22dc1064-b238-4818-9602-2051d8de9cb3-kube-api-access-jqlh8" (OuterVolumeSpecName: "kube-api-access-jqlh8") pod "22dc1064-b238-4818-9602-2051d8de9cb3" (UID: "22dc1064-b238-4818-9602-2051d8de9cb3"). InnerVolumeSpecName "kube-api-access-jqlh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:29:07.250841 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.250810    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22dc1064-b238-4818-9602-2051d8de9cb3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "22dc1064-b238-4818-9602-2051d8de9cb3" (UID: "22dc1064-b238-4818-9602-2051d8de9cb3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:29:07.340335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.340299    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqlh8\" (UniqueName: \"kubernetes.io/projected/22dc1064-b238-4818-9602-2051d8de9cb3-kube-api-access-jqlh8\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:29:07.340335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.340330    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/22dc1064-b238-4818-9602-2051d8de9cb3-tls-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:29:07.762747 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.762712    2561 generic.go:356] "Generic (PLEG): container finished" podID="22dc1064-b238-4818-9602-2051d8de9cb3" containerID="d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e" exitCode=0
Jul 08 11:29:07.763278 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.762784    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5456798b48-dcm2q"
Jul 08 11:29:07.763278 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.762798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5456798b48-dcm2q" event={"ID":"22dc1064-b238-4818-9602-2051d8de9cb3","Type":"ContainerDied","Data":"d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e"}
Jul 08 11:29:07.763278 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.762842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5456798b48-dcm2q" event={"ID":"22dc1064-b238-4818-9602-2051d8de9cb3","Type":"ContainerDied","Data":"6e5610b5af9c7e2d7e7ee2d49d178fc98578a164780cae82c622d6a3fefff25a"}
Jul 08 11:29:07.763278 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.762860    2561 scope.go:117] "RemoveContainer" containerID="d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e"
Jul 08 11:29:07.771758 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.771641    2561 scope.go:117] "RemoveContainer" containerID="d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e"
Jul 08 11:29:07.772013 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:29:07.771983    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e\": container with ID starting with d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e not found: ID does not exist" containerID="d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e"
Jul 08 11:29:07.772180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.772023    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e"} err="failed to get container status \"d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e\": rpc error: code = NotFound desc = could not find container \"d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e\": container with ID starting with d969f07266e9c198ebfa03dda06a68c5c8a194ff4549be7f6bea2245b403a03e not found: ID does not exist"
Jul 08 11:29:07.784963 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.784927    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5456798b48-dcm2q"]
Jul 08 11:29:07.790506 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.790479    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5456798b48-dcm2q"]
Jul 08 11:29:07.834688 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:29:07.834647    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22dc1064-b238-4818-9602-2051d8de9cb3" path="/var/lib/kubelet/pods/22dc1064-b238-4818-9602-2051d8de9cb3/volumes"
Jul 08 11:30:00.168824 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.168779    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"]
Jul 08 11:30:00.169409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.169220    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22dc1064-b238-4818-9602-2051d8de9cb3" containerName="authorino"
Jul 08 11:30:00.169409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.169233    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="22dc1064-b238-4818-9602-2051d8de9cb3" containerName="authorino"
Jul 08 11:30:00.169409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.169293    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="22dc1064-b238-4818-9602-2051d8de9cb3" containerName="authorino"
Jul 08 11:30:00.172239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.172215    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:30:00.175099 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.175069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:30:00.182220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.182195    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"]
Jul 08 11:30:00.259353 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.259314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfds8\" (UniqueName: \"kubernetes.io/projected/8378cba7-72db-4db8-bb62-6cea197c91fe-kube-api-access-mfds8\") pod \"maas-api-key-cleanup-29725170-dj2dt\" (UID: \"8378cba7-72db-4db8-bb62-6cea197c91fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:30:00.360663 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.360628    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfds8\" (UniqueName: \"kubernetes.io/projected/8378cba7-72db-4db8-bb62-6cea197c91fe-kube-api-access-mfds8\") pod \"maas-api-key-cleanup-29725170-dj2dt\" (UID: \"8378cba7-72db-4db8-bb62-6cea197c91fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:30:00.370176 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.370146    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfds8\" (UniqueName: \"kubernetes.io/projected/8378cba7-72db-4db8-bb62-6cea197c91fe-kube-api-access-mfds8\") pod \"maas-api-key-cleanup-29725170-dj2dt\" (UID: \"8378cba7-72db-4db8-bb62-6cea197c91fe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:30:00.483670 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.483592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:30:00.613284 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:00.613257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"]
Jul 08 11:30:00.615515 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:30:00.615485    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8378cba7_72db_4db8_bb62_6cea197c91fe.slice/crio-da10420912eebf447b9947967cefe33f54629559a4430e97a8e3d71a9bcc33bd WatchSource:0}: Error finding container da10420912eebf447b9947967cefe33f54629559a4430e97a8e3d71a9bcc33bd: Status 404 returned error can't find the container with id da10420912eebf447b9947967cefe33f54629559a4430e97a8e3d71a9bcc33bd
Jul 08 11:30:01.005344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:01.005314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt" event={"ID":"8378cba7-72db-4db8-bb62-6cea197c91fe","Type":"ContainerStarted","Data":"da10420912eebf447b9947967cefe33f54629559a4430e97a8e3d71a9bcc33bd"}
Jul 08 11:30:05.026178 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:05.026140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt" event={"ID":"8378cba7-72db-4db8-bb62-6cea197c91fe","Type":"ContainerStarted","Data":"63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019"}
Jul 08 11:30:05.045949 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:30:05.045910    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt" podStartSLOduration=1.8141423479999998 podStartE2EDuration="5.045896963s" totalImagesPullingTime="3.231754615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:30:05.04403671 +0000 UTC m=+995.807390074" watchObservedRunningTime="2026-07-08 11:30:05.045896963 +0000 UTC m=+995.809250325"
Jul 08 11:31:00.010677 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:00.010643    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"]
Jul 08 11:31:00.011172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:00.010834    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt" podUID="8378cba7-72db-4db8-bb62-6cea197c91fe" containerName="cleanup" containerID="cri-o://63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019" gracePeriod=30
Jul 08 11:31:02.912776 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.912744    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7749979db8-j7nwk"]
Jul 08 11:31:02.916102 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.916086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.941430 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.941405    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7749979db8-j7nwk"]
Jul 08 11:31:02.959778 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.959756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-oauth-serving-cert\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.959902 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.959818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-config\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.959902 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.959858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-trusted-ca-bundle\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.959978 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.959930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-oauth-config\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.959978 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.959949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-serving-cert\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.959978 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.959967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-service-ca\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:02.960085 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:02.960004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzc47\" (UniqueName: \"kubernetes.io/projected/16b96199-9cf5-4d1e-875e-00c0b65addd4-kube-api-access-rzc47\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.060841 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-config\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.060958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-trusted-ca-bundle\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.060958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-oauth-config\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.060958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-serving-cert\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.060958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-service-ca\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.060958 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzc47\" (UniqueName: \"kubernetes.io/projected/16b96199-9cf5-4d1e-875e-00c0b65addd4-kube-api-access-rzc47\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.061183 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.060982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-oauth-serving-cert\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.061726 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.061701    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-oauth-serving-cert\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.061847 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.061738    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-config\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.061937 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.061854    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-service-ca\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.062016 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.061993    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16b96199-9cf5-4d1e-875e-00c0b65addd4-trusted-ca-bundle\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.063397 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.063376    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-serving-cert\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.063397 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.063388    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16b96199-9cf5-4d1e-875e-00c0b65addd4-console-oauth-config\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.069236 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.069217    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzc47\" (UniqueName: \"kubernetes.io/projected/16b96199-9cf5-4d1e-875e-00c0b65addd4-kube-api-access-rzc47\") pod \"console-7749979db8-j7nwk\" (UID: \"16b96199-9cf5-4d1e-875e-00c0b65addd4\") " pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.225012 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.224953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:03.369165 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:03.369092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7749979db8-j7nwk"]
Jul 08 11:31:03.374388 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:31:03.374357    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b96199_9cf5_4d1e_875e_00c0b65addd4.slice/crio-a764f18eda265bce883506683f9d33f82c46db0fd101c5e5c40ade7993de521b WatchSource:0}: Error finding container a764f18eda265bce883506683f9d33f82c46db0fd101c5e5c40ade7993de521b: Status 404 returned error can't find the container with id a764f18eda265bce883506683f9d33f82c46db0fd101c5e5c40ade7993de521b
Jul 08 11:31:04.300332 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:04.300302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7749979db8-j7nwk" event={"ID":"16b96199-9cf5-4d1e-875e-00c0b65addd4","Type":"ContainerStarted","Data":"e113e531f4a36e223b42311a33731b39730754c3a43eb4f46b039c489d71ea00"}
Jul 08 11:31:04.300683 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:04.300348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7749979db8-j7nwk" event={"ID":"16b96199-9cf5-4d1e-875e-00c0b65addd4","Type":"ContainerStarted","Data":"a764f18eda265bce883506683f9d33f82c46db0fd101c5e5c40ade7993de521b"}
Jul 08 11:31:04.323056 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:04.323012    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7749979db8-j7nwk" podStartSLOduration=2.322998879 podStartE2EDuration="2.322998879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:31:04.32274336 +0000 UTC m=+1055.086096716" watchObservedRunningTime="2026-07-08 11:31:04.322998879 +0000 UTC m=+1055.086352241"
Jul 08 11:31:13.225817 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:13.225785    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:13.226200 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:13.225833    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:13.230510 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:13.230490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:13.350186 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:13.350164    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7749979db8-j7nwk"
Jul 08 11:31:13.423177 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:13.423148    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78cd99bc7-frl4x"]
Jul 08 11:31:30.196387 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.196363    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:31:30.203409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.203388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfds8\" (UniqueName: \"kubernetes.io/projected/8378cba7-72db-4db8-bb62-6cea197c91fe-kube-api-access-mfds8\") pod \"8378cba7-72db-4db8-bb62-6cea197c91fe\" (UID: \"8378cba7-72db-4db8-bb62-6cea197c91fe\") "
Jul 08 11:31:30.205457 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.205434    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8378cba7-72db-4db8-bb62-6cea197c91fe-kube-api-access-mfds8" (OuterVolumeSpecName: "kube-api-access-mfds8") pod "8378cba7-72db-4db8-bb62-6cea197c91fe" (UID: "8378cba7-72db-4db8-bb62-6cea197c91fe"). InnerVolumeSpecName "kube-api-access-mfds8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:31:30.304418 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.304367    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfds8\" (UniqueName: \"kubernetes.io/projected/8378cba7-72db-4db8-bb62-6cea197c91fe-kube-api-access-mfds8\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:30.434487 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.434463    2561 generic.go:356] "Generic (PLEG): container finished" podID="8378cba7-72db-4db8-bb62-6cea197c91fe" containerID="63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019" exitCode=137
Jul 08 11:31:30.434581 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.434508    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"
Jul 08 11:31:30.434581 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.434550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt" event={"ID":"8378cba7-72db-4db8-bb62-6cea197c91fe","Type":"ContainerDied","Data":"63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019"}
Jul 08 11:31:30.434670 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.434594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt" event={"ID":"8378cba7-72db-4db8-bb62-6cea197c91fe","Type":"ContainerDied","Data":"da10420912eebf447b9947967cefe33f54629559a4430e97a8e3d71a9bcc33bd"}
Jul 08 11:31:30.434670 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.434616    2561 scope.go:117] "RemoveContainer" containerID="63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019"
Jul 08 11:31:30.443198 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.443185    2561 scope.go:117] "RemoveContainer" containerID="63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019"
Jul 08 11:31:30.443428 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:31:30.443408    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019\": container with ID starting with 63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019 not found: ID does not exist" containerID="63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019"
Jul 08 11:31:30.443485 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.443440    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019"} err="failed to get container status \"63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019\": rpc error: code = NotFound desc = could not find container \"63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019\": container with ID starting with 63c81e4b0bd57cfc5386f781792ad500b077f323b82c82060628d48d88448019 not found: ID does not exist"
Jul 08 11:31:30.454413 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.454391    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"]
Jul 08 11:31:30.458499 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:30.458480    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725170-dj2dt"]
Jul 08 11:31:31.834925 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:31.834889    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8378cba7-72db-4db8-bb62-6cea197c91fe" path="/var/lib/kubelet/pods/8378cba7-72db-4db8-bb62-6cea197c91fe/volumes"
Jul 08 11:31:38.443233 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.443193    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78cd99bc7-frl4x" podUID="54c055c9-5b46-4226-89f5-c6a2eb4f6b19" containerName="console" containerID="cri-o://eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463" gracePeriod=15
Jul 08 11:31:38.686220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.686192    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:31:38.775133 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-service-ca\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775139    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-oauth-serving-cert\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775239 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775181    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-serving-cert\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775327 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4rbn\" (UniqueName: \"kubernetes.io/projected/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-kube-api-access-w4rbn\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775377 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-oauth-config\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775428 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775410    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-config\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775477 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-trusted-ca-bundle\") pod \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\" (UID: \"54c055c9-5b46-4226-89f5-c6a2eb4f6b19\") "
Jul 08 11:31:38.775477 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775465    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-service-ca" (OuterVolumeSpecName: "service-ca") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:31:38.775582 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775524    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:31:38.775766 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775746    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:38.775766 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775766    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-oauth-serving-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:38.775975 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.775956    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:31:38.776059 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.776023    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-config" (OuterVolumeSpecName: "console-config") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:31:38.777327 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.777303    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:31:38.777424 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.777408    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:31:38.777486 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.777441    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-kube-api-access-w4rbn" (OuterVolumeSpecName: "kube-api-access-w4rbn") pod "54c055c9-5b46-4226-89f5-c6a2eb4f6b19" (UID: "54c055c9-5b46-4226-89f5-c6a2eb4f6b19"). InnerVolumeSpecName "kube-api-access-w4rbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:31:38.876473 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.876445    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-trusted-ca-bundle\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:38.876473 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.876468    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-serving-cert\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:38.876604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.876477    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4rbn\" (UniqueName: \"kubernetes.io/projected/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-kube-api-access-w4rbn\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:38.876604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.876490    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-oauth-config\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:38.876604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:38.876502    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54c055c9-5b46-4226-89f5-c6a2eb4f6b19-console-config\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:31:39.482664 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.482632    2561 generic.go:356] "Generic (PLEG): container finished" podID="54c055c9-5b46-4226-89f5-c6a2eb4f6b19" containerID="eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463" exitCode=0
Jul 08 11:31:39.483084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.482673    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cd99bc7-frl4x"
Jul 08 11:31:39.483084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.482714    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd99bc7-frl4x" event={"ID":"54c055c9-5b46-4226-89f5-c6a2eb4f6b19","Type":"ContainerDied","Data":"eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463"}
Jul 08 11:31:39.483084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.482764    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cd99bc7-frl4x" event={"ID":"54c055c9-5b46-4226-89f5-c6a2eb4f6b19","Type":"ContainerDied","Data":"e18cb78578fc52f5749f8511382db785a135acb082c816256b934270c29e113c"}
Jul 08 11:31:39.483084 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.482783    2561 scope.go:117] "RemoveContainer" containerID="eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463"
Jul 08 11:31:39.491661 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.491644    2561 scope.go:117] "RemoveContainer" containerID="eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463"
Jul 08 11:31:39.491928 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:31:39.491910    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463\": container with ID starting with eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463 not found: ID does not exist" containerID="eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463"
Jul 08 11:31:39.491977 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.491938    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463"} err="failed to get container status \"eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463\": rpc error: code = NotFound desc = could not find container \"eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463\": container with ID starting with eb35095b6b6b1b22f5daaf2bd4943183f353bf978f46a0df5ca870ecf0b0b463 not found: ID does not exist"
Jul 08 11:31:39.503722 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.503702    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78cd99bc7-frl4x"]
Jul 08 11:31:39.507363 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.507344    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78cd99bc7-frl4x"]
Jul 08 11:31:39.835293 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:31:39.835266    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c055c9-5b46-4226-89f5-c6a2eb4f6b19" path="/var/lib/kubelet/pods/54c055c9-5b46-4226-89f5-c6a2eb4f6b19/volumes"
Jul 08 11:33:29.773605 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:33:29.773567    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:33:29.780756 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:33:29.780734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:33:29.782536 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:33:29.782515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:33:29.784244 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:33:29.784229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:38:29.818627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:38:29.818598    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:38:29.821290 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:38:29.821270    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:38:29.823256 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:38:29.823232    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:38:29.826105 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:38:29.826089    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:42:13.714735 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.714696    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"]
Jul 08 11:42:13.715279 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.715261    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8378cba7-72db-4db8-bb62-6cea197c91fe" containerName="cleanup"
Jul 08 11:42:13.715360 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.715283    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8378cba7-72db-4db8-bb62-6cea197c91fe" containerName="cleanup"
Jul 08 11:42:13.715360 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.715306    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c055c9-5b46-4226-89f5-c6a2eb4f6b19" containerName="console"
Jul 08 11:42:13.715360 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.715314    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c055c9-5b46-4226-89f5-c6a2eb4f6b19" containerName="console"
Jul 08 11:42:13.715499 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.715407    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8378cba7-72db-4db8-bb62-6cea197c91fe" containerName="cleanup"
Jul 08 11:42:13.715499 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.715422    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c055c9-5b46-4226-89f5-c6a2eb4f6b19" containerName="console"
Jul 08 11:42:13.718525 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.718505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.721476 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.721459    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:42:13.721747 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.721730    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aab7f969-serving-cert\""
Jul 08 11:42:13.731467 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.731448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"]
Jul 08 11:42:13.804828 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.804804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-openshift-service-ca\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.804940 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.804858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhq46\" (UniqueName: \"kubernetes.io/projected/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-kube-api-access-nhq46\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.804982 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.804946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.905757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.905736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.905850 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.905806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-openshift-service-ca\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.905850 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.905834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhq46\" (UniqueName: \"kubernetes.io/projected/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-kube-api-access-nhq46\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.905992 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:42:13.905894    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-serving-cert: secret "maas-api-e2e-ait-aab7f969-serving-cert" not found
Jul 08 11:42:13.905992 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:42:13.905948    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls podName:dcf38f9b-e4a8-467a-bfda-71ab90a7d6da nodeName:}" failed. No retries permitted until 2026-07-08 11:42:14.405933367 +0000 UTC m=+1725.169286712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls") pod "maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" (UID: "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da") : secret "maas-api-e2e-ait-aab7f969-serving-cert" not found
Jul 08 11:42:13.906424 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.906403    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-openshift-service-ca\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:13.917093 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:13.917068    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhq46\" (UniqueName: \"kubernetes.io/projected/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-kube-api-access-nhq46\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:14.411189 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:14.411157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:14.413522 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:14.413505    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls\") pod \"maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:14.628847 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:14.628807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:14.757592 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:14.757566    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"]
Jul 08 11:42:14.759489 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:42:14.759466    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf38f9b_e4a8_467a_bfda_71ab90a7d6da.slice/crio-df3466d930e0a753188ff1101b2bb7be4fa6eeb14e716013b5d9817ee8ccc1f8 WatchSource:0}: Error finding container df3466d930e0a753188ff1101b2bb7be4fa6eeb14e716013b5d9817ee8ccc1f8: Status 404 returned error can't find the container with id df3466d930e0a753188ff1101b2bb7be4fa6eeb14e716013b5d9817ee8ccc1f8
Jul 08 11:42:14.760814 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:14.760797    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 11:42:15.462953 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:15.462903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" event={"ID":"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da","Type":"ContainerStarted","Data":"df3466d930e0a753188ff1101b2bb7be4fa6eeb14e716013b5d9817ee8ccc1f8"}
Jul 08 11:42:16.468398 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:16.468371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" event={"ID":"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da","Type":"ContainerStarted","Data":"692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b"}
Jul 08 11:42:16.468748 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:16.468458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:16.484180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:16.484135    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" podStartSLOduration=1.846421425 podStartE2EDuration="3.484116299s" totalImagesPullingTime="1.637694874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:42:16.483247094 +0000 UTC m=+1727.246600458" watchObservedRunningTime="2026-07-08 11:42:16.484116299 +0000 UTC m=+1727.247469661"
Jul 08 11:42:19.058527 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.058495    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"]
Jul 08 11:42:19.058989 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.058704    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" podUID="dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" containerName="maas-api" containerID="cri-o://692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b" gracePeriod=30
Jul 08 11:42:19.300766 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.300745    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:19.358640 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.358586    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhq46\" (UniqueName: \"kubernetes.io/projected/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-kube-api-access-nhq46\") pod \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") "
Jul 08 11:42:19.358760 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.358642    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-openshift-service-ca\") pod \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") "
Jul 08 11:42:19.358760 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.358665    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls\") pod \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\" (UID: \"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da\") "
Jul 08 11:42:19.358983 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.358960    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" (UID: "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:42:19.360666 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.360641    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-kube-api-access-nhq46" (OuterVolumeSpecName: "kube-api-access-nhq46") pod "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" (UID: "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da"). InnerVolumeSpecName "kube-api-access-nhq46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:42:19.360666 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.360651    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" (UID: "dcf38f9b-e4a8-467a-bfda-71ab90a7d6da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:42:19.459957 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.459935    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhq46\" (UniqueName: \"kubernetes.io/projected/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-kube-api-access-nhq46\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:42:19.459957 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.459955    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:42:19.460066 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.459965    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:42:19.483359 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.483330    2561 generic.go:356] "Generic (PLEG): container finished" podID="dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" containerID="692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b" exitCode=0
Jul 08 11:42:19.483448 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.483371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" event={"ID":"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da","Type":"ContainerDied","Data":"692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b"}
Jul 08 11:42:19.483448 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.483378    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"
Jul 08 11:42:19.483448 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.483421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds" event={"ID":"dcf38f9b-e4a8-467a-bfda-71ab90a7d6da","Type":"ContainerDied","Data":"df3466d930e0a753188ff1101b2bb7be4fa6eeb14e716013b5d9817ee8ccc1f8"}
Jul 08 11:42:19.483572 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.483452    2561 scope.go:117] "RemoveContainer" containerID="692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b"
Jul 08 11:42:19.492600 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.492585    2561 scope.go:117] "RemoveContainer" containerID="692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b"
Jul 08 11:42:19.492854 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:42:19.492834    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b\": container with ID starting with 692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b not found: ID does not exist" containerID="692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b"
Jul 08 11:42:19.492925 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.492885    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b"} err="failed to get container status \"692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b\": rpc error: code = NotFound desc = could not find container \"692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b\": container with ID starting with 692bd734fc7866eadac267eb429ba01638cae76852e4c83c1a9c3b47e300411b not found: ID does not exist"
Jul 08 11:42:19.504190 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.504172    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"]
Jul 08 11:42:19.507604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.507587    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aab7f969-6f8f545c7c-xxqds"]
Jul 08 11:42:19.834619 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:19.834593    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" path="/var/lib/kubelet/pods/dcf38f9b-e4a8-467a-bfda-71ab90a7d6da/volumes"
Jul 08 11:42:44.969743 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.969712    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"]
Jul 08 11:42:44.970287 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.970269    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" containerName="maas-api"
Jul 08 11:42:44.970365 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.970289    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" containerName="maas-api"
Jul 08 11:42:44.970424 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.970408    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf38f9b-e4a8-467a-bfda-71ab90a7d6da" containerName="maas-api"
Jul 08 11:42:44.975173 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.975155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:44.977634 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.977612    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-411285cd-serving-cert\""
Jul 08 11:42:44.977739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.977703    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:42:44.984307 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:44.984279    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"]
Jul 08 11:42:45.071589 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.071556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581a5550-ced6-489a-b578-a5e1810e2b65-maas-api-tls\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.071758 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.071597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581a5550-ced6-489a-b578-a5e1810e2b65-openshift-service-ca\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.071758 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.071641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7zz\" (UniqueName: \"kubernetes.io/projected/581a5550-ced6-489a-b578-a5e1810e2b65-kube-api-access-qb7zz\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.173008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.172974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581a5550-ced6-489a-b578-a5e1810e2b65-maas-api-tls\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.173163 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.173013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581a5550-ced6-489a-b578-a5e1810e2b65-openshift-service-ca\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.173163 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.173053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7zz\" (UniqueName: \"kubernetes.io/projected/581a5550-ced6-489a-b578-a5e1810e2b65-kube-api-access-qb7zz\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.173734 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.173709    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581a5550-ced6-489a-b578-a5e1810e2b65-openshift-service-ca\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.175503 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.175472    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581a5550-ced6-489a-b578-a5e1810e2b65-maas-api-tls\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.180653 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.180636    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7zz\" (UniqueName: \"kubernetes.io/projected/581a5550-ced6-489a-b578-a5e1810e2b65-kube-api-access-qb7zz\") pod \"maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.286802 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.286772    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:45.412663 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.412640    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"]
Jul 08 11:42:45.414548 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:42:45.414524    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581a5550_ced6_489a_b578_a5e1810e2b65.slice/crio-50c2d04b9349cae0d1d9b10967df17ab97368ef93cbe0aaeb578611c1728e05e WatchSource:0}: Error finding container 50c2d04b9349cae0d1d9b10967df17ab97368ef93cbe0aaeb578611c1728e05e: Status 404 returned error can't find the container with id 50c2d04b9349cae0d1d9b10967df17ab97368ef93cbe0aaeb578611c1728e05e
Jul 08 11:42:45.613318 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:45.613244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6" event={"ID":"581a5550-ced6-489a-b578-a5e1810e2b65","Type":"ContainerStarted","Data":"50c2d04b9349cae0d1d9b10967df17ab97368ef93cbe0aaeb578611c1728e05e"}
Jul 08 11:42:46.620118 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:46.620087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6" event={"ID":"581a5550-ced6-489a-b578-a5e1810e2b65","Type":"ContainerStarted","Data":"fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815"}
Jul 08 11:42:46.620512 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:46.620219    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:46.639048 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:46.638997    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6" podStartSLOduration=2.326716585 podStartE2EDuration="2.638976576s" totalImagesPullingTime="312.259991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:42:46.637083307 +0000 UTC m=+1757.400436669" watchObservedRunningTime="2026-07-08 11:42:46.638976576 +0000 UTC m=+1757.402329939"
Jul 08 11:42:49.936797 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:49.936756    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"]
Jul 08 11:42:49.937277 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:49.936934    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6" podUID="581a5550-ced6-489a-b578-a5e1810e2b65" containerName="maas-api" containerID="cri-o://fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815" gracePeriod=30
Jul 08 11:42:50.180154 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.180132    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:50.318937 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.318915    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb7zz\" (UniqueName: \"kubernetes.io/projected/581a5550-ced6-489a-b578-a5e1810e2b65-kube-api-access-qb7zz\") pod \"581a5550-ced6-489a-b578-a5e1810e2b65\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") "
Jul 08 11:42:50.319049 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.318964    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581a5550-ced6-489a-b578-a5e1810e2b65-openshift-service-ca\") pod \"581a5550-ced6-489a-b578-a5e1810e2b65\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") "
Jul 08 11:42:50.319100 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.319081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581a5550-ced6-489a-b578-a5e1810e2b65-maas-api-tls\") pod \"581a5550-ced6-489a-b578-a5e1810e2b65\" (UID: \"581a5550-ced6-489a-b578-a5e1810e2b65\") "
Jul 08 11:42:50.319259 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.319243    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581a5550-ced6-489a-b578-a5e1810e2b65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "581a5550-ced6-489a-b578-a5e1810e2b65" (UID: "581a5550-ced6-489a-b578-a5e1810e2b65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:42:50.319409 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.319393    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581a5550-ced6-489a-b578-a5e1810e2b65-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:42:50.321007 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.320988    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581a5550-ced6-489a-b578-a5e1810e2b65-kube-api-access-qb7zz" (OuterVolumeSpecName: "kube-api-access-qb7zz") pod "581a5550-ced6-489a-b578-a5e1810e2b65" (UID: "581a5550-ced6-489a-b578-a5e1810e2b65"). InnerVolumeSpecName "kube-api-access-qb7zz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:42:50.321091 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.321073    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581a5550-ced6-489a-b578-a5e1810e2b65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "581a5550-ced6-489a-b578-a5e1810e2b65" (UID: "581a5550-ced6-489a-b578-a5e1810e2b65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:42:50.420600 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.420571    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581a5550-ced6-489a-b578-a5e1810e2b65-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:42:50.420600 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.420600    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb7zz\" (UniqueName: \"kubernetes.io/projected/581a5550-ced6-489a-b578-a5e1810e2b65-kube-api-access-qb7zz\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:42:50.639070 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.638996    2561 generic.go:356] "Generic (PLEG): container finished" podID="581a5550-ced6-489a-b578-a5e1810e2b65" containerID="fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815" exitCode=0
Jul 08 11:42:50.639070 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.639050    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"
Jul 08 11:42:50.639231 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.639075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6" event={"ID":"581a5550-ced6-489a-b578-a5e1810e2b65","Type":"ContainerDied","Data":"fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815"}
Jul 08 11:42:50.639231 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.639133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6" event={"ID":"581a5550-ced6-489a-b578-a5e1810e2b65","Type":"ContainerDied","Data":"50c2d04b9349cae0d1d9b10967df17ab97368ef93cbe0aaeb578611c1728e05e"}
Jul 08 11:42:50.639231 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.639154    2561 scope.go:117] "RemoveContainer" containerID="fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815"
Jul 08 11:42:50.648426 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.648407    2561 scope.go:117] "RemoveContainer" containerID="fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815"
Jul 08 11:42:50.648705 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:42:50.648688    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815\": container with ID starting with fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815 not found: ID does not exist" containerID="fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815"
Jul 08 11:42:50.648748 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.648714    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815"} err="failed to get container status \"fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815\": rpc error: code = NotFound desc = could not find container \"fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815\": container with ID starting with fd55dd98ed317f55d071d742e870b31c7bc0d7b57703f1f7cbd39046a1c19815 not found: ID does not exist"
Jul 08 11:42:50.661603 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.661570    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"]
Jul 08 11:42:50.666526 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:50.666505    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-411285cd-7675c88bd9-lq2s6"]
Jul 08 11:42:51.834979 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:42:51.834944    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581a5550-ced6-489a-b578-a5e1810e2b65" path="/var/lib/kubelet/pods/581a5550-ced6-489a-b578-a5e1810e2b65/volumes"
Jul 08 11:43:29.853415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:43:29.853386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:43:29.855201 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:43:29.855177    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:43:29.856965 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:43:29.856947    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:43:29.858739 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:43:29.858722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:44:35.966526 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.966496    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"]
Jul 08 11:44:35.967039 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.966861    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581a5550-ced6-489a-b578-a5e1810e2b65" containerName="maas-api"
Jul 08 11:44:35.967039 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.966896    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="581a5550-ced6-489a-b578-a5e1810e2b65" containerName="maas-api"
Jul 08 11:44:35.967039 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.966970    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="581a5550-ced6-489a-b578-a5e1810e2b65" containerName="maas-api"
Jul 08 11:44:35.969832 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.969812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:35.973387 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.973362    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dc78c413-serving-cert\""
Jul 08 11:44:35.973495 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.973462    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:44:35.998734 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:35.998712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"]
Jul 08 11:44:36.101209 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.101186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6m5h\" (UniqueName: \"kubernetes.io/projected/c826c6d7-5a74-442c-9045-e19c87a3e73b-kube-api-access-g6m5h\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.101326 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.101219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c826c6d7-5a74-442c-9045-e19c87a3e73b-openshift-service-ca\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.101326 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.101276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.202301 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.202264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.202421 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.202327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6m5h\" (UniqueName: \"kubernetes.io/projected/c826c6d7-5a74-442c-9045-e19c87a3e73b-kube-api-access-g6m5h\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.202421 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.202349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c826c6d7-5a74-442c-9045-e19c87a3e73b-openshift-service-ca\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.202421 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:44:36.202406    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-serving-cert: secret "maas-api-e2e-mt-dc78c413-serving-cert" not found
Jul 08 11:44:36.202538 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:44:36.202470    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls podName:c826c6d7-5a74-442c-9045-e19c87a3e73b nodeName:}" failed. No retries permitted until 2026-07-08 11:44:36.702455668 +0000 UTC m=+1867.465809013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls") pod "maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" (UID: "c826c6d7-5a74-442c-9045-e19c87a3e73b") : secret "maas-api-e2e-mt-dc78c413-serving-cert" not found
Jul 08 11:44:36.202940 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.202924    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c826c6d7-5a74-442c-9045-e19c87a3e73b-openshift-service-ca\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.236453 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.236401    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6m5h\" (UniqueName: \"kubernetes.io/projected/c826c6d7-5a74-442c-9045-e19c87a3e73b-kube-api-access-g6m5h\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.705479 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.705449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.707932 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.707910    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls\") pod \"maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:36.880570 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:36.880538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:37.009427 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:37.009403    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"]
Jul 08 11:44:37.011221 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:44:37.011199    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc826c6d7_5a74_442c_9045_e19c87a3e73b.slice/crio-6ac744f301e7f767d49a753c8bf26a911a83702ca2b53fba9bf76f59a617cfc2 WatchSource:0}: Error finding container 6ac744f301e7f767d49a753c8bf26a911a83702ca2b53fba9bf76f59a617cfc2: Status 404 returned error can't find the container with id 6ac744f301e7f767d49a753c8bf26a911a83702ca2b53fba9bf76f59a617cfc2
Jul 08 11:44:37.128128 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:37.128103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" event={"ID":"c826c6d7-5a74-442c-9045-e19c87a3e73b","Type":"ContainerStarted","Data":"6ac744f301e7f767d49a753c8bf26a911a83702ca2b53fba9bf76f59a617cfc2"}
Jul 08 11:44:38.133766 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:38.133733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" event={"ID":"c826c6d7-5a74-442c-9045-e19c87a3e73b","Type":"ContainerStarted","Data":"634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a"}
Jul 08 11:44:38.134135 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:38.133834    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:44.143358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:44.143329    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:44.177561 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:44.177516    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" podStartSLOduration=8.6937581 podStartE2EDuration="9.177502035s" totalImagesPullingTime="483.743935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:44:38.152802189 +0000 UTC m=+1868.916155552" watchObservedRunningTime="2026-07-08 11:44:44.177502035 +0000 UTC m=+1874.940855397"
Jul 08 11:44:47.936812 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:47.936771    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"]
Jul 08 11:44:47.937256 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:47.937097    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" podUID="c826c6d7-5a74-442c-9045-e19c87a3e73b" containerName="maas-api" containerID="cri-o://634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a" gracePeriod=30
Jul 08 11:44:48.176776 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.176755    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:48.178365 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.178337    2561 generic.go:356] "Generic (PLEG): container finished" podID="c826c6d7-5a74-442c-9045-e19c87a3e73b" containerID="634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a" exitCode=0
Jul 08 11:44:48.178446 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.178374    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"
Jul 08 11:44:48.178446 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.178413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" event={"ID":"c826c6d7-5a74-442c-9045-e19c87a3e73b","Type":"ContainerDied","Data":"634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a"}
Jul 08 11:44:48.178549 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.178465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw" event={"ID":"c826c6d7-5a74-442c-9045-e19c87a3e73b","Type":"ContainerDied","Data":"6ac744f301e7f767d49a753c8bf26a911a83702ca2b53fba9bf76f59a617cfc2"}
Jul 08 11:44:48.178549 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.178491    2561 scope.go:117] "RemoveContainer" containerID="634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a"
Jul 08 11:44:48.186480 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.186468    2561 scope.go:117] "RemoveContainer" containerID="634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a"
Jul 08 11:44:48.186698 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:44:48.186680    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a\": container with ID starting with 634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a not found: ID does not exist" containerID="634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a"
Jul 08 11:44:48.186738 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.186707    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a"} err="failed to get container status \"634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a\": rpc error: code = NotFound desc = could not find container \"634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a\": container with ID starting with 634d47be44955d7a9a89f66a4e70d45267fe3ccbfeb813b177d95dcfa4c5875a not found: ID does not exist"
Jul 08 11:44:48.299513 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.299489    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls\") pod \"c826c6d7-5a74-442c-9045-e19c87a3e73b\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") "
Jul 08 11:44:48.299604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.299528    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6m5h\" (UniqueName: \"kubernetes.io/projected/c826c6d7-5a74-442c-9045-e19c87a3e73b-kube-api-access-g6m5h\") pod \"c826c6d7-5a74-442c-9045-e19c87a3e73b\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") "
Jul 08 11:44:48.299604 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.299554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c826c6d7-5a74-442c-9045-e19c87a3e73b-openshift-service-ca\") pod \"c826c6d7-5a74-442c-9045-e19c87a3e73b\" (UID: \"c826c6d7-5a74-442c-9045-e19c87a3e73b\") "
Jul 08 11:44:48.299960 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.299933    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c826c6d7-5a74-442c-9045-e19c87a3e73b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c826c6d7-5a74-442c-9045-e19c87a3e73b" (UID: "c826c6d7-5a74-442c-9045-e19c87a3e73b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:44:48.301594 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.301575    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c826c6d7-5a74-442c-9045-e19c87a3e73b" (UID: "c826c6d7-5a74-442c-9045-e19c87a3e73b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:44:48.301680 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.301630    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c826c6d7-5a74-442c-9045-e19c87a3e73b-kube-api-access-g6m5h" (OuterVolumeSpecName: "kube-api-access-g6m5h") pod "c826c6d7-5a74-442c-9045-e19c87a3e73b" (UID: "c826c6d7-5a74-442c-9045-e19c87a3e73b"). InnerVolumeSpecName "kube-api-access-g6m5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:44:48.400455 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.400430    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c826c6d7-5a74-442c-9045-e19c87a3e73b-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:44:48.400455 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.400450    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6m5h\" (UniqueName: \"kubernetes.io/projected/c826c6d7-5a74-442c-9045-e19c87a3e73b-kube-api-access-g6m5h\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:44:48.400563 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.400459    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c826c6d7-5a74-442c-9045-e19c87a3e73b-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:44:48.501415 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.501392    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"]
Jul 08 11:44:48.505642 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:48.505623    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc78c413-56bb9c5b5b-jsscw"]
Jul 08 11:44:49.835062 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:44:49.834991    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c826c6d7-5a74-442c-9045-e19c87a3e73b" path="/var/lib/kubelet/pods/c826c6d7-5a74-442c-9045-e19c87a3e73b/volumes"
Jul 08 11:45:00.129517 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.129486    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"]
Jul 08 11:45:00.129973 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.129877    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c826c6d7-5a74-442c-9045-e19c87a3e73b" containerName="maas-api"
Jul 08 11:45:00.129973 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.129892    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c826c6d7-5a74-442c-9045-e19c87a3e73b" containerName="maas-api"
Jul 08 11:45:00.129973 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.129965    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c826c6d7-5a74-442c-9045-e19c87a3e73b" containerName="maas-api"
Jul 08 11:45:00.134404 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.134389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:45:00.136696 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.136679    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:45:00.140317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.140294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"]
Jul 08 11:45:00.294542 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.294510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gjvx\" (UniqueName: \"kubernetes.io/projected/03ad058c-c0f4-41bc-a633-31ce4c6beb42-kube-api-access-2gjvx\") pod \"maas-api-key-cleanup-29725185-qdd68\" (UID: \"03ad058c-c0f4-41bc-a633-31ce4c6beb42\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:45:00.395439 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.395368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gjvx\" (UniqueName: \"kubernetes.io/projected/03ad058c-c0f4-41bc-a633-31ce4c6beb42-kube-api-access-2gjvx\") pod \"maas-api-key-cleanup-29725185-qdd68\" (UID: \"03ad058c-c0f4-41bc-a633-31ce4c6beb42\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:45:00.406355 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.406324    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gjvx\" (UniqueName: \"kubernetes.io/projected/03ad058c-c0f4-41bc-a633-31ce4c6beb42-kube-api-access-2gjvx\") pod \"maas-api-key-cleanup-29725185-qdd68\" (UID: \"03ad058c-c0f4-41bc-a633-31ce4c6beb42\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:45:00.445791 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.445770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:45:00.571941 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:00.571920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"]
Jul 08 11:45:00.573853 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:45:00.573823    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ad058c_c0f4_41bc_a633_31ce4c6beb42.slice/crio-e7b19a40e4ec3a8941f90d58d5673a8848d7614259c485c54a58a4806d547fd3 WatchSource:0}: Error finding container e7b19a40e4ec3a8941f90d58d5673a8848d7614259c485c54a58a4806d547fd3: Status 404 returned error can't find the container with id e7b19a40e4ec3a8941f90d58d5673a8848d7614259c485c54a58a4806d547fd3
Jul 08 11:45:01.237076 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:01.237041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68" event={"ID":"03ad058c-c0f4-41bc-a633-31ce4c6beb42","Type":"ContainerStarted","Data":"62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9"}
Jul 08 11:45:01.237421 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:01.237124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68" event={"ID":"03ad058c-c0f4-41bc-a633-31ce4c6beb42","Type":"ContainerStarted","Data":"e7b19a40e4ec3a8941f90d58d5673a8848d7614259c485c54a58a4806d547fd3"}
Jul 08 11:45:01.259802 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:01.259759    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68" podStartSLOduration=1.259746172 podStartE2EDuration="1.259746172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:45:01.257884496 +0000 UTC m=+1892.021237855" watchObservedRunningTime="2026-07-08 11:45:01.259746172 +0000 UTC m=+1892.023099535"
Jul 08 11:45:17.323731 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.323701    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"]
Jul 08 11:45:17.327294 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.327279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.330822 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.330805    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5cec6d9a-serving-cert\""
Jul 08 11:45:17.344988 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.344958    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"]
Jul 08 11:45:17.432745 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.432725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca9b8f6-db5a-48f5-abdc-49268a3beeca-openshift-service-ca\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.432847 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.432761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.432847 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.432780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rsf5\" (UniqueName: \"kubernetes.io/projected/fca9b8f6-db5a-48f5-abdc-49268a3beeca-kube-api-access-6rsf5\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.533089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.533066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.533185 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.533094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rsf5\" (UniqueName: \"kubernetes.io/projected/fca9b8f6-db5a-48f5-abdc-49268a3beeca-kube-api-access-6rsf5\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.533185 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.533157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca9b8f6-db5a-48f5-abdc-49268a3beeca-openshift-service-ca\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.533292 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:45:17.533241    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-serving-cert: secret "maas-api-e2e-mt-5cec6d9a-serving-cert" not found
Jul 08 11:45:17.533342 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:45:17.533314    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls podName:fca9b8f6-db5a-48f5-abdc-49268a3beeca nodeName:}" failed. No retries permitted until 2026-07-08 11:45:18.033291057 +0000 UTC m=+1908.796644410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls") pod "maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" (UID: "fca9b8f6-db5a-48f5-abdc-49268a3beeca") : secret "maas-api-e2e-mt-5cec6d9a-serving-cert" not found
Jul 08 11:45:17.533647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.533628    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca9b8f6-db5a-48f5-abdc-49268a3beeca-openshift-service-ca\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:17.563354 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:17.563332    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rsf5\" (UniqueName: \"kubernetes.io/projected/fca9b8f6-db5a-48f5-abdc-49268a3beeca-kube-api-access-6rsf5\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:18.038272 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:18.038242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:18.040411 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:18.040384    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls\") pod \"maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:18.237646 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:18.237620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:18.372098 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:18.371944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"]
Jul 08 11:45:18.374204 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:45:18.374166    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca9b8f6_db5a_48f5_abdc_49268a3beeca.slice/crio-d2024ffe186590a7c03f8e4f8df8b6f8ab753082e54ec47897dfb77a259532a7 WatchSource:0}: Error finding container d2024ffe186590a7c03f8e4f8df8b6f8ab753082e54ec47897dfb77a259532a7: Status 404 returned error can't find the container with id d2024ffe186590a7c03f8e4f8df8b6f8ab753082e54ec47897dfb77a259532a7
Jul 08 11:45:19.326304 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:19.326272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" event={"ID":"fca9b8f6-db5a-48f5-abdc-49268a3beeca","Type":"ContainerStarted","Data":"c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8"}
Jul 08 11:45:19.326511 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:19.326330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" event={"ID":"fca9b8f6-db5a-48f5-abdc-49268a3beeca","Type":"ContainerStarted","Data":"d2024ffe186590a7c03f8e4f8df8b6f8ab753082e54ec47897dfb77a259532a7"}
Jul 08 11:45:19.326511 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:19.326390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:45:19.347530 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:19.347484    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" podStartSLOduration=2.062786073 podStartE2EDuration="2.347469294s" totalImagesPullingTime="284.683221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:45:19.344829315 +0000 UTC m=+1910.108182679" watchObservedRunningTime="2026-07-08 11:45:19.347469294 +0000 UTC m=+1910.110822656"
Jul 08 11:45:25.335977 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:45:25.335951    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:46:00.010149 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:00.010119    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"]
Jul 08 11:46:00.010683 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:00.010347    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68" podUID="03ad058c-c0f4-41bc-a633-31ce4c6beb42" containerName="cleanup" containerID="cri-o://62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9" gracePeriod=30
Jul 08 11:46:20.265992 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.265915    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"]
Jul 08 11:46:20.266524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.266156    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" podUID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" containerName="maas-api" containerID="cri-o://c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8" gracePeriod=30
Jul 08 11:46:20.331605 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.331570    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" podUID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.40:8443/health\": dial tcp 10.134.0.40:8443: connect: connection refused"
Jul 08 11:46:20.501625 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.501605    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:46:20.549620 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.549567    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rsf5\" (UniqueName: \"kubernetes.io/projected/fca9b8f6-db5a-48f5-abdc-49268a3beeca-kube-api-access-6rsf5\") pod \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") "
Jul 08 11:46:20.549709 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.549621    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca9b8f6-db5a-48f5-abdc-49268a3beeca-openshift-service-ca\") pod \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") "
Jul 08 11:46:20.549709 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.549674    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls\") pod \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\" (UID: \"fca9b8f6-db5a-48f5-abdc-49268a3beeca\") "
Jul 08 11:46:20.549977 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.549956    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca9b8f6-db5a-48f5-abdc-49268a3beeca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fca9b8f6-db5a-48f5-abdc-49268a3beeca" (UID: "fca9b8f6-db5a-48f5-abdc-49268a3beeca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:46:20.551668 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.551649    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca9b8f6-db5a-48f5-abdc-49268a3beeca-kube-api-access-6rsf5" (OuterVolumeSpecName: "kube-api-access-6rsf5") pod "fca9b8f6-db5a-48f5-abdc-49268a3beeca" (UID: "fca9b8f6-db5a-48f5-abdc-49268a3beeca"). InnerVolumeSpecName "kube-api-access-6rsf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:46:20.551757 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.551743    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fca9b8f6-db5a-48f5-abdc-49268a3beeca" (UID: "fca9b8f6-db5a-48f5-abdc-49268a3beeca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:46:20.616579 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.616554    2561 generic.go:356] "Generic (PLEG): container finished" podID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" containerID="c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8" exitCode=0
Jul 08 11:46:20.616679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.616603    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"
Jul 08 11:46:20.616679 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.616634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" event={"ID":"fca9b8f6-db5a-48f5-abdc-49268a3beeca","Type":"ContainerDied","Data":"c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8"}
Jul 08 11:46:20.616751 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.616690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95" event={"ID":"fca9b8f6-db5a-48f5-abdc-49268a3beeca","Type":"ContainerDied","Data":"d2024ffe186590a7c03f8e4f8df8b6f8ab753082e54ec47897dfb77a259532a7"}
Jul 08 11:46:20.616751 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.616716    2561 scope.go:117] "RemoveContainer" containerID="c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8"
Jul 08 11:46:20.625263 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.625248    2561 scope.go:117] "RemoveContainer" containerID="c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8"
Jul 08 11:46:20.625510 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:46:20.625494    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8\": container with ID starting with c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8 not found: ID does not exist" containerID="c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8"
Jul 08 11:46:20.625552 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.625517    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8"} err="failed to get container status \"c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8\": rpc error: code = NotFound desc = could not find container \"c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8\": container with ID starting with c12974d1e8e18eda730a00a6587777901dfda10069b4e67a0c6a2ada701c6dd8 not found: ID does not exist"
Jul 08 11:46:20.641224 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.641205    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"]
Jul 08 11:46:20.648372 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.648352    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5cec6d9a-57485f9579-nzr95"]
Jul 08 11:46:20.650939 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.650922    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fca9b8f6-db5a-48f5-abdc-49268a3beeca-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:46:20.651003 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.650941    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rsf5\" (UniqueName: \"kubernetes.io/projected/fca9b8f6-db5a-48f5-abdc-49268a3beeca-kube-api-access-6rsf5\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:46:20.651003 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:20.650951    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fca9b8f6-db5a-48f5-abdc-49268a3beeca-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:46:21.840556 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:21.840525    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" path="/var/lib/kubelet/pods/fca9b8f6-db5a-48f5-abdc-49268a3beeca/volumes"
Jul 08 11:46:30.203704 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.203681    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:46:30.331166 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.331143    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gjvx\" (UniqueName: \"kubernetes.io/projected/03ad058c-c0f4-41bc-a633-31ce4c6beb42-kube-api-access-2gjvx\") pod \"03ad058c-c0f4-41bc-a633-31ce4c6beb42\" (UID: \"03ad058c-c0f4-41bc-a633-31ce4c6beb42\") "
Jul 08 11:46:30.333207 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.333180    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ad058c-c0f4-41bc-a633-31ce4c6beb42-kube-api-access-2gjvx" (OuterVolumeSpecName: "kube-api-access-2gjvx") pod "03ad058c-c0f4-41bc-a633-31ce4c6beb42" (UID: "03ad058c-c0f4-41bc-a633-31ce4c6beb42"). InnerVolumeSpecName "kube-api-access-2gjvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:46:30.432380 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.432359    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gjvx\" (UniqueName: \"kubernetes.io/projected/03ad058c-c0f4-41bc-a633-31ce4c6beb42-kube-api-access-2gjvx\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:46:30.664537 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.664503    2561 generic.go:356] "Generic (PLEG): container finished" podID="03ad058c-c0f4-41bc-a633-31ce4c6beb42" containerID="62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9" exitCode=137
Jul 08 11:46:30.664648 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.664547    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"
Jul 08 11:46:30.664648 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.664591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68" event={"ID":"03ad058c-c0f4-41bc-a633-31ce4c6beb42","Type":"ContainerDied","Data":"62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9"}
Jul 08 11:46:30.664648 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.664644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68" event={"ID":"03ad058c-c0f4-41bc-a633-31ce4c6beb42","Type":"ContainerDied","Data":"e7b19a40e4ec3a8941f90d58d5673a8848d7614259c485c54a58a4806d547fd3"}
Jul 08 11:46:30.664773 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.664673    2561 scope.go:117] "RemoveContainer" containerID="62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9"
Jul 08 11:46:30.673343 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.673329    2561 scope.go:117] "RemoveContainer" containerID="62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9"
Jul 08 11:46:30.673579 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:46:30.673562    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9\": container with ID starting with 62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9 not found: ID does not exist" containerID="62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9"
Jul 08 11:46:30.673622 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.673585    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9"} err="failed to get container status \"62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9\": rpc error: code = NotFound desc = could not find container \"62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9\": container with ID starting with 62a1b68516b25f0f4d6661978bb5888638d432e2b9bc98664915754ad75037c9 not found: ID does not exist"
Jul 08 11:46:30.686159 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.686140    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"]
Jul 08 11:46:30.691787 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:30.691767    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725185-qdd68"]
Jul 08 11:46:31.833653 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:46:31.833621    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ad058c-c0f4-41bc-a633-31ce4c6beb42" path="/var/lib/kubelet/pods/03ad058c-c0f4-41bc-a633-31ce4c6beb42/volumes"
Jul 08 11:48:12.118178 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118141    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"]
Jul 08 11:48:12.118721 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118702    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" containerName="maas-api"
Jul 08 11:48:12.118767 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118726    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" containerName="maas-api"
Jul 08 11:48:12.118801 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118778    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ad058c-c0f4-41bc-a633-31ce4c6beb42" containerName="cleanup"
Jul 08 11:48:12.118801 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ad058c-c0f4-41bc-a633-31ce4c6beb42" containerName="cleanup"
Jul 08 11:48:12.118920 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118908    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ad058c-c0f4-41bc-a633-31ce4c6beb42" containerName="cleanup"
Jul 08 11:48:12.118979 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.118924    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca9b8f6-db5a-48f5-abdc-49268a3beeca" containerName="maas-api"
Jul 08 11:48:12.122573 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.122554    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.126354 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.126334    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3ac51b-serving-cert\""
Jul 08 11:48:12.126721 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.126702    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:48:12.135557 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.135532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"]
Jul 08 11:48:12.225531 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.225483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c047e-7061-4842-862c-d05350f90a8e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.225531 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.225534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swfg5\" (UniqueName: \"kubernetes.io/projected/1a0c047e-7061-4842-862c-d05350f90a8e-kube-api-access-swfg5\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.225771 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.225642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a0c047e-7061-4842-862c-d05350f90a8e-maas-api-tls\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.326310 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.326277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swfg5\" (UniqueName: \"kubernetes.io/projected/1a0c047e-7061-4842-862c-d05350f90a8e-kube-api-access-swfg5\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.326750 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.326347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a0c047e-7061-4842-862c-d05350f90a8e-maas-api-tls\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.326750 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.326414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c047e-7061-4842-862c-d05350f90a8e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.327275 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.327023    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c047e-7061-4842-862c-d05350f90a8e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.329025 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.329003    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a0c047e-7061-4842-862c-d05350f90a8e-maas-api-tls\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.341140 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.341115    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swfg5\" (UniqueName: \"kubernetes.io/projected/1a0c047e-7061-4842-862c-d05350f90a8e-kube-api-access-swfg5\") pod \"maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.433621 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.433520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:12.570375 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.570355    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"]
Jul 08 11:48:12.572213 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:48:12.572189    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0c047e_7061_4842_862c_d05350f90a8e.slice/crio-a06452491e3db70a6012d98d2c524b1af9f7804491e6792c4625e35318d14ffb WatchSource:0}: Error finding container a06452491e3db70a6012d98d2c524b1af9f7804491e6792c4625e35318d14ffb: Status 404 returned error can't find the container with id a06452491e3db70a6012d98d2c524b1af9f7804491e6792c4625e35318d14ffb
Jul 08 11:48:12.573602 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:12.573584    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 11:48:13.119361 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:13.119332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn" event={"ID":"1a0c047e-7061-4842-862c-d05350f90a8e","Type":"ContainerStarted","Data":"a06452491e3db70a6012d98d2c524b1af9f7804491e6792c4625e35318d14ffb"}
Jul 08 11:48:14.125459 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:14.125423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn" event={"ID":"1a0c047e-7061-4842-862c-d05350f90a8e","Type":"ContainerStarted","Data":"a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68"}
Jul 08 11:48:14.125837 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:14.125603    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:14.145214 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:14.145154    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn" podStartSLOduration=1.574721676 podStartE2EDuration="2.145140091s" totalImagesPullingTime="570.418415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:48:14.143654481 +0000 UTC m=+2084.907007846" watchObservedRunningTime="2026-07-08 11:48:14.145140091 +0000 UTC m=+2084.908493452"
Jul 08 11:48:20.134999 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.134976    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:48:20.233825 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.233792    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"]
Jul 08 11:48:20.237255 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.237240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.259223 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.259195    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ae9da2-serving-cert\""
Jul 08 11:48:20.291150 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.291126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rql\" (UniqueName: \"kubernetes.io/projected/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-kube-api-access-w6rql\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.291263 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.291168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.291263 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.291241    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.298661 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.298640    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"]
Jul 08 11:48:20.392501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.392447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rql\" (UniqueName: \"kubernetes.io/projected/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-kube-api-access-w6rql\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.392501 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.392496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.392645 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.392539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.392645 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:48:20.392629    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-serving-cert: secret "maas-api-e2e-inf-b-ae9da2-serving-cert" not found
Jul 08 11:48:20.392748 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:48:20.392677    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls podName:5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09 nodeName:}" failed. No retries permitted until 2026-07-08 11:48:20.892662514 +0000 UTC m=+2091.656015856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls") pod "maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" (UID: "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09") : secret "maas-api-e2e-inf-b-ae9da2-serving-cert" not found
Jul 08 11:48:20.393078 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.393061    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.414990 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.414967    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rql\" (UniqueName: \"kubernetes.io/projected/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-kube-api-access-w6rql\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.901180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:20.901138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:20.901377 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:48:20.901299    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-serving-cert: secret "maas-api-e2e-inf-b-ae9da2-serving-cert" not found
Jul 08 11:48:20.901377 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:48:20.901368    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls podName:5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09 nodeName:}" failed. No retries permitted until 2026-07-08 11:48:21.901352753 +0000 UTC m=+2092.664706095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls") pod "maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" (UID: "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09") : secret "maas-api-e2e-inf-b-ae9da2-serving-cert" not found
Jul 08 11:48:21.909172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:21.909139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:21.911647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:21.911624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:22.049132 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:22.049104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:22.179442 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:22.179419    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"]
Jul 08 11:48:22.181452 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:48:22.181426    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0b3804_2a05_4b6d_8ee9_9f483e0f5d09.slice/crio-e0ce70910ce407ebcc13a7ae833485d222530f675d7971aeae20daa078012c94 WatchSource:0}: Error finding container e0ce70910ce407ebcc13a7ae833485d222530f675d7971aeae20daa078012c94: Status 404 returned error can't find the container with id e0ce70910ce407ebcc13a7ae833485d222530f675d7971aeae20daa078012c94
Jul 08 11:48:23.167818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:23.167787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" event={"ID":"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09","Type":"ContainerStarted","Data":"e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127"}
Jul 08 11:48:23.168186 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:23.167835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" event={"ID":"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09","Type":"ContainerStarted","Data":"e0ce70910ce407ebcc13a7ae833485d222530f675d7971aeae20daa078012c94"}
Jul 08 11:48:23.168186 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:23.167906    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:23.184488 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:23.184436    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" podStartSLOduration=2.79405517 podStartE2EDuration="3.184418457s" totalImagesPullingTime="390.363287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:48:23.183972123 +0000 UTC m=+2093.947325519" watchObservedRunningTime="2026-07-08 11:48:23.184418457 +0000 UTC m=+2093.947771821"
Jul 08 11:48:27.004174 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.004145    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"]
Jul 08 11:48:27.007684 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.007665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.011310 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.011283    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3ac51b\"/\"test-model-3ac51b-kserve-self-signed-certs\""
Jul 08 11:48:27.011310 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.011305    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3ac51b\"/\"kube-root-ca.crt\""
Jul 08 11:48:27.011471 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.011349    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3ac51b\"/\"default-dockercfg-6hp2r\""
Jul 08 11:48:27.011471 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.011307    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3ac51b\"/\"openshift-service-ca.crt\""
Jul 08 11:48:27.018203 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.018182    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"]
Jul 08 11:48:27.054988 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.054967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tmp-dir\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.055180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.055149    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tls-certs\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.055180 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.055181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b742t\" (UniqueName: \"kubernetes.io/projected/38d4a46e-b5c2-44b1-9c70-1116729a7d48-kube-api-access-b742t\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.055360 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.055206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-model-cache\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.055360 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.055223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-dshm\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.055360 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.055332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-home\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.156771 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.156742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tmp-dir\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.156952 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.156778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tls-certs\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.156952 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.156804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b742t\" (UniqueName: \"kubernetes.io/projected/38d4a46e-b5c2-44b1-9c70-1116729a7d48-kube-api-access-b742t\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.156952 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.156835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-model-cache\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.156952 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.156855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-dshm\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.156952 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.156913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-home\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.157199 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.157178    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tmp-dir\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.157238 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.157196    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-model-cache\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.157323 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.157305    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-home\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.159088 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.159063    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-dshm\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.159372 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.159354    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tls-certs\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.164815 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.164793    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b742t\" (UniqueName: \"kubernetes.io/projected/38d4a46e-b5c2-44b1-9c70-1116729a7d48-kube-api-access-b742t\") pod \"test-model-3ac51b-kserve-7599c5dbc5-9c2xc\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") " pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.317357 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.317333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:27.444055 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:27.443991    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"]
Jul 08 11:48:27.446263 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:48:27.446238    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38d4a46e_b5c2_44b1_9c70_1116729a7d48.slice/crio-8e1cbc86c6017600cd50137c779082ec45407acb0b9bceb6a6d99c2a29007749 WatchSource:0}: Error finding container 8e1cbc86c6017600cd50137c779082ec45407acb0b9bceb6a6d99c2a29007749: Status 404 returned error can't find the container with id 8e1cbc86c6017600cd50137c779082ec45407acb0b9bceb6a6d99c2a29007749
Jul 08 11:48:28.191477 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:28.191445    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc" event={"ID":"38d4a46e-b5c2-44b1-9c70-1116729a7d48","Type":"ContainerStarted","Data":"e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a"}
Jul 08 11:48:28.191918 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:28.191485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc" event={"ID":"38d4a46e-b5c2-44b1-9c70-1116729a7d48","Type":"ContainerStarted","Data":"8e1cbc86c6017600cd50137c779082ec45407acb0b9bceb6a6d99c2a29007749"}
Jul 08 11:48:28.208677 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:28.208635    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc" podStartSLOduration=2.208620895 podStartE2EDuration="2.208620895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:48:28.207248726 +0000 UTC m=+2098.970602091" watchObservedRunningTime="2026-07-08 11:48:28.208620895 +0000 UTC m=+2098.971974258"
Jul 08 11:48:29.177794 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:29.177767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:48:29.891048 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:29.891022    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:48:29.894008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:29.893983    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:48:29.895002 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:29.894983    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:48:29.897666 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:29.897650    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:48:37.318344 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:37.318311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:37.318714 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:37.318355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:37.330138 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:37.330115    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:48:38.250477 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:48:38.250450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:49:12.872795 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:12.872758    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"]
Jul 08 11:49:14.650691 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.650652    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"]
Jul 08 11:49:14.651083 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.650849    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn" podUID="1a0c047e-7061-4842-862c-d05350f90a8e" containerName="maas-api" containerID="cri-o://a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68" gracePeriod=30
Jul 08 11:49:14.892279 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.892258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:49:14.946371 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.946298    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c047e-7061-4842-862c-d05350f90a8e-openshift-service-ca\") pod \"1a0c047e-7061-4842-862c-d05350f90a8e\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") "
Jul 08 11:49:14.946371 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.946351    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swfg5\" (UniqueName: \"kubernetes.io/projected/1a0c047e-7061-4842-862c-d05350f90a8e-kube-api-access-swfg5\") pod \"1a0c047e-7061-4842-862c-d05350f90a8e\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") "
Jul 08 11:49:14.946538 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.946377    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a0c047e-7061-4842-862c-d05350f90a8e-maas-api-tls\") pod \"1a0c047e-7061-4842-862c-d05350f90a8e\" (UID: \"1a0c047e-7061-4842-862c-d05350f90a8e\") "
Jul 08 11:49:14.946701 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.946670    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0c047e-7061-4842-862c-d05350f90a8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a0c047e-7061-4842-862c-d05350f90a8e" (UID: "1a0c047e-7061-4842-862c-d05350f90a8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:49:14.948479 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.948452    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a0c047e-7061-4842-862c-d05350f90a8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a0c047e-7061-4842-862c-d05350f90a8e" (UID: "1a0c047e-7061-4842-862c-d05350f90a8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:49:14.948556 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:14.948541    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0c047e-7061-4842-862c-d05350f90a8e-kube-api-access-swfg5" (OuterVolumeSpecName: "kube-api-access-swfg5") pod "1a0c047e-7061-4842-862c-d05350f90a8e" (UID: "1a0c047e-7061-4842-862c-d05350f90a8e"). InnerVolumeSpecName "kube-api-access-swfg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:49:15.047336 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.047306    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a0c047e-7061-4842-862c-d05350f90a8e-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:15.047336 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.047335    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a0c047e-7061-4842-862c-d05350f90a8e-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:15.047493 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.047348    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swfg5\" (UniqueName: \"kubernetes.io/projected/1a0c047e-7061-4842-862c-d05350f90a8e-kube-api-access-swfg5\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:15.410283 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.410252    2561 generic.go:356] "Generic (PLEG): container finished" podID="1a0c047e-7061-4842-862c-d05350f90a8e" containerID="a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68" exitCode=0
Jul 08 11:49:15.410417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.410301    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"
Jul 08 11:49:15.410417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.410334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn" event={"ID":"1a0c047e-7061-4842-862c-d05350f90a8e","Type":"ContainerDied","Data":"a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68"}
Jul 08 11:49:15.410417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.410404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn" event={"ID":"1a0c047e-7061-4842-862c-d05350f90a8e","Type":"ContainerDied","Data":"a06452491e3db70a6012d98d2c524b1af9f7804491e6792c4625e35318d14ffb"}
Jul 08 11:49:15.410557 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.410426    2561 scope.go:117] "RemoveContainer" containerID="a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68"
Jul 08 11:49:15.419854 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.419839    2561 scope.go:117] "RemoveContainer" containerID="a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68"
Jul 08 11:49:15.420133 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:49:15.420106    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68\": container with ID starting with a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68 not found: ID does not exist" containerID="a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68"
Jul 08 11:49:15.420185 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.420142    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68"} err="failed to get container status \"a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68\": rpc error: code = NotFound desc = could not find container \"a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68\": container with ID starting with a4760786fe8aab2acad087701a49f1ef4a7b2880a2918f3accdf2d2ce3c4ba68 not found: ID does not exist"
Jul 08 11:49:15.431411 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.431386    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"]
Jul 08 11:49:15.436811 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.436789    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3ac51b-64766d7b68-x4zbn"]
Jul 08 11:49:15.834398 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:15.834373    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a0c047e-7061-4842-862c-d05350f90a8e" path="/var/lib/kubelet/pods/1a0c047e-7061-4842-862c-d05350f90a8e/volumes"
Jul 08 11:49:27.893314 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:27.893277    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc" podUID="38d4a46e-b5c2-44b1-9c70-1116729a7d48" containerName="main" containerID="cri-o://e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a" gracePeriod=45
Jul 08 11:49:28.136307 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.136286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:49:28.254624 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254553    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-model-cache\") pod \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") "
Jul 08 11:49:28.254624 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tls-certs\") pod \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") "
Jul 08 11:49:28.254624 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-home\") pod \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") "
Jul 08 11:49:28.254891 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254630    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tmp-dir\") pod \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") "
Jul 08 11:49:28.254891 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b742t\" (UniqueName: \"kubernetes.io/projected/38d4a46e-b5c2-44b1-9c70-1116729a7d48-kube-api-access-b742t\") pod \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") "
Jul 08 11:49:28.254891 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254721    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-dshm\") pod \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\" (UID: \"38d4a46e-b5c2-44b1-9c70-1116729a7d48\") "
Jul 08 11:49:28.254891 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254818    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-home" (OuterVolumeSpecName: "home") pod "38d4a46e-b5c2-44b1-9c70-1116729a7d48" (UID: "38d4a46e-b5c2-44b1-9c70-1116729a7d48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 11:49:28.254891 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254857    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-model-cache" (OuterVolumeSpecName: "model-cache") pod "38d4a46e-b5c2-44b1-9c70-1116729a7d48" (UID: "38d4a46e-b5c2-44b1-9c70-1116729a7d48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 11:49:28.255135 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.254928    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38d4a46e-b5c2-44b1-9c70-1116729a7d48" (UID: "38d4a46e-b5c2-44b1-9c70-1116729a7d48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 11:49:28.255135 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.255044    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tmp-dir\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:28.255135 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.255058    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-model-cache\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:28.255135 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.255066    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-home\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:28.256965 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.256942    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38d4a46e-b5c2-44b1-9c70-1116729a7d48" (UID: "38d4a46e-b5c2-44b1-9c70-1116729a7d48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:49:28.257062 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.256940    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-dshm" (OuterVolumeSpecName: "dshm") pod "38d4a46e-b5c2-44b1-9c70-1116729a7d48" (UID: "38d4a46e-b5c2-44b1-9c70-1116729a7d48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 11:49:28.257062 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.257046    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d4a46e-b5c2-44b1-9c70-1116729a7d48-kube-api-access-b742t" (OuterVolumeSpecName: "kube-api-access-b742t") pod "38d4a46e-b5c2-44b1-9c70-1116729a7d48" (UID: "38d4a46e-b5c2-44b1-9c70-1116729a7d48"). InnerVolumeSpecName "kube-api-access-b742t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:49:28.355656 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.355627    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38d4a46e-b5c2-44b1-9c70-1116729a7d48-tls-certs\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:28.355656 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.355649    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b742t\" (UniqueName: \"kubernetes.io/projected/38d4a46e-b5c2-44b1-9c70-1116729a7d48-kube-api-access-b742t\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:28.355656 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.355658    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38d4a46e-b5c2-44b1-9c70-1116729a7d48-dshm\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:28.474269 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.474246    2561 generic.go:356] "Generic (PLEG): container finished" podID="38d4a46e-b5c2-44b1-9c70-1116729a7d48" containerID="e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a" exitCode=0
Jul 08 11:49:28.474377 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.474283    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc" event={"ID":"38d4a46e-b5c2-44b1-9c70-1116729a7d48","Type":"ContainerDied","Data":"e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a"}
Jul 08 11:49:28.474377 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.474295    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"
Jul 08 11:49:28.474377 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.474309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc" event={"ID":"38d4a46e-b5c2-44b1-9c70-1116729a7d48","Type":"ContainerDied","Data":"8e1cbc86c6017600cd50137c779082ec45407acb0b9bceb6a6d99c2a29007749"}
Jul 08 11:49:28.474377 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.474326    2561 scope.go:117] "RemoveContainer" containerID="e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a"
Jul 08 11:49:28.483046 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.483030    2561 scope.go:117] "RemoveContainer" containerID="e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a"
Jul 08 11:49:28.483313 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:49:28.483294    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a\": container with ID starting with e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a not found: ID does not exist" containerID="e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a"
Jul 08 11:49:28.483356 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.483321    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a"} err="failed to get container status \"e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a\": rpc error: code = NotFound desc = could not find container \"e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a\": container with ID starting with e9b7fd571da3f4424e0d9621690391ea7dd78f3761d4b642738ea5ceddd3570a not found: ID does not exist"
Jul 08 11:49:28.495937 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.495912    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"]
Jul 08 11:49:28.499429 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:28.499410    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3ac51b/test-model-3ac51b-kserve-7599c5dbc5-9c2xc"]
Jul 08 11:49:29.835765 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:29.835736    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d4a46e-b5c2-44b1-9c70-1116729a7d48" path="/var/lib/kubelet/pods/38d4a46e-b5c2-44b1-9c70-1116729a7d48/volumes"
Jul 08 11:49:47.273823 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.273791    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"]
Jul 08 11:49:47.274297 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.274038    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" podUID="5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" containerName="maas-api" containerID="cri-o://e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127" gracePeriod=30
Jul 08 11:49:47.524327 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.524273    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:49:47.567844 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.567815    2561 generic.go:356] "Generic (PLEG): container finished" podID="5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" containerID="e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127" exitCode=0
Jul 08 11:49:47.568004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.567859    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"
Jul 08 11:49:47.568004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.567902    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" event={"ID":"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09","Type":"ContainerDied","Data":"e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127"}
Jul 08 11:49:47.568004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.567957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8" event={"ID":"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09","Type":"ContainerDied","Data":"e0ce70910ce407ebcc13a7ae833485d222530f675d7971aeae20daa078012c94"}
Jul 08 11:49:47.568004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.567983    2561 scope.go:117] "RemoveContainer" containerID="e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127"
Jul 08 11:49:47.576455 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.576435    2561 scope.go:117] "RemoveContainer" containerID="e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127"
Jul 08 11:49:47.576726 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:49:47.576706    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127\": container with ID starting with e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127 not found: ID does not exist" containerID="e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127"
Jul 08 11:49:47.576802 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.576741    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127"} err="failed to get container status \"e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127\": rpc error: code = NotFound desc = could not find container \"e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127\": container with ID starting with e40bd600efd0ae0dc57dc2c4e62be03c80a92bc36e1cff26a8c33d0752022127 not found: ID does not exist"
Jul 08 11:49:47.618832 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.618807    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6rql\" (UniqueName: \"kubernetes.io/projected/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-kube-api-access-w6rql\") pod \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") "
Jul 08 11:49:47.619010 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.618926    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-openshift-service-ca\") pod \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") "
Jul 08 11:49:47.619010 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.618949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") pod \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\" (UID: \"5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09\") "
Jul 08 11:49:47.619325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.619300    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" (UID: "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:49:47.621007 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.620983    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-kube-api-access-w6rql" (OuterVolumeSpecName: "kube-api-access-w6rql") pod "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" (UID: "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09"). InnerVolumeSpecName "kube-api-access-w6rql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:49:47.621108 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.621078    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" (UID: "5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:49:47.720319 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.720292    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6rql\" (UniqueName: \"kubernetes.io/projected/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-kube-api-access-w6rql\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:47.720319 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.720314    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:47.720319 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.720324    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:49:47.881943 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.881917    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"]
Jul 08 11:49:47.885465 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:47.885444    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae9da2-5744f7944d-lnxz8"]
Jul 08 11:49:49.833837 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:49.833796    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" path="/var/lib/kubelet/pods/5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09/volumes"
Jul 08 11:49:56.708137 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708106    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"]
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708476    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" containerName="maas-api"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708487    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" containerName="maas-api"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708494    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d4a46e-b5c2-44b1-9c70-1116729a7d48" containerName="main"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708499    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d4a46e-b5c2-44b1-9c70-1116729a7d48" containerName="main"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708519    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0c047e-7061-4842-862c-d05350f90a8e" containerName="maas-api"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708525    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0c047e-7061-4842-862c-d05350f90a8e" containerName="maas-api"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708595    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0b3804-2a05-4b6d-8ee9-9f483e0f5d09" containerName="maas-api"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708603    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d4a46e-b5c2-44b1-9c70-1116729a7d48" containerName="main"
Jul 08 11:49:56.708647 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.708610    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0c047e-7061-4842-862c-d05350f90a8e" containerName="maas-api"
Jul 08 11:49:56.711668 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.711649    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.715325 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.715298    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-4076ef-serving-cert\""
Jul 08 11:49:56.715432 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.715406    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:49:56.721522 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.721502    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"]
Jul 08 11:49:56.897168 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.897132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ed5194d-5b29-4518-851e-a61630368c0c-openshift-service-ca\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.897295 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.897258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqs97\" (UniqueName: \"kubernetes.io/projected/4ed5194d-5b29-4518-851e-a61630368c0c-kube-api-access-sqs97\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.897295 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.897289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.997630 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.997576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ed5194d-5b29-4518-851e-a61630368c0c-openshift-service-ca\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.997719 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.997641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqs97\" (UniqueName: \"kubernetes.io/projected/4ed5194d-5b29-4518-851e-a61630368c0c-kube-api-access-sqs97\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.997719 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.997659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:56.997829 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:49:56.997754    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-serving-cert: secret "maas-api-e2e-api-a-4076ef-serving-cert" not found
Jul 08 11:49:56.997829 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:49:56.997811    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls podName:4ed5194d-5b29-4518-851e-a61630368c0c nodeName:}" failed. No retries permitted until 2026-07-08 11:49:57.497796498 +0000 UTC m=+2188.261149839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls") pod "maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" (UID: "4ed5194d-5b29-4518-851e-a61630368c0c") : secret "maas-api-e2e-api-a-4076ef-serving-cert" not found
Jul 08 11:49:56.998187 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:56.998171    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ed5194d-5b29-4518-851e-a61630368c0c-openshift-service-ca\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:57.006611 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:57.006589    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqs97\" (UniqueName: \"kubernetes.io/projected/4ed5194d-5b29-4518-851e-a61630368c0c-kube-api-access-sqs97\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:57.502040 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:57.502015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:57.504375 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:57.504353    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls\") pod \"maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:57.623712 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:57.623684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:57.752151 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:57.752092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"]
Jul 08 11:49:57.754459 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:49:57.754435    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed5194d_5b29_4518_851e_a61630368c0c.slice/crio-a58360da974e7f8038404dd2ebd57ba23b302ce4f9b1650387ff09c94b6dfcdc WatchSource:0}: Error finding container a58360da974e7f8038404dd2ebd57ba23b302ce4f9b1650387ff09c94b6dfcdc: Status 404 returned error can't find the container with id a58360da974e7f8038404dd2ebd57ba23b302ce4f9b1650387ff09c94b6dfcdc
Jul 08 11:49:58.617390 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:58.617361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" event={"ID":"4ed5194d-5b29-4518-851e-a61630368c0c","Type":"ContainerStarted","Data":"4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7"}
Jul 08 11:49:58.617543 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:58.617411    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:49:58.617543 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:58.617427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" event={"ID":"4ed5194d-5b29-4518-851e-a61630368c0c","Type":"ContainerStarted","Data":"a58360da974e7f8038404dd2ebd57ba23b302ce4f9b1650387ff09c94b6dfcdc"}
Jul 08 11:49:58.635160 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:49:58.635115    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" podStartSLOduration=1.971352569 podStartE2EDuration="2.635101238s" totalImagesPullingTime="663.748669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:49:58.633539672 +0000 UTC m=+2189.396893047" watchObservedRunningTime="2026-07-08 11:49:58.635101238 +0000 UTC m=+2189.398454600"
Jul 08 11:50:04.627686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:04.627658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:50:05.000288 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.000209    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"]
Jul 08 11:50:05.002801 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.002780    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.005498 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.005474    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cf8404-serving-cert\""
Jul 08 11:50:05.020582 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.020560    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"]
Jul 08 11:50:05.070749 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.070724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fed28223-e7d7-463d-8ee4-ccf029360414-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.070904 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.070774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fed28223-e7d7-463d-8ee4-ccf029360414-openshift-service-ca\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.070956 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.070920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxk97\" (UniqueName: \"kubernetes.io/projected/fed28223-e7d7-463d-8ee4-ccf029360414-kube-api-access-xxk97\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.171746 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.171720    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxk97\" (UniqueName: \"kubernetes.io/projected/fed28223-e7d7-463d-8ee4-ccf029360414-kube-api-access-xxk97\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.171854 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.171765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fed28223-e7d7-463d-8ee4-ccf029360414-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.171854 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.171791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fed28223-e7d7-463d-8ee4-ccf029360414-openshift-service-ca\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.172397 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.172373    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fed28223-e7d7-463d-8ee4-ccf029360414-openshift-service-ca\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.174319 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.174299    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fed28223-e7d7-463d-8ee4-ccf029360414-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.180357 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.180335    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxk97\" (UniqueName: \"kubernetes.io/projected/fed28223-e7d7-463d-8ee4-ccf029360414-kube-api-access-xxk97\") pod \"maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.314196 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.314173    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:05.446807 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.446751    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"]
Jul 08 11:50:05.448701 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:50:05.448676    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed28223_e7d7_463d_8ee4_ccf029360414.slice/crio-1d7ee40e9c9c6a5278563aa1887cc7c433f6f990203af6e1b10f239d47c836ce WatchSource:0}: Error finding container 1d7ee40e9c9c6a5278563aa1887cc7c433f6f990203af6e1b10f239d47c836ce: Status 404 returned error can't find the container with id 1d7ee40e9c9c6a5278563aa1887cc7c433f6f990203af6e1b10f239d47c836ce
Jul 08 11:50:05.653046 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:05.652982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt" event={"ID":"fed28223-e7d7-463d-8ee4-ccf029360414","Type":"ContainerStarted","Data":"1d7ee40e9c9c6a5278563aa1887cc7c433f6f990203af6e1b10f239d47c836ce"}
Jul 08 11:50:06.659495 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:06.659460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt" event={"ID":"fed28223-e7d7-463d-8ee4-ccf029360414","Type":"ContainerStarted","Data":"4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60"}
Jul 08 11:50:06.659896 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:06.659522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:06.676667 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:06.676615    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt" podStartSLOduration=2.391657715 podStartE2EDuration="2.676595619s" totalImagesPullingTime="284.937904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:50:06.674992702 +0000 UTC m=+2197.438346075" watchObservedRunningTime="2026-07-08 11:50:06.676595619 +0000 UTC m=+2197.439948983"
Jul 08 11:50:12.670965 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:12.670933    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:18.227087 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.227049    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"]
Jul 08 11:50:18.227528 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.227294    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" podUID="4ed5194d-5b29-4518-851e-a61630368c0c" containerName="maas-api" containerID="cri-o://4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7" gracePeriod=30
Jul 08 11:50:18.467091 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.467064    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:50:18.586637 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.586609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls\") pod \"4ed5194d-5b29-4518-851e-a61630368c0c\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") "
Jul 08 11:50:18.586794 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.586663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqs97\" (UniqueName: \"kubernetes.io/projected/4ed5194d-5b29-4518-851e-a61630368c0c-kube-api-access-sqs97\") pod \"4ed5194d-5b29-4518-851e-a61630368c0c\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") "
Jul 08 11:50:18.586860 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.586797    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ed5194d-5b29-4518-851e-a61630368c0c-openshift-service-ca\") pod \"4ed5194d-5b29-4518-851e-a61630368c0c\" (UID: \"4ed5194d-5b29-4518-851e-a61630368c0c\") "
Jul 08 11:50:18.587125 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.587103    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ed5194d-5b29-4518-851e-a61630368c0c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ed5194d-5b29-4518-851e-a61630368c0c" (UID: "4ed5194d-5b29-4518-851e-a61630368c0c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:50:18.588731 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.588707    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ed5194d-5b29-4518-851e-a61630368c0c-kube-api-access-sqs97" (OuterVolumeSpecName: "kube-api-access-sqs97") pod "4ed5194d-5b29-4518-851e-a61630368c0c" (UID: "4ed5194d-5b29-4518-851e-a61630368c0c"). InnerVolumeSpecName "kube-api-access-sqs97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:50:18.588796 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.588739    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ed5194d-5b29-4518-851e-a61630368c0c" (UID: "4ed5194d-5b29-4518-851e-a61630368c0c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:50:18.687558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.687529    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqs97\" (UniqueName: \"kubernetes.io/projected/4ed5194d-5b29-4518-851e-a61630368c0c-kube-api-access-sqs97\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:50:18.687558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.687555    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ed5194d-5b29-4518-851e-a61630368c0c-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:50:18.687682 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.687570    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ed5194d-5b29-4518-851e-a61630368c0c-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:50:18.718439 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.718412    2561 generic.go:356] "Generic (PLEG): container finished" podID="4ed5194d-5b29-4518-851e-a61630368c0c" containerID="4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7" exitCode=0
Jul 08 11:50:18.718528 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.718446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" event={"ID":"4ed5194d-5b29-4518-851e-a61630368c0c","Type":"ContainerDied","Data":"4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7"}
Jul 08 11:50:18.718528 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.718496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl" event={"ID":"4ed5194d-5b29-4518-851e-a61630368c0c","Type":"ContainerDied","Data":"a58360da974e7f8038404dd2ebd57ba23b302ce4f9b1650387ff09c94b6dfcdc"}
Jul 08 11:50:18.718528 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.718517    2561 scope.go:117] "RemoveContainer" containerID="4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7"
Jul 08 11:50:18.718625 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.718457    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"
Jul 08 11:50:18.727220 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.727206    2561 scope.go:117] "RemoveContainer" containerID="4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7"
Jul 08 11:50:18.727491 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:50:18.727465    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7\": container with ID starting with 4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7 not found: ID does not exist" containerID="4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7"
Jul 08 11:50:18.727538 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.727499    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7"} err="failed to get container status \"4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7\": rpc error: code = NotFound desc = could not find container \"4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7\": container with ID starting with 4ad2d59a4b9ff5596f7c62c5225c32c9ec8bc44972f121a089c26534c5d8cbe7 not found: ID does not exist"
Jul 08 11:50:18.738936 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.738906    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"]
Jul 08 11:50:18.742855 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:18.742832    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4076ef-6c765947fb-wf6vl"]
Jul 08 11:50:19.838443 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:19.838416    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ed5194d-5b29-4518-851e-a61630368c0c" path="/var/lib/kubelet/pods/4ed5194d-5b29-4518-851e-a61630368c0c/volumes"
Jul 08 11:50:25.079008 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.078976    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"]
Jul 08 11:50:25.079468 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.079184    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt" podUID="fed28223-e7d7-463d-8ee4-ccf029360414" containerName="maas-api" containerID="cri-o://4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60" gracePeriod=30
Jul 08 11:50:25.320335 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.320314    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:25.445420 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.445363    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fed28223-e7d7-463d-8ee4-ccf029360414-maas-api-tls\") pod \"fed28223-e7d7-463d-8ee4-ccf029360414\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") "
Jul 08 11:50:25.445523 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.445426    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fed28223-e7d7-463d-8ee4-ccf029360414-openshift-service-ca\") pod \"fed28223-e7d7-463d-8ee4-ccf029360414\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") "
Jul 08 11:50:25.445523 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.445459    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxk97\" (UniqueName: \"kubernetes.io/projected/fed28223-e7d7-463d-8ee4-ccf029360414-kube-api-access-xxk97\") pod \"fed28223-e7d7-463d-8ee4-ccf029360414\" (UID: \"fed28223-e7d7-463d-8ee4-ccf029360414\") "
Jul 08 11:50:25.445733 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.445713    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fed28223-e7d7-463d-8ee4-ccf029360414-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fed28223-e7d7-463d-8ee4-ccf029360414" (UID: "fed28223-e7d7-463d-8ee4-ccf029360414"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:50:25.447457 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.447438    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fed28223-e7d7-463d-8ee4-ccf029360414-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fed28223-e7d7-463d-8ee4-ccf029360414" (UID: "fed28223-e7d7-463d-8ee4-ccf029360414"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:50:25.447525 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.447488    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fed28223-e7d7-463d-8ee4-ccf029360414-kube-api-access-xxk97" (OuterVolumeSpecName: "kube-api-access-xxk97") pod "fed28223-e7d7-463d-8ee4-ccf029360414" (UID: "fed28223-e7d7-463d-8ee4-ccf029360414"). InnerVolumeSpecName "kube-api-access-xxk97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:50:25.547042 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.547019    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fed28223-e7d7-463d-8ee4-ccf029360414-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:50:25.547042 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.547041    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fed28223-e7d7-463d-8ee4-ccf029360414-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:50:25.547171 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.547050    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxk97\" (UniqueName: \"kubernetes.io/projected/fed28223-e7d7-463d-8ee4-ccf029360414-kube-api-access-xxk97\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:50:25.752393 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.752299    2561 generic.go:356] "Generic (PLEG): container finished" podID="fed28223-e7d7-463d-8ee4-ccf029360414" containerID="4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60" exitCode=0
Jul 08 11:50:25.752393 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.752353    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"
Jul 08 11:50:25.752393 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.752367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt" event={"ID":"fed28223-e7d7-463d-8ee4-ccf029360414","Type":"ContainerDied","Data":"4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60"}
Jul 08 11:50:25.752628 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.752407    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt" event={"ID":"fed28223-e7d7-463d-8ee4-ccf029360414","Type":"ContainerDied","Data":"1d7ee40e9c9c6a5278563aa1887cc7c433f6f990203af6e1b10f239d47c836ce"}
Jul 08 11:50:25.752628 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.752428    2561 scope.go:117] "RemoveContainer" containerID="4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60"
Jul 08 11:50:25.761624 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.761609    2561 scope.go:117] "RemoveContainer" containerID="4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60"
Jul 08 11:50:25.761878 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:50:25.761848    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60\": container with ID starting with 4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60 not found: ID does not exist" containerID="4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60"
Jul 08 11:50:25.761921 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.761890    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60"} err="failed to get container status \"4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60\": rpc error: code = NotFound desc = could not find container \"4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60\": container with ID starting with 4e386c1f388d09eb16b3c66d67adbf03f85d3964db81a8fc0a1d0cb76f5a0a60 not found: ID does not exist"
Jul 08 11:50:25.772726 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.772706    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"]
Jul 08 11:50:25.776380 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.776362    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8404-6bb97f495b-jhmtt"]
Jul 08 11:50:25.834425 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:25.834400    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fed28223-e7d7-463d-8ee4-ccf029360414" path="/var/lib/kubelet/pods/fed28223-e7d7-463d-8ee4-ccf029360414/volumes"
Jul 08 11:50:35.061553 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.061518    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"]
Jul 08 11:50:35.062000 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.061951    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fed28223-e7d7-463d-8ee4-ccf029360414" containerName="maas-api"
Jul 08 11:50:35.062000 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.061964    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fed28223-e7d7-463d-8ee4-ccf029360414" containerName="maas-api"
Jul 08 11:50:35.062000 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.061985    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ed5194d-5b29-4518-851e-a61630368c0c" containerName="maas-api"
Jul 08 11:50:35.062000 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.061992    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ed5194d-5b29-4518-851e-a61630368c0c" containerName="maas-api"
Jul 08 11:50:35.062130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.062092    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fed28223-e7d7-463d-8ee4-ccf029360414" containerName="maas-api"
Jul 08 11:50:35.062130 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.062104    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ed5194d-5b29-4518-851e-a61630368c0c" containerName="maas-api"
Jul 08 11:50:35.065129 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.065115    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.070614 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.070590    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-5a670c-serving-cert\""
Jul 08 11:50:35.070748 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.070630    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tnv7f\""
Jul 08 11:50:35.078015 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.077993    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"]
Jul 08 11:50:35.228823 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.228795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlm7r\" (UniqueName: \"kubernetes.io/projected/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-kube-api-access-jlm7r\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.228953 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.228829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.228953 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.228861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-maas-api-tls\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.329668 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.329604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlm7r\" (UniqueName: \"kubernetes.io/projected/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-kube-api-access-jlm7r\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.329668 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.329636    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.329809 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.329684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-maas-api-tls\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.330299 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.330279    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.332102 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.332082    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-maas-api-tls\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.355823 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.355798    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlm7r\" (UniqueName: \"kubernetes.io/projected/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-kube-api-access-jlm7r\") pod \"maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.374814 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.374793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:35.511945 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.511921    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"]
Jul 08 11:50:35.513725 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:50:35.513687    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4936b1d6_51bb_45f5_a7a6_7ae5457c6a68.slice/crio-122f8e253d9412c98e2330c37ffaa24295b5fac257754be392af6b38b7a29b4a WatchSource:0}: Error finding container 122f8e253d9412c98e2330c37ffaa24295b5fac257754be392af6b38b7a29b4a: Status 404 returned error can't find the container with id 122f8e253d9412c98e2330c37ffaa24295b5fac257754be392af6b38b7a29b4a
Jul 08 11:50:35.799675 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:35.799645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw" event={"ID":"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68","Type":"ContainerStarted","Data":"122f8e253d9412c98e2330c37ffaa24295b5fac257754be392af6b38b7a29b4a"}
Jul 08 11:50:36.811550 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:36.811511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw" event={"ID":"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68","Type":"ContainerStarted","Data":"7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba"}
Jul 08 11:50:36.811982 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:36.811658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:36.831594 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:36.831546    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw" podStartSLOduration=1.386216518 podStartE2EDuration="1.831533277s" totalImagesPullingTime="445.316759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:50:36.829983421 +0000 UTC m=+2227.593336796" watchObservedRunningTime="2026-07-08 11:50:36.831533277 +0000 UTC m=+2227.594886639"
Jul 08 11:50:42.822043 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:42.822014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:50:42.989617 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:42.989584    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"]
Jul 08 11:50:42.993428 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:42.993411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:42.995644 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:42.995622    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e79b1c-serving-cert\""
Jul 08 11:50:43.002779 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.002755    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"]
Jul 08 11:50:43.100154 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.100093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbnc5\" (UniqueName: \"kubernetes.io/projected/763ae010-e1ff-4417-b15f-2ddd556b79eb-kube-api-access-gbnc5\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.100154 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.100126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.100316 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.100241    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/763ae010-e1ff-4417-b15f-2ddd556b79eb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.201542 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.201511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/763ae010-e1ff-4417-b15f-2ddd556b79eb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.201636 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.201607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbnc5\" (UniqueName: \"kubernetes.io/projected/763ae010-e1ff-4417-b15f-2ddd556b79eb-kube-api-access-gbnc5\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.201696 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.201641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.201779 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:50:43.201765    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-serving-cert: secret "maas-api-e2e-shared-b-e79b1c-serving-cert" not found
Jul 08 11:50:43.201836 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:50:43.201825    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls podName:763ae010-e1ff-4417-b15f-2ddd556b79eb nodeName:}" failed. No retries permitted until 2026-07-08 11:50:43.701810123 +0000 UTC m=+2234.465163464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls") pod "maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" (UID: "763ae010-e1ff-4417-b15f-2ddd556b79eb") : secret "maas-api-e2e-shared-b-e79b1c-serving-cert" not found
Jul 08 11:50:43.202095 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.202079    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/763ae010-e1ff-4417-b15f-2ddd556b79eb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.214524 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.214502    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbnc5\" (UniqueName: \"kubernetes.io/projected/763ae010-e1ff-4417-b15f-2ddd556b79eb-kube-api-access-gbnc5\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.706038 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.706007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.708350 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.708326    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls\") pod \"maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:43.907479 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:43.907457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:44.030690 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:44.030666    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"]
Jul 08 11:50:44.032906 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:50:44.032860    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763ae010_e1ff_4417_b15f_2ddd556b79eb.slice/crio-f8c873e789b44fc78739eac67c357356d426512330068ff6b93ba1a61a217839 WatchSource:0}: Error finding container f8c873e789b44fc78739eac67c357356d426512330068ff6b93ba1a61a217839: Status 404 returned error can't find the container with id f8c873e789b44fc78739eac67c357356d426512330068ff6b93ba1a61a217839
Jul 08 11:50:44.849045 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:44.848966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" event={"ID":"763ae010-e1ff-4417-b15f-2ddd556b79eb","Type":"ContainerStarted","Data":"ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd"}
Jul 08 11:50:44.849045 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:44.849011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" event={"ID":"763ae010-e1ff-4417-b15f-2ddd556b79eb","Type":"ContainerStarted","Data":"f8c873e789b44fc78739eac67c357356d426512330068ff6b93ba1a61a217839"}
Jul 08 11:50:44.849045 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:44.849030    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:50.858996 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:50.858912    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:50:50.874489 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:50:50.874264    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" podStartSLOduration=8.316649164 podStartE2EDuration="8.874245249s" totalImagesPullingTime="557.596085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:50:44.865815045 +0000 UTC m=+2235.629168426" watchObservedRunningTime="2026-07-08 11:50:50.874245249 +0000 UTC m=+2241.637598613"
Jul 08 11:53:29.925883 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:29.925843    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:53:29.929173 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:29.929152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pf8f6_2e9640ba-98da-49bf-82d8-6a1a136fd760/kube-multus/0.log"
Jul 08 11:53:29.930727 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:29.930706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:53:29.933650 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:29.933630    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pz758_db85efb0-a3b1-4598-8bb2-32a8b07d1080/ovn-acl-logging/0.log"
Jul 08 11:53:53.630089 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:53.630013    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"]
Jul 08 11:53:53.630505 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:53.630200    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw" podUID="4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" containerName="maas-api" containerID="cri-o://7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba" gracePeriod=30
Jul 08 11:53:53.866561 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:53.866528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:53:54.038770 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.038739    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-openshift-service-ca\") pod \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") "
Jul 08 11:53:54.038989 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.038775    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-maas-api-tls\") pod \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") "
Jul 08 11:53:54.038989 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.038804    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlm7r\" (UniqueName: \"kubernetes.io/projected/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-kube-api-access-jlm7r\") pod \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\" (UID: \"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68\") "
Jul 08 11:53:54.039119 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.039097    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" (UID: "4936b1d6-51bb-45f5-a7a6-7ae5457c6a68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:53:54.039202 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.039190    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:53:54.040995 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.040973    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" (UID: "4936b1d6-51bb-45f5-a7a6-7ae5457c6a68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:53:54.041141 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.041007    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-kube-api-access-jlm7r" (OuterVolumeSpecName: "kube-api-access-jlm7r") pod "4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" (UID: "4936b1d6-51bb-45f5-a7a6-7ae5457c6a68"). InnerVolumeSpecName "kube-api-access-jlm7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:53:54.140601 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.140580    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:53:54.140601 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.140601    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlm7r\" (UniqueName: \"kubernetes.io/projected/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68-kube-api-access-jlm7r\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:53:54.714000 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.713969    2561 generic.go:356] "Generic (PLEG): container finished" podID="4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" containerID="7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba" exitCode=0
Jul 08 11:53:54.714371 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.714016    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"
Jul 08 11:53:54.714371 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.714057    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw" event={"ID":"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68","Type":"ContainerDied","Data":"7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba"}
Jul 08 11:53:54.714371 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.714103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw" event={"ID":"4936b1d6-51bb-45f5-a7a6-7ae5457c6a68","Type":"ContainerDied","Data":"122f8e253d9412c98e2330c37ffaa24295b5fac257754be392af6b38b7a29b4a"}
Jul 08 11:53:54.714371 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.714123    2561 scope.go:117] "RemoveContainer" containerID="7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba"
Jul 08 11:53:54.722627 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.722612    2561 scope.go:117] "RemoveContainer" containerID="7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba"
Jul 08 11:53:54.722903 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:53:54.722886    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba\": container with ID starting with 7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba not found: ID does not exist" containerID="7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba"
Jul 08 11:53:54.722969 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.722916    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba"} err="failed to get container status \"7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba\": rpc error: code = NotFound desc = could not find container \"7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba\": container with ID starting with 7bba49481148a36420de6651b46c51e4182cab84137904db4793cf54fb1be7ba not found: ID does not exist"
Jul 08 11:53:54.738971 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.738949    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"]
Jul 08 11:53:54.742886 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:54.742855    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5a670c-5648bb6c89-t42tw"]
Jul 08 11:53:55.834000 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:53:55.833966    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" path="/var/lib/kubelet/pods/4936b1d6-51bb-45f5-a7a6-7ae5457c6a68/volumes"
Jul 08 11:54:00.749237 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.749208    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"]
Jul 08 11:54:00.749633 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.749395    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" podUID="763ae010-e1ff-4417-b15f-2ddd556b79eb" containerName="maas-api" containerID="cri-o://ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd" gracePeriod=30
Jul 08 11:54:00.853692 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.853656    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" podUID="763ae010-e1ff-4417-b15f-2ddd556b79eb" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.47:8443/health\": dial tcp 10.134.0.47:8443: connect: connection refused"
Jul 08 11:54:00.983857 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.983830    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:54:00.995463 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.995446    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls\") pod \"763ae010-e1ff-4417-b15f-2ddd556b79eb\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") "
Jul 08 11:54:00.995546 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.995533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/763ae010-e1ff-4417-b15f-2ddd556b79eb-openshift-service-ca\") pod \"763ae010-e1ff-4417-b15f-2ddd556b79eb\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") "
Jul 08 11:54:00.995608 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.995588    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbnc5\" (UniqueName: \"kubernetes.io/projected/763ae010-e1ff-4417-b15f-2ddd556b79eb-kube-api-access-gbnc5\") pod \"763ae010-e1ff-4417-b15f-2ddd556b79eb\" (UID: \"763ae010-e1ff-4417-b15f-2ddd556b79eb\") "
Jul 08 11:54:00.995879 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.995844    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763ae010-e1ff-4417-b15f-2ddd556b79eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "763ae010-e1ff-4417-b15f-2ddd556b79eb" (UID: "763ae010-e1ff-4417-b15f-2ddd556b79eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 11:54:00.997430 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.997408    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "763ae010-e1ff-4417-b15f-2ddd556b79eb" (UID: "763ae010-e1ff-4417-b15f-2ddd556b79eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 11:54:00.997527 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:00.997506    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763ae010-e1ff-4417-b15f-2ddd556b79eb-kube-api-access-gbnc5" (OuterVolumeSpecName: "kube-api-access-gbnc5") pod "763ae010-e1ff-4417-b15f-2ddd556b79eb" (UID: "763ae010-e1ff-4417-b15f-2ddd556b79eb"). InnerVolumeSpecName "kube-api-access-gbnc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 11:54:01.096420 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.096394    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/763ae010-e1ff-4417-b15f-2ddd556b79eb-openshift-service-ca\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:54:01.096420 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.096418    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbnc5\" (UniqueName: \"kubernetes.io/projected/763ae010-e1ff-4417-b15f-2ddd556b79eb-kube-api-access-gbnc5\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:54:01.096563 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.096428    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/763ae010-e1ff-4417-b15f-2ddd556b79eb-maas-api-tls\") on node \"ip-10-0-141-201.ec2.internal\" DevicePath \"\""
Jul 08 11:54:01.748190 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.748162    2561 generic.go:356] "Generic (PLEG): container finished" podID="763ae010-e1ff-4417-b15f-2ddd556b79eb" containerID="ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd" exitCode=0
Jul 08 11:54:01.748317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.748212    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"
Jul 08 11:54:01.748317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.748230    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" event={"ID":"763ae010-e1ff-4417-b15f-2ddd556b79eb","Type":"ContainerDied","Data":"ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd"}
Jul 08 11:54:01.748317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.748293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs" event={"ID":"763ae010-e1ff-4417-b15f-2ddd556b79eb","Type":"ContainerDied","Data":"f8c873e789b44fc78739eac67c357356d426512330068ff6b93ba1a61a217839"}
Jul 08 11:54:01.748317 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.748314    2561 scope.go:117] "RemoveContainer" containerID="ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd"
Jul 08 11:54:01.757465 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.757283    2561 scope.go:117] "RemoveContainer" containerID="ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd"
Jul 08 11:54:01.757703 ip-10-0-141-201 kubenswrapper[2561]: E0708 11:54:01.757545    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd\": container with ID starting with ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd not found: ID does not exist" containerID="ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd"
Jul 08 11:54:01.757703 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.757569    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd"} err="failed to get container status \"ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd\": rpc error: code = NotFound desc = could not find container \"ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd\": container with ID starting with ac1d3d6ba35969db3127a02338a703149b788bf9f5d36a2ab00e7f207897ebfd not found: ID does not exist"
Jul 08 11:54:01.772832 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.772792    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"]
Jul 08 11:54:01.775014 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.774995    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e79b1c-7456d47b7c-bkrvs"]
Jul 08 11:54:01.833639 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:01.833616    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763ae010-e1ff-4417-b15f-2ddd556b79eb" path="/var/lib/kubelet/pods/763ae010-e1ff-4417-b15f-2ddd556b79eb/volumes"
Jul 08 11:54:07.715488 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:07.715461    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-649794b7f7-kzwxr_8adf2d8f-7b0e-41e2-a36a-066ebcb61076/authorino/0.log"
Jul 08 11:54:13.334280 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:13.334248    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-njlv2_6b577cfb-bc0b-4a25-af74-90f21347eacd/copy-manifests/0.log"
Jul 08 11:54:13.342196 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:13.342168    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-njlv2_6b577cfb-bc0b-4a25-af74-90f21347eacd/manager/0.log"
Jul 08 11:54:14.713253 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:14.713226    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-649794b7f7-kzwxr_8adf2d8f-7b0e-41e2-a36a-066ebcb61076/authorino/0.log"
Jul 08 11:54:15.084199 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:15.084173    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dzl98_4565cdc7-f0fd-45a5-a134-91188739bc89/kuadrant-console-plugin/0.log"
Jul 08 11:54:16.291247 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:16.291210    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-flnts_efb0b325-0725-4a2e-adfb-3bef0fbfe61f/kube-auth-proxy/0.log"
Jul 08 11:54:17.146235 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:17.146188    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8klnq_d53733ac-0ae7-4fe2-a9ff-e47e617caba3/main/0.log"
Jul 08 11:54:17.372526 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:17.372498    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ngbvc_b0bf6157-4516-4db5-91bd-88a78a32da49/main/0.log"
Jul 08 11:54:21.482215 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482183    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wcxfn/must-gather-v8kmw"]
Jul 08 11:54:21.482558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482515    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763ae010-e1ff-4417-b15f-2ddd556b79eb" containerName="maas-api"
Jul 08 11:54:21.482558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482526    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="763ae010-e1ff-4417-b15f-2ddd556b79eb" containerName="maas-api"
Jul 08 11:54:21.482558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482554    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" containerName="maas-api"
Jul 08 11:54:21.482558 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482559    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" containerName="maas-api"
Jul 08 11:54:21.482686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482606    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4936b1d6-51bb-45f5-a7a6-7ae5457c6a68" containerName="maas-api"
Jul 08 11:54:21.482686 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.482618    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="763ae010-e1ff-4417-b15f-2ddd556b79eb" containerName="maas-api"
Jul 08 11:54:21.485702 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.485678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.491157 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.491133    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wcxfn\"/\"openshift-service-ca.crt\""
Jul 08 11:54:21.491296 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.491175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wcxfn\"/\"kube-root-ca.crt\""
Jul 08 11:54:21.505785 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.505764    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wcxfn/must-gather-v8kmw"]
Jul 08 11:54:21.559458 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.559432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a653e64d-bfe0-4f67-b3da-946a0ae78958-must-gather-output\") pod \"must-gather-v8kmw\" (UID: \"a653e64d-bfe0-4f67-b3da-946a0ae78958\") " pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.559549 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.559485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnnj\" (UniqueName: \"kubernetes.io/projected/a653e64d-bfe0-4f67-b3da-946a0ae78958-kube-api-access-htnnj\") pod \"must-gather-v8kmw\" (UID: \"a653e64d-bfe0-4f67-b3da-946a0ae78958\") " pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.660114 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.660087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a653e64d-bfe0-4f67-b3da-946a0ae78958-must-gather-output\") pod \"must-gather-v8kmw\" (UID: \"a653e64d-bfe0-4f67-b3da-946a0ae78958\") " pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.660216 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.660169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnnj\" (UniqueName: \"kubernetes.io/projected/a653e64d-bfe0-4f67-b3da-946a0ae78958-kube-api-access-htnnj\") pod \"must-gather-v8kmw\" (UID: \"a653e64d-bfe0-4f67-b3da-946a0ae78958\") " pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.660380 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.660361    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a653e64d-bfe0-4f67-b3da-946a0ae78958-must-gather-output\") pod \"must-gather-v8kmw\" (UID: \"a653e64d-bfe0-4f67-b3da-946a0ae78958\") " pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.674324 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.674298    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htnnj\" (UniqueName: \"kubernetes.io/projected/a653e64d-bfe0-4f67-b3da-946a0ae78958-kube-api-access-htnnj\") pod \"must-gather-v8kmw\" (UID: \"a653e64d-bfe0-4f67-b3da-946a0ae78958\") " pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.793974 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.793951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wcxfn/must-gather-v8kmw"
Jul 08 11:54:21.940007 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.939985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wcxfn/must-gather-v8kmw"]
Jul 08 11:54:21.941762 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:54:21.941734    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda653e64d_bfe0_4f67_b3da_946a0ae78958.slice/crio-7f53cc4f402701f2eac850f3ccf16d9e3ec28aa79bd1332bd7208e4bdfe0e934 WatchSource:0}: Error finding container 7f53cc4f402701f2eac850f3ccf16d9e3ec28aa79bd1332bd7208e4bdfe0e934: Status 404 returned error can't find the container with id 7f53cc4f402701f2eac850f3ccf16d9e3ec28aa79bd1332bd7208e4bdfe0e934
Jul 08 11:54:21.943525 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:21.943511    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 11:54:22.846630 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:22.846590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/must-gather-v8kmw" event={"ID":"a653e64d-bfe0-4f67-b3da-946a0ae78958","Type":"ContainerStarted","Data":"7f53cc4f402701f2eac850f3ccf16d9e3ec28aa79bd1332bd7208e4bdfe0e934"}
Jul 08 11:54:23.855700 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:23.855662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/must-gather-v8kmw" event={"ID":"a653e64d-bfe0-4f67-b3da-946a0ae78958","Type":"ContainerStarted","Data":"2ffe99ec1c95e6a59671976fc562bcd84bdf8e705caee92f88f209fcb7982f4e"}
Jul 08 11:54:23.856575 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:23.856282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/must-gather-v8kmw" event={"ID":"a653e64d-bfe0-4f67-b3da-946a0ae78958","Type":"ContainerStarted","Data":"06a12307e36f3b9993365f155ad74b62fc8a809a501f3c73116d7e4467f2af4d"}
Jul 08 11:54:23.875599 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:23.875555    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wcxfn/must-gather-v8kmw" podStartSLOduration=1.814158995 podStartE2EDuration="2.875542677s" totalImagesPullingTime="1.061383682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:54:23.873156745 +0000 UTC m=+2454.636510109" watchObservedRunningTime="2026-07-08 11:54:23.875542677 +0000 UTC m=+2454.638896040"
Jul 08 11:54:24.813018 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:24.812976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qjxsr_4b5572f4-4d54-4f11-af5f-3946b41cb37f/global-pull-secret-syncer/0.log"
Jul 08 11:54:25.071729 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:25.071657    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-959ql_3ea356d3-cf05-444a-bc88-1ce1346e7eee/konnectivity-agent/0.log"
Jul 08 11:54:25.280664 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:25.280635    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-201.ec2.internal_bef9c4d9d443de443b3dad3e31ea593a/haproxy/0.log"
Jul 08 11:54:30.103030 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:30.102977    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-649794b7f7-kzwxr_8adf2d8f-7b0e-41e2-a36a-066ebcb61076/authorino/0.log"
Jul 08 11:54:30.207526 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:30.207387    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dzl98_4565cdc7-f0fd-45a5-a134-91188739bc89/kuadrant-console-plugin/0.log"
Jul 08 11:54:32.129253 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.129228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/alertmanager/0.log"
Jul 08 11:54:32.172906 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.172807    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/config-reloader/0.log"
Jul 08 11:54:32.205813 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.205762    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/kube-rbac-proxy-web/0.log"
Jul 08 11:54:32.240606 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.240575    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/kube-rbac-proxy/0.log"
Jul 08 11:54:32.269881 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.269841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/kube-rbac-proxy-metric/0.log"
Jul 08 11:54:32.300276 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.300244    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/prom-label-proxy/0.log"
Jul 08 11:54:32.337595 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.337569    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5042306a-033f-4185-a720-c22b51678783/init-config-reloader/0.log"
Jul 08 11:54:32.466887 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.466784    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jr86n_ea676d20-78ec-4f4f-b2b7-52f61b6f7eda/kube-state-metrics/0.log"
Jul 08 11:54:32.491800 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.491771    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jr86n_ea676d20-78ec-4f4f-b2b7-52f61b6f7eda/kube-rbac-proxy-main/0.log"
Jul 08 11:54:32.522358 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.522318    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jr86n_ea676d20-78ec-4f4f-b2b7-52f61b6f7eda/kube-rbac-proxy-self/0.log"
Jul 08 11:54:32.568101 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.568072    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b5659f4-wg7bx_50a7b652-5b98-4b44-961b-4a6bbc0a72e8/metrics-server/0.log"
Jul 08 11:54:32.615278 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.615229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-jxwb7_5920737f-2fdb-4be8-b4c7-aabdb1787b1e/monitoring-plugin/0.log"
Jul 08 11:54:32.764408 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.764374    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lgng_1a23de9a-2b17-4cf2-9b90-24639d7e0367/node-exporter/0.log"
Jul 08 11:54:32.798207 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.798180    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lgng_1a23de9a-2b17-4cf2-9b90-24639d7e0367/kube-rbac-proxy/0.log"
Jul 08 11:54:32.833896 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.833849    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7lgng_1a23de9a-2b17-4cf2-9b90-24639d7e0367/init-textfile/0.log"
Jul 08 11:54:32.984176 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:32.984144    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xw5vf_516693f1-7417-4b5b-8f49-d56ee966eb5d/kube-rbac-proxy-main/0.log"
Jul 08 11:54:33.015598 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.015515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xw5vf_516693f1-7417-4b5b-8f49-d56ee966eb5d/kube-rbac-proxy-self/0.log"
Jul 08 11:54:33.042101 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.042071    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xw5vf_516693f1-7417-4b5b-8f49-d56ee966eb5d/openshift-state-metrics/0.log"
Jul 08 11:54:33.076405 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.076377    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/prometheus/0.log"
Jul 08 11:54:33.119183 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.119153    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/config-reloader/0.log"
Jul 08 11:54:33.145950 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.145920    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/thanos-sidecar/0.log"
Jul 08 11:54:33.174568 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.174529    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/kube-rbac-proxy-web/0.log"
Jul 08 11:54:33.198775 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.198747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/kube-rbac-proxy/0.log"
Jul 08 11:54:33.224166 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.224136    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/kube-rbac-proxy-thanos/0.log"
Jul 08 11:54:33.255332 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.255297    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a860a654-29d1-417e-b5c1-68e785f497ec/init-config-reloader/0.log"
Jul 08 11:54:33.390026 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.389948    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c9dd655dc-6lt7k_61e52fa5-8962-4714-9e22-f4fe7bffe133/telemeter-client/0.log"
Jul 08 11:54:33.415936 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.415907    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c9dd655dc-6lt7k_61e52fa5-8962-4714-9e22-f4fe7bffe133/reload/0.log"
Jul 08 11:54:33.443369 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.443333    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c9dd655dc-6lt7k_61e52fa5-8962-4714-9e22-f4fe7bffe133/kube-rbac-proxy/0.log"
Jul 08 11:54:33.476543 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.476515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cddf8d44b-2scnd_cf610ecb-4996-499e-a40a-0538b7920b52/thanos-query/0.log"
Jul 08 11:54:33.501025 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.500993    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cddf8d44b-2scnd_cf610ecb-4996-499e-a40a-0538b7920b52/kube-rbac-proxy-web/0.log"
Jul 08 11:54:33.526146 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.526105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cddf8d44b-2scnd_cf610ecb-4996-499e-a40a-0538b7920b52/kube-rbac-proxy/0.log"
Jul 08 11:54:33.553103 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.553072    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cddf8d44b-2scnd_cf610ecb-4996-499e-a40a-0538b7920b52/prom-label-proxy/0.log"
Jul 08 11:54:33.578256 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.578224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cddf8d44b-2scnd_cf610ecb-4996-499e-a40a-0538b7920b52/kube-rbac-proxy-rules/0.log"
Jul 08 11:54:33.605004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:33.604975    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cddf8d44b-2scnd_cf610ecb-4996-499e-a40a-0538b7920b52/kube-rbac-proxy-metrics/0.log"
Jul 08 11:54:34.391935 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.391897    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"]
Jul 08 11:54:34.396294 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.396264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.399744 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.399713    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wcxfn\"/\"default-dockercfg-kjnzf\""
Jul 08 11:54:34.403769 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.403740    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"]
Jul 08 11:54:34.500085 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.500055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-lib-modules\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.500085 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.500095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-sys\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.500342 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.500125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-podres\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.500342 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.500266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-proc\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.500342 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.500304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmhhf\" (UniqueName: \"kubernetes.io/projected/95b79912-836a-4e0f-8913-a972abd584de-kube-api-access-qmhhf\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.601663 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-sys\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.601856 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-podres\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.601856 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-proc\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.601856 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601768    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-sys\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.602037 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmhhf\" (UniqueName: \"kubernetes.io/projected/95b79912-836a-4e0f-8913-a972abd584de-kube-api-access-qmhhf\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.602037 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-podres\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.602037 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-lib-modules\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.602037 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.601827    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-proc\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.602172 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.602113    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b79912-836a-4e0f-8913-a972abd584de-lib-modules\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.611417 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.611391    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmhhf\" (UniqueName: \"kubernetes.io/projected/95b79912-836a-4e0f-8913-a972abd584de-kube-api-access-qmhhf\") pod \"perf-node-gather-daemonset-zvhnp\" (UID: \"95b79912-836a-4e0f-8913-a972abd584de\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.713594 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.713518    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:34.894571 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.894532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"]
Jul 08 11:54:34.898764 ip-10-0-141-201 kubenswrapper[2561]: W0708 11:54:34.898727    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95b79912_836a_4e0f_8913_a972abd584de.slice/crio-80505ab7417ff61b3658000e0dab82c2376c42cc2c995e9cdaf8691f0ed8e628 WatchSource:0}: Error finding container 80505ab7417ff61b3658000e0dab82c2376c42cc2c995e9cdaf8691f0ed8e628: Status 404 returned error can't find the container with id 80505ab7417ff61b3658000e0dab82c2376c42cc2c995e9cdaf8691f0ed8e628
Jul 08 11:54:34.940755 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:34.940727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp" event={"ID":"95b79912-836a-4e0f-8913-a972abd584de","Type":"ContainerStarted","Data":"80505ab7417ff61b3658000e0dab82c2376c42cc2c995e9cdaf8691f0ed8e628"}
Jul 08 11:54:35.934818 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:35.934796    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7749979db8-j7nwk_16b96199-9cf5-4d1e-875e-00c0b65addd4/console/0.log"
Jul 08 11:54:35.947764 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:35.947733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp" event={"ID":"95b79912-836a-4e0f-8913-a972abd584de","Type":"ContainerStarted","Data":"3e48c4a3a18c2a48a0b17c2beac38d6de4462ae514badc81a2b21596d12a61db"}
Jul 08 11:54:35.947946 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:35.947897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:35.966690 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:35.966641    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp" podStartSLOduration=1.966625814 podStartE2EDuration="1.966625814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:54:35.965411201 +0000 UTC m=+2466.728764564" watchObservedRunningTime="2026-07-08 11:54:35.966625814 +0000 UTC m=+2466.729979177"
Jul 08 11:54:37.804139 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:37.804111    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zslfs_7a195fc6-882c-4e50-8b6d-aa4d9a64c964/dns/0.log"
Jul 08 11:54:37.841080 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:37.841045    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zslfs_7a195fc6-882c-4e50-8b6d-aa4d9a64c964/kube-rbac-proxy/0.log"
Jul 08 11:54:37.982534 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:37.982505    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bnkkb_00682ea6-c7f0-45db-9154-8538017af12c/dns-node-resolver/0.log"
Jul 08 11:54:38.582034 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:38.581993    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2nhll_01de7db5-6d86-4170-bf3b-798c52e19c5f/node-ca/0.log"
Jul 08 11:54:39.890738 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:39.890710    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-flnts_efb0b325-0725-4a2e-adfb-3bef0fbfe61f/kube-auth-proxy/0.log"
Jul 08 11:54:41.002004 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:41.001970    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d7lrq_53b10f49-0798-44ad-a5ef-aee1c07d7f6d/serve-healthcheck-canary/0.log"
Jul 08 11:54:41.776431 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:41.776402    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd6tr_750c064b-9e8a-4f79-9d09-cf047b2e05e8/kube-rbac-proxy/0.log"
Jul 08 11:54:41.802153 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:41.802123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd6tr_750c064b-9e8a-4f79-9d09-cf047b2e05e8/exporter/0.log"
Jul 08 11:54:41.827153 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:41.827117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd6tr_750c064b-9e8a-4f79-9d09-cf047b2e05e8/extractor/0.log"
Jul 08 11:54:41.963802 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:41.963772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-zvhnp"
Jul 08 11:54:44.787396 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:44.787367    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-flnts_efb0b325-0725-4a2e-adfb-3bef0fbfe61f/kube-auth-proxy/0.log"
Jul 08 11:54:44.856040 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:44.856005    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-njlv2_6b577cfb-bc0b-4a25-af74-90f21347eacd/manager/0.log"
Jul 08 11:54:44.876764 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:44.876740    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-njlv2_6b577cfb-bc0b-4a25-af74-90f21347eacd/copy-manifests/0.log"
Jul 08 11:54:46.131675 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:46.131650    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-574bb547d7-hqk6m_48cb74ef-b64c-473c-91a9-aab667d92db0/manager/0.log"
Jul 08 11:54:46.160724 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:46.160685    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-c9f4c_cae4c549-3d51-4490-be38-b16f87af9026/openshift-lws-operator/0.log"
Jul 08 11:54:46.326067 ip-10-0-141-201 kubenswrapper[2561]: I0708 11:54:46.326039    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-flnts_efb0b325-0725-4a2e-adfb-3bef0fbfe61f/kube-auth-proxy/0.log"