Jul 07 15:40:58.360134 ip-10-0-141-63 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.822147    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826287    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826299    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826303    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826306    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826310    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826312    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826315    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:40:58.901003 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826318    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826321    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826323    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826328    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826332    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826335    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826337    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826340    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826349    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826352    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826354    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826358    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826362    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826365    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826368    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826371    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826374    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826377    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826379    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:40:58.904523 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826382    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826385    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826388    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826390    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826393    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826395    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826398    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826400    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826403    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826405    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826408    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826410    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826414    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826416    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826419    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826421    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826424    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826427    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826429    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826432    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:40:58.906211 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826434    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:40:58.906118 ip-10-0-141-63 systemd[1]: Started Kubernetes Kubelet.
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826437    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826440    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826442    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826444    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826447    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826450    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826453    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826456    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826459    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826461    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826464    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826467    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826469    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826472    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826474    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826477    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826480    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826482    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826484    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:40:58.913249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826487    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826489    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826492    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826494    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826498    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826502    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826505    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826508    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826510    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826513    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826515    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826518    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826520    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826522    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826525    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826527    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826530    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826533    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826535    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:40:58.914101 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826538    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826541    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826544    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826546    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826549    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826551    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826554    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826556    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826559    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826561    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826564    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826567    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826569    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.826572    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827315    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827322    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827324    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827327    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827330    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827333    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:40:58.923012 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827336    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827339    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827341    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827344    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827346    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827349    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827352    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827354    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827357    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827359    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827363    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827365    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827368    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827371    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827374    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827377    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827380    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827382    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827385    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827387    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:40:58.924274 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827390    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827392    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827395    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827398    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827401    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827403    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827406    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827410    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827413    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827417    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827420    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827422    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827430    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827434    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827437    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827440    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827443    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827445    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827448    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:40:58.931740 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827450    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827455    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827458    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827462    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827465    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827469    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827472    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827474    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827477    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827480    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827482    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827485    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827487    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827490    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827492    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827495    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827497    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827500    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827503    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:40:58.933359 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827505    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827508    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827511    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827513    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827516    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827518    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827521    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827525    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827528    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827532    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827535    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827538    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827541    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827544    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827549    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827551    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827554    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827556    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827559    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:40:58.939161 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827562    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827564    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827567    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827569    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827572    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827574    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827577    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827579    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827581    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827584    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827587    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827590    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827592    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827594    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827597    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827599    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827985    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827989    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827992    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827996    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.827999    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:40:58.940097 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828002    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828005    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828008    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828010    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828013    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828016    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828022    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828024    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828027    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828029    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828032    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828035    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828037    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828040    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828042    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828044    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828048    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828050    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828053    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828055    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:40:58.942502 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828057    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828060    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828062    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828066    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828069    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828071    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828073    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828076    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828078    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828082    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828085    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828087    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828092    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828095    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828099    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828102    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828105    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828108    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828112    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:40:58.943627 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828115    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828117    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828120    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828123    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828126    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828128    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828131    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828133    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828136    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828138    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828141    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828143    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828146    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828150    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828152    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828155    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828157    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828160    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828162    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:40:58.944909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828165    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828168    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828171    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828174    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828176    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828179    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828182    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828184    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828187    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828189    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828192    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828195    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828199    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828201    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828204    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828206    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828209    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828211    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828214    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:40:58.945895 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828217    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828219    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828222    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828224    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828227    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828229    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828232    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828236    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828239    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828241    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828244    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828246    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828249    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828251    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828253    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828256    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828259    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828327    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828338    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828344    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828349    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 15:40:58.947254 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828353    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828357    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828361    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828365    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828369    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828372    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828376    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828379    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828382    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828385    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828388    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828391    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828394    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828397    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828407    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828410    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828413    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828416    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828421    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828429    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828432    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828435    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828439    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828442    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 15:40:58.948198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828445    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828447    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828450    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828453    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828457    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828460    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828463    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828466    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828469    2570 flags.go:64] FLAG: --enable-server="true"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828473    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828477    2570 flags.go:64] FLAG: --event-burst="100"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828480    2570 flags.go:64] FLAG: --event-qps="50"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828484    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828487    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828490    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828494    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828497    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828499    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828502    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828505    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828508    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828511    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828514    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828516    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828519    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 15:40:58.949775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828522    2570 flags.go:64] FLAG: --feature-gates=""
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828527    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828530    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828533    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828536    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828539    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828542    2570 flags.go:64] FLAG: --help="false"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828545    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-141-63.ec2.internal"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828548    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828551    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828554    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828557    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828560    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828563    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828566    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828569    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828572    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828575    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828579    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828583    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828586    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828589    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828592    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828594    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 15:40:58.951147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828597    2570 flags.go:64] FLAG: --lock-file=""
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828600    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828603    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828605    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828611    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828614    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828616    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828619    2570 flags.go:64] FLAG: --logging-format="text"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828622    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828626    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828629    2570 flags.go:64] FLAG: --manifest-url=""
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828632    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828637    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828640    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828644    2570 flags.go:64] FLAG: --max-pods="110"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828646    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828649    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828652    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828655    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828658    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828661    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828663    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828670    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828674    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828676    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 15:40:58.952298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828679    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828683    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828692    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828696    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828700    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828703    2570 flags.go:64] FLAG: --port="10250"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828706    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828709    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0130d21f233859e41"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828712    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828714    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828717    2570 flags.go:64] FLAG: --register-node="true"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828720    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828728    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828730    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828733    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828736    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828741    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828744    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828747    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828749    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828752    2570 flags.go:64] FLAG: --runonce="false"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828755    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828758    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828761    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828763    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 15:40:59.192484 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828766    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828769    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828772    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828775    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828777    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828780    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828783    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828786    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828789    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828793    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828810    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828816    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828819    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828822    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828825    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828828    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828831    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828834    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828836    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828839    2570 flags.go:64] FLAG: --v="2"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828844    2570 flags.go:64] FLAG: --version="false"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828848    2570 flags.go:64] FLAG: --vmodule=""
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828851    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.828857    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828984    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:40:59.214520 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828988    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828991    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828993    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828996    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.828999    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829001    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829004    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829007    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829011    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829014    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829017    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829021    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829023    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829026    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829028    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829032    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829035    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829041    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829044    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829047    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:40:59.215453 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829049    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829052    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829054    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829057    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829059    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829062    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829065    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829069    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829071    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829074    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829078    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829081    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829083    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829086    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829088    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829091    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829094    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829096    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829099    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829101    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:40:59.217250 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829104    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829106    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829109    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829112    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829114    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829117    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829119    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829122    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829125    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829130    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829133    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829136    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829139    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829141    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829144    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829146    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829149    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829151    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829154    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:40:59.217993 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829156    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829159    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829161    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829168    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829170    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829173    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829175    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829178    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829181    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829183    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829186    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829188    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829191    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829193    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829196    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829198    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829201    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829203    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829206    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829209    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:40:59.218731 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829212    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829214    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829218    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829220    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829224    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829226    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829229    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829231    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829233    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829236    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829239    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829241    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829244    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829246    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829248    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829253    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829255    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829258    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:40:59.219330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.829260    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.830257    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.838062    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.838077    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.838098    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.838103    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838181    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838186    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838189    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838192    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838195    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838198    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838200    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838203    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838205    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:00.854980 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838208    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838210    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838213    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838215    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838218    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838221    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838225    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838229    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838232    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838235    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838238    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838241    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838243    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838246    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838248    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838251    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838254    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838256    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838258    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:00.855936 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838261    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838270    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838272    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838275    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838277    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838280    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838282    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838286    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838289    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838293    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838295    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838298    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838302    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838304    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838307    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838310    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838313    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838316    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838319    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:00.857116 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838321    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838324    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838327    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838330    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838332    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838336    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838340    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838342    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838345    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838348    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838350    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838353    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838355    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838358    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838360    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838368    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838371    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838374    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838376    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838379    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:00.857721 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838382    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838384    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838387    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838389    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838392    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838394    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838397    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838400    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838402    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838405    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838407    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838409    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838412    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838414    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838419    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838421    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838424    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838427    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838429    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838432    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:00.858293 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838434    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838437    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838439    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838442    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838444    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838447    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838450    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838452    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838460    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838462    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838465    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838469    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.838474    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838639    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838644    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:00.858930 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838647    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838650    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838653    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838656    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838659    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838661    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838664    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838667    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838670    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838673    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838675    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838678    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838682    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838685    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838688    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838690    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838693    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838695    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838698    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838700    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:00.859375 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838703    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838705    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838708    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838710    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838712    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838715    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838724    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838726    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838730    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838733    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838735    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838738    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838740    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838744    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838747    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838750    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838752    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838754    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838757    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:00.859987 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838760    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838762    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838765    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838767    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838776    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838780    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838782    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838784    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838787    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838790    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838792    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838809    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838813    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838816    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838818    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838821    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838823    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838828    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838831    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:00.860570 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838834    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838844    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838848    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838851    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838854    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838856    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838859    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838861    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838864    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838866    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838869    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838871    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838874    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838876    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838879    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838882    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838884    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838887    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838890    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838893    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:01.101131 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838896    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838898    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838901    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838904    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838906    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838909    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838911    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838914    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838916    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838919    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838921    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838924    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838926    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838929    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838939    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838942    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838944    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838946    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:01.102633 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:40:58.838949    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.838954    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.839072    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.843269    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.844993    2570 server.go:1019] "Starting client certificate rotation"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.845092    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.845122    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.848662    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.849830    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.861469    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.865831    2570 log.go:25] "Validated CRI v1 image API"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.867642    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 15:41:01.103133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.870342    2570 fs.go:135] Filesystem UUIDs: map[072496b4-8d88-4c6a-bf63-49a4b285b4dc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d3990489-6a94-47ab-ba91-58ba43af07a5:/dev/nvme0n1p4]
Jul 07 15:41:01.103469 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.870363    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.878512    2570 manager.go:216] Machine: {Timestamp:2026-07-07 15:40:58.877109902 +0000 UTC m=+0.373970854 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101380 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27e8f5d7897f9c2c4c19eba529a081 SystemUUID:ec27e8f5-d789-7f9c-2c4c-19eba529a081 BootID:650a8a5e-8399-410a-bc21-ed92da595436 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:d1:f4:83:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:d1:f4:83:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:05:d8:a0:82:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.878660    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.878794    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.878882    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.882299    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.882332    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 15:41:01.103500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.883888    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.883903    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.883912    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.884768    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.886650    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891232    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891366    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891403    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891417    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891428    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891438    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891447    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891886    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.891907    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.896392    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.898830    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.898885    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900361    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900379    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900388    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900396    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900407    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900416    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900428    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900435    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900445    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900453    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900465    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.900473    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.901441    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.901450    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.905351    2570 server.go:1268] "Started kubelet"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.905429    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.905561    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.905637    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.907891    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.908428    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.908446    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.908515    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.908510    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 15:41:01.103719 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.912340    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.916330    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.916439    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.916780    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917268    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917281    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917358    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917366    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917480    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917525    2570 factory.go:55] Registering systemd factory
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917539    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917820    2570 factory.go:153] Registering CRI-O factory
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917831    2570 factory.go:223] Registration of the crio container factory successfully
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917878    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917909    2570 factory.go:103] Registering Raw factory
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.917925    2570 manager.go:1196] Started watching for new ooms in manager
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.918302    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-63.ec2.internal.18c00c316fadff61  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-63.ec2.internal,UID:ip-10-0-141-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-63.ec2.internal,},FirstTimestamp:2026-07-07 15:40:58.905321313 +0000 UTC m=+0.402182263,LastTimestamp:2026-07-07 15:40:58.905321313 +0000 UTC m=+0.402182263,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-63.ec2.internal,}"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.919543    2570 manager.go:349] Starting recovery of all containers
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.943011    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.943080    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.948745    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kmn8f"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.951435    2570 manager.go:354] Recovery completed
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.956468    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.957133    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kmn8f"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.958651    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.958673    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.958684    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.959344    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.959353    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.959359    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.959370    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.960042    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.104802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.960062    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.960071    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:58.961149    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-63.ec2.internal.18c00c3172dbec11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-63.ec2.internal,UID:ip-10-0-141-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-63.ec2.internal,},FirstTimestamp:2026-07-07 15:40:58.958662673 +0000 UTC m=+0.455523617,LastTimestamp:2026-07-07 15:40:58.958662673 +0000 UTC m=+0.455523617,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-63.ec2.internal,}"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.961331    2570 policy_none.go:49] "None policy: Start"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.961344    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.961354    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:58.963262    2570 policy_none.go:47] "Start"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002515    2570 manager.go:337] "Starting Device Plugin manager"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.002544    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002554    2570 server.go:87] "Starting device plugin registration server"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002770    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002779    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002890    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002988    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.002997    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.007269    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.007309    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.086359    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.087561    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.087595    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.087616    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.087647    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.090379    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.103769    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.104543    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.104567    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.104577    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.104598    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.115268    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.115287    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-63.ec2.internal\": node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.146371    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.188253    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"]
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.188333    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.105704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.189655    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.189683    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.189693    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.192320    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.192434    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.192461    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.193109    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.193120    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.193142    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.193156    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.193127    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.193206    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.195610    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.195630    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.196302    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.196322    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.196337    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.229668    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-63.ec2.internal\" not found" node="ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.234186    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-63.ec2.internal\" not found" node="ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.247154    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.318302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/375c4f29254a72a0dd1dd44cec3d3aa3-config\") pod \"kube-apiserver-proxy-ip-10-0-141-63.ec2.internal\" (UID: \"375c4f29254a72a0dd1dd44cec3d3aa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.318332    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bb3e0823befaba9d5a1d2f76adade9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal\" (UID: \"4bb3e0823befaba9d5a1d2f76adade9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:40:59.318353    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bb3e0823befaba9d5a1d2f76adade9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal\" (UID: \"4bb3e0823befaba9d5a1d2f76adade9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:40:59.347416    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.106588 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.780566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bb3e0823befaba9d5a1d2f76adade9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal\" (UID: \"4bb3e0823befaba9d5a1d2f76adade9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.780620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bb3e0823befaba9d5a1d2f76adade9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal\" (UID: \"4bb3e0823befaba9d5a1d2f76adade9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.780626    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bb3e0823befaba9d5a1d2f76adade9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal\" (UID: \"4bb3e0823befaba9d5a1d2f76adade9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.780638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/375c4f29254a72a0dd1dd44cec3d3aa3-config\") pod \"kube-apiserver-proxy-ip-10-0-141-63.ec2.internal\" (UID: \"375c4f29254a72a0dd1dd44cec3d3aa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.780669    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/375c4f29254a72a0dd1dd44cec3d3aa3-config\") pod \"kube-apiserver-proxy-ip-10-0-141-63.ec2.internal\" (UID: \"375c4f29254a72a0dd1dd44cec3d3aa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.780676    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bb3e0823befaba9d5a1d2f76adade9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal\" (UID: \"4bb3e0823befaba9d5a1d2f76adade9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:00.809678    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.894167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:00.898372    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:00.911454    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.107194 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.012170    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.115020 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.114993    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.205528 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.205502    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 15:41:01.205699 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.205679    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:41:01.215807 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.215786    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.316678 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.316648    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.321198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.321181    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:41:01.321314 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.321286    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:36:00 +0000 UTC" deadline="2028-03-28 03:24:37.193047398 +0000 UTC"
Jul 07 15:41:01.321362 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.321317    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15107h43m35.871734583s"
Jul 07 15:41:01.417253 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.417148    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.517652 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.517608    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.618161 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.618131    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.675253 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:01.675206    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb3e0823befaba9d5a1d2f76adade9d.slice/crio-ec134689a211d0843a7070e2ac0280239af353d7ad9a8d6c8cd536ca2f554b20 WatchSource:0}: Error finding container ec134689a211d0843a7070e2ac0280239af353d7ad9a8d6c8cd536ca2f554b20: Status 404 returned error can't find the container with id ec134689a211d0843a7070e2ac0280239af353d7ad9a8d6c8cd536ca2f554b20
Jul 07 15:41:01.676246 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:01.676208    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375c4f29254a72a0dd1dd44cec3d3aa3.slice/crio-ae500f621f9fea23e3a1ff7c66dfe2fef1885847640617ecbc6ef50e4ccc0292 WatchSource:0}: Error finding container ae500f621f9fea23e3a1ff7c66dfe2fef1885847640617ecbc6ef50e4ccc0292: Status 404 returned error can't find the container with id ae500f621f9fea23e3a1ff7c66dfe2fef1885847640617ecbc6ef50e4ccc0292
Jul 07 15:41:01.679952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.679938    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:41:01.719035 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.718995    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.819723 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:01.819692    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-63.ec2.internal\" not found"
Jul 07 15:41:01.835423 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.835398    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:41:01.837257 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.837222    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:41:01.878568 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.878537    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.898134 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.898106    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:41:01.898865 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.898852    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal"
Jul 07 15:41:01.919690 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:01.919626    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:41:02.254250 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.254144    2570 apiserver.go:52] "Watching apiserver"
Jul 07 15:41:02.263017 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.262978    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 15:41:02.263459 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.263429    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-ml7bn","openshift-dns/node-resolver-gcxcp","openshift-image-registry/node-ca-q2x98","openshift-multus/multus-pw9f6","openshift-network-operator/iptables-alerter-qmvqn","openshift-ovn-kubernetes/ovnkube-node-bxhmn","kube-system/global-pull-secret-syncer-swpt5","kube-system/konnectivity-agent-php6p","kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal","openshift-multus/multus-additional-cni-plugins-gztdv","openshift-multus/network-metrics-daemon-hcvvl","openshift-network-diagnostics/network-check-target-vr4ds","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"]
Jul 07 15:41:02.266129 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.266110    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.266264 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.266191    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:02.268293 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.268263    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:02.268401 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.268340    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:02.270936 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.270651    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.273064 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.273041    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.275300 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.275279    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.275524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.275406    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 15:41:02.275524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.275483    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.276151 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.276131    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 15:41:02.277717 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.276618    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.277717 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.276907    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.277717 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.277122    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 15:41:02.277717 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.277374    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.277717 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.277574    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w2mgr\""
Jul 07 15:41:02.278008 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.277780    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.278548 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.278441    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 15:41:02.281492 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.280493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.282752 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.282734    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.285071 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.285043    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.287507 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.287486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.288536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.288378    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.288536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.288390    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.289633 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289591    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fsrlh\""
Jul 07 15:41:02.289633 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289628    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 15:41:02.289790 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289714    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 15:41:02.289846 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289789    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c9ppb\""
Jul 07 15:41:02.289846 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/031402b1-7a34-420b-8afa-88d831420552-cni-binary-copy\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.289945 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-multus-certs\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.289945 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289874    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ngnsj\""
Jul 07 15:41:02.289945 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289875    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-cnibin\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.289945 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-os-release\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.289945 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-socket-dir-parent\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.290174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.289961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c492a17c-710d-4cec-b100-d0f09baa601c-iptables-alerter-script\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.290174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-slash\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f011a4e0-4069-4314-be2a-2e478fd09df6-ovn-node-metrics-cert\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290083    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.290174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-device-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.290174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290152    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290176    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-ovnkube-config\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a0277e1-1f50-4b00-9d93-8e9465792701-serviceca\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-kubelet\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290285    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztpwf\" (UniqueName: \"kubernetes.io/projected/5464af78-c514-4a1f-b35a-c67d534111fb-kube-api-access-ztpwf\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp5sn\" (UniqueName: \"kubernetes.io/projected/f011a4e0-4069-4314-be2a-2e478fd09df6-kube-api-access-jp5sn\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-socket-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-cni-bin\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-run-ovn-kubernetes\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-node-log\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290481    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-etc-kubernetes\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290504    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-systemd-units\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.290524 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-systemd\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290554    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0524fef0-1941-4668-a60a-168f43fd6802-dbus\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-hostroot\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290610    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l66r5\" (UniqueName: \"kubernetes.io/projected/031402b1-7a34-420b-8afa-88d831420552-kube-api-access-l66r5\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-kubelet\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-ovn\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-env-overrides\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-ovnkube-script-lib\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-k8s-cni-cncf-io\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfc6x\" (UniqueName: \"kubernetes.io/projected/c492a17c-710d-4cec-b100-d0f09baa601c-kube-api-access-zfc6x\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-var-lib-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-etc-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290850    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-cni-netd\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-netns\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290899    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-cni-bin\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290921    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/031402b1-7a34-420b-8afa-88d831420552-multus-daemon-config\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-run-netns\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.290993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-system-cni-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c492a17c-710d-4cec-b100-d0f09baa601c-host-slash\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a0277e1-1f50-4b00-9d93-8e9465792701-host\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnbvv\" (UniqueName: \"kubernetes.io/projected/3a0277e1-1f50-4b00-9d93-8e9465792701-kube-api-access-xnbvv\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-cni-multus\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-conf-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291204    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291228    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-cni-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-registration-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.291819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-sys-fs\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.292304 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291313    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-log-socket\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.292304 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291349    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0524fef0-1941-4668-a60a-168f43fd6802-kubelet-config\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.292304 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.291401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.293000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.292980    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:02.293085 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.293048    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:02.295147 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.295127    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 15:41:02.299798 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.299759    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.299894 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.299801    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 15:41:02.300410 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.300389    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 15:41:02.300499 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.300433    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.301344 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.300648    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.301344 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.300943    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 15:41:02.301344 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.301002    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.301519 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.301400    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.301519 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.301430    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.301519 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.301505    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.301724    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v9phb\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302056    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gl5qw\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302328    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302355    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302366    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kcq7p\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302327    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302627    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302646    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g9mmh\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302682    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n9wxm\""
Jul 07 15:41:02.302837 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.302701    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 15:41:02.313868 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.313840    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:41:02.347243 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.347203    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k8v9t"
Jul 07 15:41:02.363116 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.363083    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k8v9t"
Jul 07 15:41:02.380946 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.380429    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 15:41:02.392435 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392401    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-run-ovn-kubernetes\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392473    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-kubernetes\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-node-log\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysconfig\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392590    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-os-release\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392619    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw5s8\" (UniqueName: \"kubernetes.io/projected/215b79d3-981f-428a-b75b-eb8cf9b21111-kube-api-access-fw5s8\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.392644 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-etc-kubernetes\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-systemd-units\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-systemd\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0524fef0-1941-4668-a60a-168f43fd6802-dbus\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-lib-modules\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-hostroot\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l66r5\" (UniqueName: \"kubernetes.io/projected/031402b1-7a34-420b-8afa-88d831420552-kube-api-access-l66r5\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-kubelet\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.392926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-ovn\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393185 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.392930    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-env-overrides\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393185 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-ovnkube-script-lib\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393185 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393094    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fafb7153-061f-4be5-86d1-35708af2b3f6-tmp\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.393185 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-k8s-cni-cncf-io\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfc6x\" (UniqueName: \"kubernetes.io/projected/c492a17c-710d-4cec-b100-d0f09baa601c-kube-api-access-zfc6x\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-var-lib-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-etc-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-cni-netd\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393332    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c254\" (UniqueName: \"kubernetes.io/projected/e27c8f9f-600f-4ea0-97f8-83725093bf13-kube-api-access-6c254\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393342    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-cni-netd\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-netns\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393464    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-kubelet\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393471    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-etc-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393474    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-run-ovn-kubernetes\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393519    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-hostroot\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393529    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-etc-kubernetes\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393565    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-k8s-cni-cncf-io\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-cni-bin\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/031402b1-7a34-420b-8afa-88d831420552-multus-daemon-config\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-run-netns\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.393712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-host\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shw6\" (UniqueName: \"kubernetes.io/projected/448dbf99-118f-4db1-a41b-e6949048f4e1-kube-api-access-9shw6\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-system-cni-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c492a17c-710d-4cec-b100-d0f09baa601c-host-slash\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393820    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a0277e1-1f50-4b00-9d93-8e9465792701-host\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnbvv\" (UniqueName: \"kubernetes.io/projected/3a0277e1-1f50-4b00-9d93-8e9465792701-kube-api-access-xnbvv\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-var-lib-kubelet\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.393997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3078b8c-641a-4fe7-a940-22ed21b23009-agent-certs\") pod \"konnectivity-agent-php6p\" (UID: \"c3078b8c-641a-4fe7-a940-22ed21b23009\") " pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-cni-multus\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-conf-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394105    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-system-cni-dir\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394111    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-ovnkube-script-lib\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-cni-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394183    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-registration-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-sys-fs\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394216    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-env-overrides\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-log-socket\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394300    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-ovn\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0524fef0-1941-4668-a60a-168f43fd6802-kubelet-config\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394338    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-var-lib-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysctl-d\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394445    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-systemd-units\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394502    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-netns\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.394870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394507    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-registration-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394511    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-system-cni-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394528    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-systemd\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394539    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c492a17c-710d-4cec-b100-d0f09baa601c-host-slash\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394556    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-cni-bin\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394575    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-sys-fs\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394577    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-run-openvswitch\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394607    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a0277e1-1f50-4b00-9d93-8e9465792701-host\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394622    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-log-socket\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394649    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-cni-multus\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394670    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0524fef0-1941-4668-a60a-168f43fd6802-kubelet-config\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394683    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-conf-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394723    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394794    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394851    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0524fef0-1941-4668-a60a-168f43fd6802-dbus\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.395540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394859    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-cni-dir\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-node-log\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-cnibin\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394923    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-run-netns\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-cni-binary-copy\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394943    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/031402b1-7a34-420b-8afa-88d831420552-multus-daemon-config\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.394964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-modprobe-d\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/215b79d3-981f-428a-b75b-eb8cf9b21111-tmp-dir\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/031402b1-7a34-420b-8afa-88d831420552-cni-binary-copy\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-multus-certs\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysctl-conf\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395208    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-tuned\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-cnibin\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-os-release\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396256 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-socket-dir-parent\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c492a17c-710d-4cec-b100-d0f09baa601c-iptables-alerter-script\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-slash\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f011a4e0-4069-4314-be2a-2e478fd09df6-ovn-node-metrics-cert\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395468    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-device-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395519    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/031402b1-7a34-420b-8afa-88d831420552-cni-binary-copy\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-ovnkube-config\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-systemd\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395584    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-multus-socket-dir-parent\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-run\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395688    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/215b79d3-981f-428a-b75b-eb8cf9b21111-hosts-file\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.395700    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:02.396904 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.395803    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:02.895768977 +0000 UTC m=+3.031194842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3078b8c-641a-4fe7-a940-22ed21b23009-konnectivity-ca\") pod \"konnectivity-agent-php6p\" (UID: \"c3078b8c-641a-4fe7-a940-22ed21b23009\") " pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.395975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a0277e1-1f50-4b00-9d93-8e9465792701-serviceca\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396005    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-kubelet\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztpwf\" (UniqueName: \"kubernetes.io/projected/5464af78-c514-4a1f-b35a-c67d534111fb-kube-api-access-ztpwf\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp5sn\" (UniqueName: \"kubernetes.io/projected/f011a4e0-4069-4314-be2a-2e478fd09df6-kube-api-access-jp5sn\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-sys\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396204    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c492a17c-710d-4cec-b100-d0f09baa601c-iptables-alerter-script\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-socket-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-cni-bin\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjrj\" (UniqueName: \"kubernetes.io/projected/fafb7153-061f-4be5-86d1-35708af2b3f6-kube-api-access-xxjrj\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396339    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-socket-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396409    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-run-multus-certs\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.397584 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396459    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-cnibin\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396514    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-os-release\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396560    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-slash\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396739    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a0277e1-1f50-4b00-9d93-8e9465792701-serviceca\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396805    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f011a4e0-4069-4314-be2a-2e478fd09df6-host-cni-bin\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396806    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/031402b1-7a34-420b-8afa-88d831420552-host-var-lib-kubelet\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.396860    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5464af78-c514-4a1f-b35a-c67d534111fb-device-dir\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.397307    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 15:41:02.398313 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.397492    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f011a4e0-4069-4314-be2a-2e478fd09df6-ovnkube-config\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.402204 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.402170    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f011a4e0-4069-4314-be2a-2e478fd09df6-ovn-node-metrics-cert\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.410746 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.410249    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l66r5\" (UniqueName: \"kubernetes.io/projected/031402b1-7a34-420b-8afa-88d831420552-kube-api-access-l66r5\") pod \"multus-pw9f6\" (UID: \"031402b1-7a34-420b-8afa-88d831420552\") " pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.411695 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.411420    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:02.411695 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.411447    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:02.411695 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.411461    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:02.411695 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.411528    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:41:02.91150874 +0000 UTC m=+3.046934600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:02.413225 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.413199    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfc6x\" (UniqueName: \"kubernetes.io/projected/c492a17c-710d-4cec-b100-d0f09baa601c-kube-api-access-zfc6x\") pod \"iptables-alerter-qmvqn\" (UID: \"c492a17c-710d-4cec-b100-d0f09baa601c\") " pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.416192 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.416157    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp5sn\" (UniqueName: \"kubernetes.io/projected/f011a4e0-4069-4314-be2a-2e478fd09df6-kube-api-access-jp5sn\") pod \"ovnkube-node-bxhmn\" (UID: \"f011a4e0-4069-4314-be2a-2e478fd09df6\") " pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.418247 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.418204    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztpwf\" (UniqueName: \"kubernetes.io/projected/5464af78-c514-4a1f-b35a-c67d534111fb-kube-api-access-ztpwf\") pod \"aws-ebs-csi-driver-node-4hlc9\" (UID: \"5464af78-c514-4a1f-b35a-c67d534111fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.420563 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.420505    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnbvv\" (UniqueName: \"kubernetes.io/projected/3a0277e1-1f50-4b00-9d93-8e9465792701-kube-api-access-xnbvv\") pod \"node-ca-q2x98\" (UID: \"3a0277e1-1f50-4b00-9d93-8e9465792701\") " pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.455413 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.455352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal" event={"ID":"375c4f29254a72a0dd1dd44cec3d3aa3","Type":"ContainerStarted","Data":"ae500f621f9fea23e3a1ff7c66dfe2fef1885847640617ecbc6ef50e4ccc0292"}
Jul 07 15:41:02.457341 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.457304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal" event={"ID":"4bb3e0823befaba9d5a1d2f76adade9d","Type":"ContainerStarted","Data":"ec134689a211d0843a7070e2ac0280239af353d7ad9a8d6c8cd536ca2f554b20"}
Jul 07 15:41:02.497035 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.496997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysconfig\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.497200 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-os-release\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.497300 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw5s8\" (UniqueName: \"kubernetes.io/projected/215b79d3-981f-428a-b75b-eb8cf9b21111-kube-api-access-fw5s8\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-lib-modules\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fafb7153-061f-4be5-86d1-35708af2b3f6-tmp\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c254\" (UniqueName: \"kubernetes.io/projected/e27c8f9f-600f-4ea0-97f8-83725093bf13-kube-api-access-6c254\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-host\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497821    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shw6\" (UniqueName: \"kubernetes.io/projected/448dbf99-118f-4db1-a41b-e6949048f4e1-kube-api-access-9shw6\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-var-lib-kubelet\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.498086    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysconfig\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.498173    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-os-release\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.498330    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-lib-modules\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.498608    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-host\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.498673    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-var-lib-kubelet\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.498763    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:02.500302 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.498829    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:02.998801429 +0000 UTC m=+3.134227274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.497900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3078b8c-641a-4fe7-a940-22ed21b23009-agent-certs\") pod \"konnectivity-agent-php6p\" (UID: \"c3078b8c-641a-4fe7-a940-22ed21b23009\") " pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-system-cni-dir\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysctl-d\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-cnibin\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-cni-binary-copy\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-modprobe-d\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/215b79d3-981f-428a-b75b-eb8cf9b21111-tmp-dir\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499627    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysctl-conf\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-tuned\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-systemd\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-run\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/215b79d3-981f-428a-b75b-eb8cf9b21111-hosts-file\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499745    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3078b8c-641a-4fe7-a940-22ed21b23009-konnectivity-ca\") pod \"konnectivity-agent-php6p\" (UID: \"c3078b8c-641a-4fe7-a940-22ed21b23009\") " pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-sys\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjrj\" (UniqueName: \"kubernetes.io/projected/fafb7153-061f-4be5-86d1-35708af2b3f6-kube-api-access-xxjrj\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-kubernetes\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499907    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-kubernetes\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.499941    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-system-cni-dir\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500498    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500569    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3078b8c-641a-4fe7-a940-22ed21b23009-agent-certs\") pod \"konnectivity-agent-php6p\" (UID: \"c3078b8c-641a-4fe7-a940-22ed21b23009\") " pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500688    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500757    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-systemd\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500816    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-run\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500880    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/215b79d3-981f-428a-b75b-eb8cf9b21111-hosts-file\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.501767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.500954    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e27c8f9f-600f-4ea0-97f8-83725093bf13-cnibin\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.501271    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/215b79d3-981f-428a-b75b-eb8cf9b21111-tmp-dir\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.501396    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-cni-binary-copy\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.501426    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-modprobe-d\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.501546    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysctl-d\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.501570    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-sysctl-conf\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.502037    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fafb7153-061f-4be5-86d1-35708af2b3f6-sys\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.502056    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e27c8f9f-600f-4ea0-97f8-83725093bf13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.502536 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.502162    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3078b8c-641a-4fe7-a940-22ed21b23009-konnectivity-ca\") pod \"konnectivity-agent-php6p\" (UID: \"c3078b8c-641a-4fe7-a940-22ed21b23009\") " pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.504135 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.504043    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fafb7153-061f-4be5-86d1-35708af2b3f6-tmp\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.505123 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.505076    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fafb7153-061f-4be5-86d1-35708af2b3f6-etc-tuned\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.517310 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.517277    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw5s8\" (UniqueName: \"kubernetes.io/projected/215b79d3-981f-428a-b75b-eb8cf9b21111-kube-api-access-fw5s8\") pod \"node-resolver-gcxcp\" (UID: \"215b79d3-981f-428a-b75b-eb8cf9b21111\") " pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.523757 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.523721    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c254\" (UniqueName: \"kubernetes.io/projected/e27c8f9f-600f-4ea0-97f8-83725093bf13-kube-api-access-6c254\") pod \"multus-additional-cni-plugins-gztdv\" (UID: \"e27c8f9f-600f-4ea0-97f8-83725093bf13\") " pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.524013 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.523986    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shw6\" (UniqueName: \"kubernetes.io/projected/448dbf99-118f-4db1-a41b-e6949048f4e1-kube-api-access-9shw6\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:02.524519 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.524470    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjrj\" (UniqueName: \"kubernetes.io/projected/fafb7153-061f-4be5-86d1-35708af2b3f6-kube-api-access-xxjrj\") pod \"tuned-ml7bn\" (UID: \"fafb7153-061f-4be5-86d1-35708af2b3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.585279 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.585245    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q2x98"
Jul 07 15:41:02.594106 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.593899    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pw9f6"
Jul 07 15:41:02.595330 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.595305    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0277e1_1f50_4b00_9d93_8e9465792701.slice/crio-6ea6aead54af7e2a06c65bf1801219bed64d6c719571e0856dba87fb163e71bf WatchSource:0}: Error finding container 6ea6aead54af7e2a06c65bf1801219bed64d6c719571e0856dba87fb163e71bf: Status 404 returned error can't find the container with id 6ea6aead54af7e2a06c65bf1801219bed64d6c719571e0856dba87fb163e71bf
Jul 07 15:41:02.604737 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.604710    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031402b1_7a34_420b_8afa_88d831420552.slice/crio-5c970035611847dabe9ff5a045e353023bdfa999fc0c3fee0da5a9c6945dc29e WatchSource:0}: Error finding container 5c970035611847dabe9ff5a045e353023bdfa999fc0c3fee0da5a9c6945dc29e: Status 404 returned error can't find the container with id 5c970035611847dabe9ff5a045e353023bdfa999fc0c3fee0da5a9c6945dc29e
Jul 07 15:41:02.606815 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.606793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qmvqn"
Jul 07 15:41:02.615431 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.615408    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:02.617325 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.617298    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc492a17c_710d_4cec_b100_d0f09baa601c.slice/crio-3d027b4908d52bb1623f4c507d57214cb22c449f2d367389b2e52ccdbc67f2bf WatchSource:0}: Error finding container 3d027b4908d52bb1623f4c507d57214cb22c449f2d367389b2e52ccdbc67f2bf: Status 404 returned error can't find the container with id 3d027b4908d52bb1623f4c507d57214cb22c449f2d367389b2e52ccdbc67f2bf
Jul 07 15:41:02.623253 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.623216    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9"
Jul 07 15:41:02.625318 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.625291    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf011a4e0_4069_4314_be2a_2e478fd09df6.slice/crio-373902e5a41d87ef050c3ebf81abc6a0961c738b4a5569ceb8fa9a44bb8beb90 WatchSource:0}: Error finding container 373902e5a41d87ef050c3ebf81abc6a0961c738b4a5569ceb8fa9a44bb8beb90: Status 404 returned error can't find the container with id 373902e5a41d87ef050c3ebf81abc6a0961c738b4a5569ceb8fa9a44bb8beb90
Jul 07 15:41:02.631277 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.631056    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ml7bn"
Jul 07 15:41:02.633024 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.632993    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5464af78_c514_4a1f_b35a_c67d534111fb.slice/crio-de08d8c8e4c0939d50ca4079b09a533220767f9f3a3f67c1e36701dc069910e3 WatchSource:0}: Error finding container de08d8c8e4c0939d50ca4079b09a533220767f9f3a3f67c1e36701dc069910e3: Status 404 returned error can't find the container with id de08d8c8e4c0939d50ca4079b09a533220767f9f3a3f67c1e36701dc069910e3
Jul 07 15:41:02.640104 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.640068    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcxcp"
Jul 07 15:41:02.641596 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.641562    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafb7153_061f_4be5_86d1_35708af2b3f6.slice/crio-f7a4c2004eb47e7c2e536d45f7183de8cfd044bc52b8b789d555c8f0373a9661 WatchSource:0}: Error finding container f7a4c2004eb47e7c2e536d45f7183de8cfd044bc52b8b789d555c8f0373a9661: Status 404 returned error can't find the container with id f7a4c2004eb47e7c2e536d45f7183de8cfd044bc52b8b789d555c8f0373a9661
Jul 07 15:41:02.649218 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.649194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:02.651397 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.651369    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215b79d3_981f_428a_b75b_eb8cf9b21111.slice/crio-971fcd879d01bb4403e81178e9d6b057c002c89f961ce0084c5a2ff673e59516 WatchSource:0}: Error finding container 971fcd879d01bb4403e81178e9d6b057c002c89f961ce0084c5a2ff673e59516: Status 404 returned error can't find the container with id 971fcd879d01bb4403e81178e9d6b057c002c89f961ce0084c5a2ff673e59516
Jul 07 15:41:02.655995 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.655974    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gztdv"
Jul 07 15:41:02.659825 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.659791    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3078b8c_641a_4fe7_a940_22ed21b23009.slice/crio-795692416ca2652486aa6260e886a283008f6d8e50e2e586350b7292154d7f2e WatchSource:0}: Error finding container 795692416ca2652486aa6260e886a283008f6d8e50e2e586350b7292154d7f2e: Status 404 returned error can't find the container with id 795692416ca2652486aa6260e886a283008f6d8e50e2e586350b7292154d7f2e
Jul 07 15:41:02.666347 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:02.666322    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27c8f9f_600f_4ea0_97f8_83725093bf13.slice/crio-63a6ec1ddebff7ca5c62313a4428e523313c1eb4b96c94635328f5870aeafad1 WatchSource:0}: Error finding container 63a6ec1ddebff7ca5c62313a4428e523313c1eb4b96c94635328f5870aeafad1: Status 404 returned error can't find the container with id 63a6ec1ddebff7ca5c62313a4428e523313c1eb4b96c94635328f5870aeafad1
Jul 07 15:41:02.771902 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.771645    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:41:02.902557 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:02.902523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:02.902735 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.902710    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:02.902807 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:02.902796    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:03.902774187 +0000 UTC m=+4.038200035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:03.003661 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.003620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:03.003801 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.003692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:03.003801 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.003757    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:03.003801 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.003779    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:03.003801 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.003792    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:03.003801 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.003795    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:03.004017 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.003853    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:41:04.003839446 +0000 UTC m=+4.139265303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:03.004017 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.003873    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:04.003864214 +0000 UTC m=+4.139290071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:03.367892 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.367844    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:36:02 +0000 UTC" deadline="2028-04-01 01:43:00.412739314 +0000 UTC"
Jul 07 15:41:03.367892 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.367882    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15202h1m57.044860794s"
Jul 07 15:41:03.460523 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.460490    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-php6p" event={"ID":"c3078b8c-641a-4fe7-a940-22ed21b23009","Type":"ContainerStarted","Data":"795692416ca2652486aa6260e886a283008f6d8e50e2e586350b7292154d7f2e"}
Jul 07 15:41:03.461650 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.461625    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9" event={"ID":"5464af78-c514-4a1f-b35a-c67d534111fb","Type":"ContainerStarted","Data":"de08d8c8e4c0939d50ca4079b09a533220767f9f3a3f67c1e36701dc069910e3"}
Jul 07 15:41:03.462742 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.462708    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qmvqn" event={"ID":"c492a17c-710d-4cec-b100-d0f09baa601c","Type":"ContainerStarted","Data":"3d027b4908d52bb1623f4c507d57214cb22c449f2d367389b2e52ccdbc67f2bf"}
Jul 07 15:41:03.463777 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.463755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pw9f6" event={"ID":"031402b1-7a34-420b-8afa-88d831420552","Type":"ContainerStarted","Data":"5c970035611847dabe9ff5a045e353023bdfa999fc0c3fee0da5a9c6945dc29e"}
Jul 07 15:41:03.464775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.464753    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q2x98" event={"ID":"3a0277e1-1f50-4b00-9d93-8e9465792701","Type":"ContainerStarted","Data":"6ea6aead54af7e2a06c65bf1801219bed64d6c719571e0856dba87fb163e71bf"}
Jul 07 15:41:03.465721 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.465698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcxcp" event={"ID":"215b79d3-981f-428a-b75b-eb8cf9b21111","Type":"ContainerStarted","Data":"971fcd879d01bb4403e81178e9d6b057c002c89f961ce0084c5a2ff673e59516"}
Jul 07 15:41:03.466746 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.466730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ml7bn" event={"ID":"fafb7153-061f-4be5-86d1-35708af2b3f6","Type":"ContainerStarted","Data":"f7a4c2004eb47e7c2e536d45f7183de8cfd044bc52b8b789d555c8f0373a9661"}
Jul 07 15:41:03.467997 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.467980    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"373902e5a41d87ef050c3ebf81abc6a0961c738b4a5569ceb8fa9a44bb8beb90"}
Jul 07 15:41:03.469040 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.469023    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerStarted","Data":"63a6ec1ddebff7ca5c62313a4428e523313c1eb4b96c94635328f5870aeafad1"}
Jul 07 15:41:03.913557 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:03.913509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:03.913755 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.913737    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:03.913820 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:03.913809    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:05.913790041 +0000 UTC m=+6.049215886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:04.014507 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.014466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:04.014693 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.014535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:04.014693 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.014681    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:04.014794 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.014743    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:06.014724979 +0000 UTC m=+6.150150833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:04.014857 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.014833    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:04.014857 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.014852    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:04.014956 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.014864    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:04.014956 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.014899    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:41:06.014887908 +0000 UTC m=+6.150313754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:04.368847 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.368573    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:36:02 +0000 UTC" deadline="2028-03-20 06:36:42.360630886 +0000 UTC"
Jul 07 15:41:04.368847 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.368848    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14918h55m37.991788225s"
Jul 07 15:41:04.450139 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.450028    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:04.450355 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.450174    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:04.450628 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.450607    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:04.450740 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.450717    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:04.450899 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.450885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:04.451025 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:04.450974    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:04.487423 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.487351    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal" event={"ID":"375c4f29254a72a0dd1dd44cec3d3aa3","Type":"ContainerStarted","Data":"5c2a04145f4b599fd3c8457daa04c0ca636455aca59fec0c2cba21063ab9a9b1"}
Jul 07 15:41:04.519291 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:04.519187    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-63.ec2.internal" podStartSLOduration=3.519166014 podStartE2EDuration="3.519166014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:04.518717213 +0000 UTC m=+4.654143077" watchObservedRunningTime="2026-07-07 15:41:04.519166014 +0000 UTC m=+4.654591878"
Jul 07 15:41:05.498596 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:05.498557    2570 generic.go:356] "Generic (PLEG): container finished" podID="4bb3e0823befaba9d5a1d2f76adade9d" containerID="7b5da307c8f1eb8fdb413c820db23a62d5100a20f3586a53727e6f384fd4d165" exitCode=0
Jul 07 15:41:05.499509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:05.499482    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal" event={"ID":"4bb3e0823befaba9d5a1d2f76adade9d","Type":"ContainerDied","Data":"7b5da307c8f1eb8fdb413c820db23a62d5100a20f3586a53727e6f384fd4d165"}
Jul 07 15:41:05.930822 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:05.930780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:05.931020 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:05.930967    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:05.931096 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:05.931045    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:09.931015799 +0000 UTC m=+10.066441644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:06.031630 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:06.031588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:06.031811 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:06.031657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:06.031868 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.031818    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:06.031915 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.031886    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:10.031867237 +0000 UTC m=+10.167293081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:06.032407 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.032385    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:06.032523 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.032413    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:06.032523 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.032427    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:06.032523 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.032474    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:41:10.032459262 +0000 UTC m=+10.167885108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:06.451549 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:06.451518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:06.451719 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:06.451560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:06.451719 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.451667    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:06.451842 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.451753    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:06.451842 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:06.451805    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:06.451945 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:06.451877    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:08.450071 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:08.450024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:08.450499 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:08.450024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:08.450499 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:08.450168    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:08.450499 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:08.450214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:08.450499 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:08.450322    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:08.450499 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:08.450404    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:09.964050 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:09.964012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:09.964509 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:09.964127    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:09.964509 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:09.964172    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:17.964158568 +0000 UTC m=+18.099584409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:10.065304 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:10.065179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:10.065304 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:10.065258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:10.065550 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.065382    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:10.065550 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.065446    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:18.065425849 +0000 UTC m=+18.200851709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:10.065550 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.065383    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:10.065550 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.065483    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:10.065550 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.065499    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:10.065784 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.065552    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:41:18.065536566 +0000 UTC m=+18.200962427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:10.451302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:10.451213    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:10.451513 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.451459    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:10.452097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:10.452072    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:10.452214 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.452177    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:10.452214 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:10.452205    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:10.452331 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:10.452288    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:12.449381 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:12.449343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:12.449861 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:12.449488    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:12.449932 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:12.449900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:12.449995 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:12.449899    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:12.450049 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:12.450029    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:12.450104 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:12.450059    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:14.450385 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:14.450350    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:14.450892 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:14.450350    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:14.450892 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:14.450478    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:14.450892 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:14.450351    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:14.450892 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:14.450570    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:14.450892 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:14.450642    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:16.450178 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:16.450138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:16.450178 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:16.450173    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:16.450713 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:16.450138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:16.450713 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:16.450303    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:16.450713 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:16.450439    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:16.450713 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:16.450530    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:18.027499 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:18.027460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:18.027973 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.027613    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:18.027973 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.027678    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:34.027662609 +0000 UTC m=+34.163088450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:18.128433 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:18.128394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:18.128629 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:18.128447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:18.128629 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.128588    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:18.128629 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.128608    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:18.128629 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.128629    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:18.128811 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.128639    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:18.128811 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.128649    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:34.128630032 +0000 UTC m=+34.264055888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:18.128811 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.128678    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:41:34.128666944 +0000 UTC m=+34.264092790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:18.449657 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:18.449627    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:18.449657 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:18.449644    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:18.449911 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:18.449628    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:18.449911 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.449756    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:18.449911 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.449839    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:18.450058 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:18.449924    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:20.450579 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:20.450547    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:20.451024 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:20.450661    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:20.451024 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:20.450746    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:20.451024 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:20.450855    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:20.451024 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:20.450908    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:20.451303 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:20.451031    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:22.449672 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.449348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:22.450219 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:22.449731    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:22.450219 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.449427    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:22.450219 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.449373    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:22.450219 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:22.449843    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:22.450219 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:22.449934    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:22.536359 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.536326    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pw9f6" event={"ID":"031402b1-7a34-420b-8afa-88d831420552","Type":"ContainerStarted","Data":"d0fce2c88b9f3cc521a80fe88be5a8d4d4c419407db52510ea90a88360b03fac"}
Jul 07 15:41:22.537983 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.537956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q2x98" event={"ID":"3a0277e1-1f50-4b00-9d93-8e9465792701","Type":"ContainerStarted","Data":"c561022222d5142436d3b48e0e6fa464bd59530d12830c0f4d1d4b2a50907dad"}
Jul 07 15:41:22.540033 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.540010    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal" event={"ID":"4bb3e0823befaba9d5a1d2f76adade9d","Type":"ContainerStarted","Data":"d59fabf14af306da9b0e1b3c74592c7b89d8e5bd4848f63b2054e3bdccd75ce1"}
Jul 07 15:41:22.543683 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.543652    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcxcp" event={"ID":"215b79d3-981f-428a-b75b-eb8cf9b21111","Type":"ContainerStarted","Data":"7f9242067a6557587077ba6426b19ed74f9291fe3c2e64a43b2dd4320b0c7645"}
Jul 07 15:41:22.545102 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.545075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ml7bn" event={"ID":"fafb7153-061f-4be5-86d1-35708af2b3f6","Type":"ContainerStarted","Data":"4b2df33fab931b5ff3f18aee1bab994ccb0d57efe093902a2e26070a6c51a027"}
Jul 07 15:41:22.546571 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.546514    2570 generic.go:356] "Generic (PLEG): container finished" podID="e27c8f9f-600f-4ea0-97f8-83725093bf13" containerID="ee98c14a0c98934663a4e9e6c4c1316c68952daf22baa6ed08f8b5eb4527993e" exitCode=0
Jul 07 15:41:22.546643 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.546604    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerDied","Data":"ee98c14a0c98934663a4e9e6c4c1316c68952daf22baa6ed08f8b5eb4527993e"}
Jul 07 15:41:22.548411 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.548382    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-php6p" event={"ID":"c3078b8c-641a-4fe7-a940-22ed21b23009","Type":"ContainerStarted","Data":"9bcf000f18e9e21a9026db7458b2a090fd3eb950f57de6916f75eb1656cd7f44"}
Jul 07 15:41:22.550035 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.550012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9" event={"ID":"5464af78-c514-4a1f-b35a-c67d534111fb","Type":"ContainerStarted","Data":"dd886649d7264a375c65ce3cd240c4ee306b3ebd28a7f748f7d31aef39637988"}
Jul 07 15:41:22.556819 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.556778    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pw9f6" podStartSLOduration=2.983172628 podStartE2EDuration="22.556765981s" totalImagesPullingTime="19.573593353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:22.556414095 +0000 UTC m=+22.691839958" watchObservedRunningTime="2026-07-07 15:41:22.556765981 +0000 UTC m=+22.692191843"
Jul 07 15:41:22.575419 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.575360    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-63.ec2.internal" podStartSLOduration=21.575333408 podStartE2EDuration="21.575333408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:22.574646312 +0000 UTC m=+22.710072175" watchObservedRunningTime="2026-07-07 15:41:22.575333408 +0000 UTC m=+22.710759273"
Jul 07 15:41:22.592294 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.592211    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q2x98" podStartSLOduration=11.554844757 podStartE2EDuration="22.592188826s" totalImagesPullingTime="11.037344069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:22.591522218 +0000 UTC m=+22.726948077" watchObservedRunningTime="2026-07-07 15:41:22.592188826 +0000 UTC m=+22.727614690"
Jul 07 15:41:22.635208 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.635165    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ml7bn" podStartSLOduration=3.141152651 podStartE2EDuration="22.635150634s" totalImagesPullingTime="19.493997983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:22.611062697 +0000 UTC m=+22.746488560" watchObservedRunningTime="2026-07-07 15:41:22.635150634 +0000 UTC m=+22.770576497"
Jul 07 15:41:22.635339 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.635286    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gcxcp" podStartSLOduration=3.154270033 podStartE2EDuration="22.635279724s" totalImagesPullingTime="19.481009691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:22.634983373 +0000 UTC m=+22.770409235" watchObservedRunningTime="2026-07-07 15:41:22.635279724 +0000 UTC m=+22.770705587"
Jul 07 15:41:22.657839 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:22.657588    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-php6p" podStartSLOduration=3.227943745 podStartE2EDuration="22.6575656s" totalImagesPullingTime="19.429621855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:22.657141279 +0000 UTC m=+22.792567141" watchObservedRunningTime="2026-07-07 15:41:22.6575656 +0000 UTC m=+22.792991464"
Jul 07 15:41:23.556135 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.555879    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"d819db394eb8b037433fbeb6d88131d2334fc845f00ea8fd5090980fe475c58f"}
Jul 07 15:41:23.556947 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.556222    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"1e73ce06527f2a53c92679c34dd852fbee8affd03aad6284051acb43bbc974ca"}
Jul 07 15:41:23.556947 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.556297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"5eb1f24bf8511695bda04fec16dfb1af3e0bbcf52a2a50fcf438971524d8c72e"}
Jul 07 15:41:23.556947 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.556333    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"b7f7cc07dc775c4d9583bbd9ffdc6711c2bb49f7b64ef8f4a59e459df8cc7729"}
Jul 07 15:41:23.556947 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.556366    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"ba76ef197e52d09b3b5e5e450a9c71a388e64cb72a1af2b6b1b3f6776558b493"}
Jul 07 15:41:23.556947 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.556403    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"2e76f653031bd165cd26c2d3f679d4d63a1811d09f8778bfbf991dcb465cf6ff"}
Jul 07 15:41:23.557667 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.557640    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qmvqn" event={"ID":"c492a17c-710d-4cec-b100-d0f09baa601c","Type":"ContainerStarted","Data":"f0860115df011b2706a91bb7135ed25d4b216730ef60d94b42f270d9b3cb5d78"}
Jul 07 15:41:23.582863 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.582810    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qmvqn" podStartSLOduration=4.067651827 podStartE2EDuration="23.582791441s" totalImagesPullingTime="19.515139614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:23.582545928 +0000 UTC m=+23.717971788" watchObservedRunningTime="2026-07-07 15:41:23.582791441 +0000 UTC m=+23.718217303"
Jul 07 15:41:23.933341 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:23.933311    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 15:41:24.376469 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.376364    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:41:23.933332717Z","UUID":"d2c2fe50-aa4d-40ce-bbdd-2ee13efe2e40","Handler":null,"Name":"","Endpoint":""}
Jul 07 15:41:24.378115 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.378092    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 15:41:24.378265 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.378139    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 15:41:24.449713 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.449682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:24.449897 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.449685    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:24.449897 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:24.449814    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:24.449897 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.449829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:24.450029 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:24.449922    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:24.450029 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:24.450010    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:24.562299 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:24.562262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9" event={"ID":"5464af78-c514-4a1f-b35a-c67d534111fb","Type":"ContainerStarted","Data":"e32cefa5e144562cf3c1e543f473bc9510a968d907b9199bb479dd1f6219c45c"}
Jul 07 15:41:25.478170 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:25.478091    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:25.478944 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:25.478921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:25.564140 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:25.564106    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:25.564649 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:25.564615    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-php6p"
Jul 07 15:41:26.450358 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:26.450093    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:26.450542 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:26.450124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:26.450542 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:26.450463    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:26.450542 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:26.450143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:26.450761 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:26.450587    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:26.450761 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:26.450635    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:27.570551 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:27.570468    2570 generic.go:356] "Generic (PLEG): container finished" podID="e27c8f9f-600f-4ea0-97f8-83725093bf13" containerID="aa2769e4d969d6b3282377fdeb2bf78669c9ad73202c4ba55996fb5d8a386a0d" exitCode=0
Jul 07 15:41:27.571352 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:27.570558    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerDied","Data":"aa2769e4d969d6b3282377fdeb2bf78669c9ad73202c4ba55996fb5d8a386a0d"}
Jul 07 15:41:27.572858 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:27.572833    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9" event={"ID":"5464af78-c514-4a1f-b35a-c67d534111fb","Type":"ContainerStarted","Data":"0e76ce35b3e277c06d1504605845fc73ae1c2296a2218a61380da2461a65ce1b"}
Jul 07 15:41:27.576146 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:27.576121    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"34ef4ebe2af9bda46c9f111d487db8595611a393853a7b403f82ebee7a503c0e"}
Jul 07 15:41:27.627070 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:27.627020    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hlc9" podStartSLOduration=3.534119064 podStartE2EDuration="27.627005074s" totalImagesPullingTime="24.09288601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:27.626751378 +0000 UTC m=+27.762177241" watchObservedRunningTime="2026-07-07 15:41:27.627005074 +0000 UTC m=+27.762430938"
Jul 07 15:41:28.449616 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:28.449582    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:28.449858 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:28.449587    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:28.449858 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:28.449700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:28.449858 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:28.449698    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:28.449858 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:28.449786    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:28.449858 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:28.449843    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:29.584770 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:29.584540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" event={"ID":"f011a4e0-4069-4314-be2a-2e478fd09df6","Type":"ContainerStarted","Data":"a015f6686af3b662c98530a845a3bb0ce63918d17654db174152b214802d46b3"}
Jul 07 15:41:29.585390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:29.584840    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:29.586903 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:29.586870    2570 generic.go:356] "Generic (PLEG): container finished" podID="e27c8f9f-600f-4ea0-97f8-83725093bf13" containerID="0d7c936661731845a68f295447ea50a56d3d0e660d3abd3a43f83a4275d53496" exitCode=0
Jul 07 15:41:29.587011 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:29.586928    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerDied","Data":"0d7c936661731845a68f295447ea50a56d3d0e660d3abd3a43f83a4275d53496"}
Jul 07 15:41:29.600954 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:29.600929    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:29.624725 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:29.624671    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn" podStartSLOduration=9.797571946 podStartE2EDuration="29.624656414s" totalImagesPullingTime="19.827084468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:29.623051738 +0000 UTC m=+29.758477600" watchObservedRunningTime="2026-07-07 15:41:29.624656414 +0000 UTC m=+29.760082278"
Jul 07 15:41:30.430486 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.430453    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:30.452926 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.452903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:30.453038 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.452998    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:30.453038 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.453009    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:30.453212 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:30.452993    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:30.453212 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:30.453094    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:30.453212 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:30.453188    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:30.592841 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.592806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerStarted","Data":"25160aa74855f32b41c10e9445fc71b36322af3e169702a55bc4a4dda5e667ef"}
Jul 07 15:41:30.593479 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.593438    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:30.609764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:30.609740    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:41:31.316456 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.316221    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vr4ds"]
Jul 07 15:41:31.316606 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.316549    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:31.316659 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:31.316638    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:31.323907 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.321750    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-swpt5"]
Jul 07 15:41:31.323907 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.321927    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:31.323907 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:31.322062    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:31.324461 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.324436    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hcvvl"]
Jul 07 15:41:31.324573 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.324560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:31.325010 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:31.324984    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:31.597781 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.597750    2570 generic.go:356] "Generic (PLEG): container finished" podID="e27c8f9f-600f-4ea0-97f8-83725093bf13" containerID="25160aa74855f32b41c10e9445fc71b36322af3e169702a55bc4a4dda5e667ef" exitCode=0
Jul 07 15:41:31.598171 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:31.597830    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerDied","Data":"25160aa74855f32b41c10e9445fc71b36322af3e169702a55bc4a4dda5e667ef"}
Jul 07 15:41:33.449893 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:33.449857    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:33.450451 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:33.449899    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:33.450451 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:33.449899    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:33.450451 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:33.449970    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-swpt5" podUID="0524fef0-1941-4668-a60a-168f43fd6802"
Jul 07 15:41:33.450451 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:33.450077    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr4ds" podUID="22827ac4-e9de-4125-9364-737fd6a6034c"
Jul 07 15:41:33.450451 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:33.450165    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcvvl" podUID="448dbf99-118f-4db1-a41b-e6949048f4e1"
Jul 07 15:41:34.040434 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:34.040390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:34.040861 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.040565    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:34.040861 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.040638    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret podName:0524fef0-1941-4668-a60a-168f43fd6802 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:06.040615231 +0000 UTC m=+66.176041072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret") pod "global-pull-secret-syncer-swpt5" (UID: "0524fef0-1941-4668-a60a-168f43fd6802") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:41:34.141682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:34.141646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:34.141682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:34.141691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:34.141936 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.141798    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:34.141936 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.141837    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:41:34.141936 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.141859    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:06.141840957 +0000 UTC m=+66.277266800 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:41:34.141936 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.141861    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:41:34.141936 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.141875    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kcm7k for pod openshift-network-diagnostics/network-check-target-vr4ds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:34.141936 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:34.141928    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k podName:22827ac4-e9de-4125-9364-737fd6a6034c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:06.141915272 +0000 UTC m=+66.277341112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcm7k" (UniqueName: "kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k") pod "network-check-target-vr4ds" (UID: "22827ac4-e9de-4125-9364-737fd6a6034c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:41:35.163787 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.163758    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-63.ec2.internal" event="NodeReady"
Jul 07 15:41:35.164398 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.163906    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 15:41:35.214946 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.214914    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d5db9c7bd-68rfh"]
Jul 07 15:41:35.220103 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.220071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.223138 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.223115    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 15:41:35.223299 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.223157    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 15:41:35.223415 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.223400    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 15:41:35.223630 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.223580    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bxv9m\""
Jul 07 15:41:35.230869 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.230004    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 15:41:35.231170 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.231152    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d5db9c7bd-68rfh"]
Jul 07 15:41:35.245896 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.245871    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fl9q7"]
Jul 07 15:41:35.249893 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.249868    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.252289 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.252266    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w75vl\""
Jul 07 15:41:35.252399 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.252268    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 15:41:35.252670 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.252653    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 15:41:35.260884 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.260721    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fl9q7"]
Jul 07 15:41:35.302496 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.302465    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-md92w"]
Jul 07 15:41:35.306329 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.306308    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.308939 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.308918    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 15:41:35.309050 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.308920    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q5k6l\""
Jul 07 15:41:35.309050 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.309029    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 15:41:35.309270 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.309253    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 15:41:35.316502 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.316481    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-md92w"]
Jul 07 15:41:35.349777 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349744    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b3b134-c678-4bce-84ba-07631be5f5b4-tmp-dir\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.349777 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-bound-sa-token\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b3b134-c678-4bce-84ba-07631be5f5b4-config-volume\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.350000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-certificates\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349924    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-trusted-ca\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-installation-pull-secrets\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbh8\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-kube-api-access-fbbh8\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350000 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.349998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-image-registry-private-configuration\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350265 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.350025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350265 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.350085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-ca-trust-extracted\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.350265 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.350113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.350265 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.350163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t824j\" (UniqueName: \"kubernetes.io/projected/b4b3b134-c678-4bce-84ba-07631be5f5b4-kube-api-access-t824j\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.449997 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.449914    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:41:35.450165 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450032    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:41:35.450165 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450072    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:41:35.450541 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtlq\" (UniqueName: \"kubernetes.io/projected/ac675709-090a-4b96-b262-f35e168df417-kube-api-access-rwtlq\") pod \"ingress-canary-md92w\" (UID: \"ac675709-090a-4b96-b262-f35e168df417\") " pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.450646 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b3b134-c678-4bce-84ba-07631be5f5b4-config-volume\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.450646 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-certificates\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450750 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-trusted-ca\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450750 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-installation-pull-secrets\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450750 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbh8\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-kube-api-access-fbbh8\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450750 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-image-registry-private-configuration\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac675709-090a-4b96-b262-f35e168df417-cert\") pod \"ingress-canary-md92w\" (UID: \"ac675709-090a-4b96-b262-f35e168df417\") " pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450814    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-ca-trust-extracted\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450870    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t824j\" (UniqueName: \"kubernetes.io/projected/b4b3b134-c678-4bce-84ba-07631be5f5b4-kube-api-access-t824j\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b3b134-c678-4bce-84ba-07631be5f5b4-tmp-dir\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.450952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.450949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-bound-sa-token\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.451309 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.451126    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4b3b134-c678-4bce-84ba-07631be5f5b4-config-volume\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.451309 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.451222    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-certificates\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.451309 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.451226    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:41:35.451453 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.451337    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls podName:b4b3b134-c678-4bce-84ba-07631be5f5b4 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:35.951318422 +0000 UTC m=+36.086744267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls") pod "dns-default-fl9q7" (UID: "b4b3b134-c678-4bce-84ba-07631be5f5b4") : secret "dns-default-metrics-tls" not found
Jul 07 15:41:35.451515 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.451498    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:41:35.451515 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.451513    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d5db9c7bd-68rfh: secret "image-registry-tls" not found
Jul 07 15:41:35.451609 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.451576    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls podName:42225cf4-5fa1-4f4f-9277-e8e56aa8d892 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:35.951558682 +0000 UTC m=+36.086984537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls") pod "image-registry-7d5db9c7bd-68rfh" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892") : secret "image-registry-tls" not found
Jul 07 15:41:35.451669 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.451634    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b3b134-c678-4bce-84ba-07631be5f5b4-tmp-dir\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.451907 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.451881    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-ca-trust-extracted\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.452362 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.452151    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-trusted-ca\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.453196 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.453179    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:41:35.453315 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.453297    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k55hz\""
Jul 07 15:41:35.454034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.453658    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:41:35.454034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.453752    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:41:35.454034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.453851    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:41:35.454034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.453932    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2q2r\""
Jul 07 15:41:35.455812 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.455790    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-image-registry-private-configuration\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.455912 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.455805    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-installation-pull-secrets\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.466372 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.466158    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t824j\" (UniqueName: \"kubernetes.io/projected/b4b3b134-c678-4bce-84ba-07631be5f5b4-kube-api-access-t824j\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.468103 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.468083    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-bound-sa-token\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.468205 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.468169    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbh8\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-kube-api-access-fbbh8\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.552149 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.552105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtlq\" (UniqueName: \"kubernetes.io/projected/ac675709-090a-4b96-b262-f35e168df417-kube-api-access-rwtlq\") pod \"ingress-canary-md92w\" (UID: \"ac675709-090a-4b96-b262-f35e168df417\") " pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.552360 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.552221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac675709-090a-4b96-b262-f35e168df417-cert\") pod \"ingress-canary-md92w\" (UID: \"ac675709-090a-4b96-b262-f35e168df417\") " pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.555067 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.555036    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac675709-090a-4b96-b262-f35e168df417-cert\") pod \"ingress-canary-md92w\" (UID: \"ac675709-090a-4b96-b262-f35e168df417\") " pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.564706 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.564678    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtlq\" (UniqueName: \"kubernetes.io/projected/ac675709-090a-4b96-b262-f35e168df417-kube-api-access-rwtlq\") pod \"ingress-canary-md92w\" (UID: \"ac675709-090a-4b96-b262-f35e168df417\") " pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.616058 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.616021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-md92w"
Jul 07 15:41:35.889399 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.889192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-md92w"]
Jul 07 15:41:35.893544 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:35.893518    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac675709_090a_4b96_b262_f35e168df417.slice/crio-c47f9abae7768760ecc62550d6226c603db3f4f825066620b7919a6ec38f403f WatchSource:0}: Error finding container c47f9abae7768760ecc62550d6226c603db3f4f825066620b7919a6ec38f403f: Status 404 returned error can't find the container with id c47f9abae7768760ecc62550d6226c603db3f4f825066620b7919a6ec38f403f
Jul 07 15:41:35.956107 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.956067    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:35.956190 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:35.956140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:35.956250 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.956216    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:41:35.956250 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.956246    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d5db9c7bd-68rfh: secret "image-registry-tls" not found
Jul 07 15:41:35.956360 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.956304    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls podName:42225cf4-5fa1-4f4f-9277-e8e56aa8d892 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:36.956289597 +0000 UTC m=+37.091715439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls") pod "image-registry-7d5db9c7bd-68rfh" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892") : secret "image-registry-tls" not found
Jul 07 15:41:35.956360 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.956314    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:41:35.956450 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:35.956388    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls podName:b4b3b134-c678-4bce-84ba-07631be5f5b4 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:36.956369797 +0000 UTC m=+37.091795644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls") pod "dns-default-fl9q7" (UID: "b4b3b134-c678-4bce-84ba-07631be5f5b4") : secret "dns-default-metrics-tls" not found
Jul 07 15:41:36.612812 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:36.612775    2570 generic.go:356] "Generic (PLEG): container finished" podID="e27c8f9f-600f-4ea0-97f8-83725093bf13" containerID="756fd574c5ee52c58e369ffa9c671806e9c841f4e14bb4a50c916c8d0d3d8ac7" exitCode=0
Jul 07 15:41:36.613424 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:36.612856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerDied","Data":"756fd574c5ee52c58e369ffa9c671806e9c841f4e14bb4a50c916c8d0d3d8ac7"}
Jul 07 15:41:36.614472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:36.614431    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-md92w" event={"ID":"ac675709-090a-4b96-b262-f35e168df417","Type":"ContainerStarted","Data":"c47f9abae7768760ecc62550d6226c603db3f4f825066620b7919a6ec38f403f"}
Jul 07 15:41:36.964943 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:36.964857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:36.964943 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:36.964914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:36.965162 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:36.965026    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:41:36.965162 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:36.965047    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d5db9c7bd-68rfh: secret "image-registry-tls" not found
Jul 07 15:41:36.965162 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:36.965090    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:41:36.965162 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:36.965119    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls podName:42225cf4-5fa1-4f4f-9277-e8e56aa8d892 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:38.965099665 +0000 UTC m=+39.100525521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls") pod "image-registry-7d5db9c7bd-68rfh" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892") : secret "image-registry-tls" not found
Jul 07 15:41:36.965162 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:36.965140    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls podName:b4b3b134-c678-4bce-84ba-07631be5f5b4 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:38.965127885 +0000 UTC m=+39.100553760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls") pod "dns-default-fl9q7" (UID: "b4b3b134-c678-4bce-84ba-07631be5f5b4") : secret "dns-default-metrics-tls" not found
Jul 07 15:41:37.620552 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:37.620481    2570 generic.go:356] "Generic (PLEG): container finished" podID="e27c8f9f-600f-4ea0-97f8-83725093bf13" containerID="1c9f1ff7d25496bf90b11ea9914c52fbadb0ae615e903c08796a969608cdb789" exitCode=0
Jul 07 15:41:37.621071 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:37.620572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerDied","Data":"1c9f1ff7d25496bf90b11ea9914c52fbadb0ae615e903c08796a969608cdb789"}
Jul 07 15:41:38.624705 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:38.624455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-md92w" event={"ID":"ac675709-090a-4b96-b262-f35e168df417","Type":"ContainerStarted","Data":"3b6ce369a526d89aae6ccbd010df9fa74975ffa5262682839de0984b8f422654"}
Jul 07 15:41:38.627579 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:38.627554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gztdv" event={"ID":"e27c8f9f-600f-4ea0-97f8-83725093bf13","Type":"ContainerStarted","Data":"cf8a75e0ee6df442450b124d928c326e65cfa0d7ded8c707975d107d4526dde8"}
Jul 07 15:41:38.654845 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:38.654794    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-md92w" podStartSLOduration=1.198662315 podStartE2EDuration="3.65477582s" totalImagesPullingTime="2.456113505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:38.654536648 +0000 UTC m=+38.789962512" watchObservedRunningTime="2026-07-07 15:41:38.65477582 +0000 UTC m=+38.790201686"
Jul 07 15:41:38.684162 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:38.684105    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gztdv" podStartSLOduration=8.274681997 podStartE2EDuration="38.6840629s" totalImagesPullingTime="30.409380903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:38.682120272 +0000 UTC m=+38.817546138" watchObservedRunningTime="2026-07-07 15:41:38.6840629 +0000 UTC m=+38.819488764"
Jul 07 15:41:38.982844 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:38.982810    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:38.983022 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:38.982854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:38.983022 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:38.982969    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:41:38.983022 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:38.983023    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls podName:b4b3b134-c678-4bce-84ba-07631be5f5b4 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:42.983010836 +0000 UTC m=+43.118436678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls") pod "dns-default-fl9q7" (UID: "b4b3b134-c678-4bce-84ba-07631be5f5b4") : secret "dns-default-metrics-tls" not found
Jul 07 15:41:38.983125 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:38.982973    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:41:38.983125 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:38.983060    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d5db9c7bd-68rfh: secret "image-registry-tls" not found
Jul 07 15:41:38.983125 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:38.983116    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls podName:42225cf4-5fa1-4f4f-9277-e8e56aa8d892 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:42.983103348 +0000 UTC m=+43.118529193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls") pod "image-registry-7d5db9c7bd-68rfh" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892") : secret "image-registry-tls" not found
Jul 07 15:41:39.755478 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.755444    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"]
Jul 07 15:41:39.788595 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.788549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"]
Jul 07 15:41:39.788735 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.788619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.791099 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.791079    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 15:41:39.792130 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.792115    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 15:41:39.792431 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.792416    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nhjgh\""
Jul 07 15:41:39.793295 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.793275    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 15:41:39.793374 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.793278    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 15:41:39.890031 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.889996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/501c8998-d6be-4933-93cd-191bdb0bdc73-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.890031 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.890033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.890272 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.890055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhwx8\" (UniqueName: \"kubernetes.io/projected/501c8998-d6be-4933-93cd-191bdb0bdc73-kube-api-access-bhwx8\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.990641 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.990608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/501c8998-d6be-4933-93cd-191bdb0bdc73-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.990641 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.990643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.990822 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.990664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhwx8\" (UniqueName: \"kubernetes.io/projected/501c8998-d6be-4933-93cd-191bdb0bdc73-kube-api-access-bhwx8\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:39.990822 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:39.990784    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:39.990887 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:39.990854    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls podName:501c8998-d6be-4933-93cd-191bdb0bdc73 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:40.490835581 +0000 UTC m=+40.626261427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q7s74" (UID: "501c8998-d6be-4933-93cd-191bdb0bdc73") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:39.991347 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:39.991329    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/501c8998-d6be-4933-93cd-191bdb0bdc73-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:40.001492 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:40.001461    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhwx8\" (UniqueName: \"kubernetes.io/projected/501c8998-d6be-4933-93cd-191bdb0bdc73-kube-api-access-bhwx8\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:40.495390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:40.495355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:40.495553 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:40.495512    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:40.495590 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:40.495582    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls podName:501c8998-d6be-4933-93cd-191bdb0bdc73 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:41.495566845 +0000 UTC m=+41.630992685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q7s74" (UID: "501c8998-d6be-4933-93cd-191bdb0bdc73") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:41.502638 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:41.502595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:41.503175 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:41.502756    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:41.503175 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:41.502821    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls podName:501c8998-d6be-4933-93cd-191bdb0bdc73 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:43.50280608 +0000 UTC m=+43.638231921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q7s74" (UID: "501c8998-d6be-4933-93cd-191bdb0bdc73") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:43.013883 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:43.013843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:43.014226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:43.013944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:43.014226 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.014001    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:41:43.014226 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.014065    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls podName:b4b3b134-c678-4bce-84ba-07631be5f5b4 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:51.01404997 +0000 UTC m=+51.149475823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls") pod "dns-default-fl9q7" (UID: "b4b3b134-c678-4bce-84ba-07631be5f5b4") : secret "dns-default-metrics-tls" not found
Jul 07 15:41:43.014226 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.014070    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:41:43.014226 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.014087    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d5db9c7bd-68rfh: secret "image-registry-tls" not found
Jul 07 15:41:43.014226 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.014128    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls podName:42225cf4-5fa1-4f4f-9277-e8e56aa8d892 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:51.014117361 +0000 UTC m=+51.149543206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls") pod "image-registry-7d5db9c7bd-68rfh" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892") : secret "image-registry-tls" not found
Jul 07 15:41:43.517997 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:43.517954    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:43.518153 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.518072    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:43.518153 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:43.518125    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls podName:501c8998-d6be-4933-93cd-191bdb0bdc73 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:47.518112453 +0000 UTC m=+47.653538294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q7s74" (UID: "501c8998-d6be-4933-93cd-191bdb0bdc73") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:44.809032 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.808999    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-45qcb"]
Jul 07 15:41:44.832611 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.832586    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45qcb"]
Jul 07 15:41:44.832736 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.832698    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:44.835161 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.835132    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 15:41:44.835161 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.835132    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 15:41:44.836008 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.835962    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4xbb9\""
Jul 07 15:41:44.836008 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.836005    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 15:41:44.836174 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.836005    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 15:41:44.928446 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.928407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-crio-socket\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:44.928446 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.928447    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:44.928657 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.928469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-data-volume\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:44.928657 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.928578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:44.928657 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:44.928612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-api-access-4zswn\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029350 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-crio-socket\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-data-volume\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029443    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-api-access-4zswn\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029509 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.029483    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:45.029691 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.029540    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:41:45.029691 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.029556    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:45.529537333 +0000 UTC m=+45.664963175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:45.029691 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029559    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-crio-socket\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.029691 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.029641    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:45.52962404 +0000 UTC m=+45.665049887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : configmap "kube-rbac-proxy" not found
Jul 07 15:41:45.029827 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.029782    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-data-volume\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.042807 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.042786    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zswn\" (UniqueName: \"kubernetes.io/projected/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-api-access-4zswn\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.534102 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.534065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.534331 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:45.534130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:45.534331 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.534195    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:41:45.534331 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.534254    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:45.534331 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.534271    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:46.534257192 +0000 UTC m=+46.669683033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : configmap "kube-rbac-proxy" not found
Jul 07 15:41:45.534331 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:45.534317    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:46.534298339 +0000 UTC m=+46.669724197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:46.205718 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:46.205688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcxcp_215b79d3-981f-428a-b75b-eb8cf9b21111/dns-node-resolver/0.log"
Jul 07 15:41:46.543246 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:46.543150    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:46.543377 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:46.543261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:46.543377 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:46.543285    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:41:46.543377 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:46.543352    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:48.543337579 +0000 UTC m=+48.678763419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : configmap "kube-rbac-proxy" not found
Jul 07 15:41:46.543504 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:46.543379    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:46.543504 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:46.543425    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:48.543411194 +0000 UTC m=+48.678837052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:47.206299 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:47.206271    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q2x98_3a0277e1-1f50-4b00-9d93-8e9465792701/node-ca/0.log"
Jul 07 15:41:47.551780 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:47.551700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:47.551922 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:47.551849    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:47.551922 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:47.551917    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls podName:501c8998-d6be-4933-93cd-191bdb0bdc73 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:55.551900089 +0000 UTC m=+55.687325952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q7s74" (UID: "501c8998-d6be-4933-93cd-191bdb0bdc73") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:47.801683 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:47.801650    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-md92w_ac675709-090a-4b96-b262-f35e168df417/serve-healthcheck-canary/0.log"
Jul 07 15:41:48.558744 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:48.558706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:48.559141 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:48.558841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:48.559141 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:48.558851    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:48.559141 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:48.558915    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:52.558900298 +0000 UTC m=+52.694326162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:48.559141 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:48.558923    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:41:48.559141 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:48.558961    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:41:52.558950326 +0000 UTC m=+52.694376193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : configmap "kube-rbac-proxy" not found
Jul 07 15:41:49.658849 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.658814    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"]
Jul 07 15:41:49.678518 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.678493    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"]
Jul 07 15:41:49.678652 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.678597    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.681289 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.681265    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 15:41:49.681392 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.681315    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 15:41:49.682164 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.682147    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:41:49.682164 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.682154    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 15:41:49.682350 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.682176    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qjgrn\""
Jul 07 15:41:49.761931 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.761896    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"]
Jul 07 15:41:49.776895 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.776859    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"]
Jul 07 15:41:49.777063 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.776987    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"
Jul 07 15:41:49.779442 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.779418    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:41:49.779563 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.779418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ngf6l\""
Jul 07 15:41:49.779563 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.779430    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 15:41:49.789341 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.789320    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"]
Jul 07 15:41:49.789341 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.789350    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"]
Jul 07 15:41:49.789495 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.789432    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:49.791820 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.791798    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 15:41:49.791959 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.791875    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:41:49.792034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.791959    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 15:41:49.792296 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.792229    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-75t84\""
Jul 07 15:41:49.869362 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.869325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssw9\" (UniqueName: \"kubernetes.io/projected/c073b469-e22d-49db-af2b-1d52543bdfe5-kube-api-access-2ssw9\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.869552 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.869385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c073b469-e22d-49db-af2b-1d52543bdfe5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.869552 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.869478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c073b469-e22d-49db-af2b-1d52543bdfe5-config\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.970472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.970391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssw9\" (UniqueName: \"kubernetes.io/projected/c073b469-e22d-49db-af2b-1d52543bdfe5-kube-api-access-2ssw9\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.970472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.970435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c073b469-e22d-49db-af2b-1d52543bdfe5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.970472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.970459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c073b469-e22d-49db-af2b-1d52543bdfe5-config\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.970687 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.970511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8ssx\" (UniqueName: \"kubernetes.io/projected/6b067879-6093-44c7-a149-d7e81fb97482-kube-api-access-d8ssx\") pod \"volume-data-source-validator-5d456fdbcd-tlddv\" (UID: \"6b067879-6093-44c7-a149-d7e81fb97482\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"
Jul 07 15:41:49.970687 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.970529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjsn2\" (UniqueName: \"kubernetes.io/projected/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-kube-api-access-vjsn2\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:49.970687 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.970670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:49.971163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.971128    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c073b469-e22d-49db-af2b-1d52543bdfe5-config\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.972785 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.972757    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c073b469-e22d-49db-af2b-1d52543bdfe5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.979212 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.979183    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssw9\" (UniqueName: \"kubernetes.io/projected/c073b469-e22d-49db-af2b-1d52543bdfe5-kube-api-access-2ssw9\") pod \"service-ca-operator-5d46d9ffd4-qnqc4\" (UID: \"c073b469-e22d-49db-af2b-1d52543bdfe5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:49.988099 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:49.988080    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"
Jul 07 15:41:50.071727 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.071694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8ssx\" (UniqueName: \"kubernetes.io/projected/6b067879-6093-44c7-a149-d7e81fb97482-kube-api-access-d8ssx\") pod \"volume-data-source-validator-5d456fdbcd-tlddv\" (UID: \"6b067879-6093-44c7-a149-d7e81fb97482\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"
Jul 07 15:41:50.071884 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.071738    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjsn2\" (UniqueName: \"kubernetes.io/projected/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-kube-api-access-vjsn2\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:50.071884 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.071823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:50.072065 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:50.072048    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:41:50.072131 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:50.072117    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls podName:12614454-dfe2-4a47-9b1b-6c14ba3bffb1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:50.572097456 +0000 UTC m=+50.707523315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7n4dv" (UID: "12614454-dfe2-4a47-9b1b-6c14ba3bffb1") : secret "samples-operator-tls" not found
Jul 07 15:41:50.084480 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.084414    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjsn2\" (UniqueName: \"kubernetes.io/projected/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-kube-api-access-vjsn2\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:50.084480 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.084451    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8ssx\" (UniqueName: \"kubernetes.io/projected/6b067879-6093-44c7-a149-d7e81fb97482-kube-api-access-d8ssx\") pod \"volume-data-source-validator-5d456fdbcd-tlddv\" (UID: \"6b067879-6093-44c7-a149-d7e81fb97482\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"
Jul 07 15:41:50.087082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.087069    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"
Jul 07 15:41:50.130912 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.130883    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4"]
Jul 07 15:41:50.134384 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:50.134358    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc073b469_e22d_49db_af2b_1d52543bdfe5.slice/crio-e8a558efd1085cb378b5342928b64c0fc57c1a15bb1b51af45f53b7c5d86a029 WatchSource:0}: Error finding container e8a558efd1085cb378b5342928b64c0fc57c1a15bb1b51af45f53b7c5d86a029: Status 404 returned error can't find the container with id e8a558efd1085cb378b5342928b64c0fc57c1a15bb1b51af45f53b7c5d86a029
Jul 07 15:41:50.250026 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.249954    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv"]
Jul 07 15:41:50.253098 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:50.253073    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b067879_6093_44c7_a149_d7e81fb97482.slice/crio-a0b4e4a2fbb4c6ca13b9ad3543bf181245e4843f04322a2cf2fee883bcb0997a WatchSource:0}: Error finding container a0b4e4a2fbb4c6ca13b9ad3543bf181245e4843f04322a2cf2fee883bcb0997a: Status 404 returned error can't find the container with id a0b4e4a2fbb4c6ca13b9ad3543bf181245e4843f04322a2cf2fee883bcb0997a
Jul 07 15:41:50.576025 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.575946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:50.576161 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:50.576098    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:41:50.576202 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:50.576164    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls podName:12614454-dfe2-4a47-9b1b-6c14ba3bffb1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:51.576149073 +0000 UTC m=+51.711574914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7n4dv" (UID: "12614454-dfe2-4a47-9b1b-6c14ba3bffb1") : secret "samples-operator-tls" not found
Jul 07 15:41:50.655099 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.655064    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv" event={"ID":"6b067879-6093-44c7-a149-d7e81fb97482","Type":"ContainerStarted","Data":"a0b4e4a2fbb4c6ca13b9ad3543bf181245e4843f04322a2cf2fee883bcb0997a"}
Jul 07 15:41:50.656097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:50.656069    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4" event={"ID":"c073b469-e22d-49db-af2b-1d52543bdfe5","Type":"ContainerStarted","Data":"e8a558efd1085cb378b5342928b64c0fc57c1a15bb1b51af45f53b7c5d86a029"}
Jul 07 15:41:51.080002 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:51.079960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:41:51.080481 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:51.080020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:41:51.080481 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.080137    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:41:51.080481 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.080162    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d5db9c7bd-68rfh: secret "image-registry-tls" not found
Jul 07 15:41:51.080481 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.080229    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls podName:42225cf4-5fa1-4f4f-9277-e8e56aa8d892 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:07.080209724 +0000 UTC m=+67.215635588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls") pod "image-registry-7d5db9c7bd-68rfh" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892") : secret "image-registry-tls" not found
Jul 07 15:41:51.080481 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.080252    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:41:51.080481 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.080318    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls podName:b4b3b134-c678-4bce-84ba-07631be5f5b4 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:07.080300305 +0000 UTC m=+67.215726146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls") pod "dns-default-fl9q7" (UID: "b4b3b134-c678-4bce-84ba-07631be5f5b4") : secret "dns-default-metrics-tls" not found
Jul 07 15:41:51.583994 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:51.583960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:51.584188 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.584105    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:41:51.584188 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:51.584169    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls podName:12614454-dfe2-4a47-9b1b-6c14ba3bffb1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:53.584154894 +0000 UTC m=+53.719580735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7n4dv" (UID: "12614454-dfe2-4a47-9b1b-6c14ba3bffb1") : secret "samples-operator-tls" not found
Jul 07 15:41:52.592595 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:52.592550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:52.592996 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:52.592621    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:52.592996 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:52.592770    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:52.592996 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:52.592850    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:42:00.592829497 +0000 UTC m=+60.728255358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:41:52.593180 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:52.593158    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:41:52.662248 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:52.662200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv" event={"ID":"6b067879-6093-44c7-a149-d7e81fb97482","Type":"ContainerStarted","Data":"fe7f6b3fc3f1299e0c40f009d7cd6391aa04bd0f2267275f7db4bd7148167a7c"}
Jul 07 15:41:52.684771 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:52.684724    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlddv" podStartSLOduration=2.162572953 podStartE2EDuration="3.684708925s" totalImagesPullingTime="1.522135972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:52.684121814 +0000 UTC m=+52.819547728" watchObservedRunningTime="2026-07-07 15:41:52.684708925 +0000 UTC m=+52.820134817"
Jul 07 15:41:53.601762 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:53.601735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:53.602066 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:53.601874    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:41:53.602066 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:53.601933    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls podName:12614454-dfe2-4a47-9b1b-6c14ba3bffb1 nodeName:}" failed. No retries permitted until 2026-07-07 15:41:57.601917964 +0000 UTC m=+57.737343805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7n4dv" (UID: "12614454-dfe2-4a47-9b1b-6c14ba3bffb1") : secret "samples-operator-tls" not found
Jul 07 15:41:53.666805 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:53.666771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4" event={"ID":"c073b469-e22d-49db-af2b-1d52543bdfe5","Type":"ContainerStarted","Data":"e838bf8838eea2fd4f931f48c0f18d074414d04fcf8880932f5f2de402a272b6"}
Jul 07 15:41:53.686931 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:53.686852    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4" podStartSLOduration=1.285453735 podStartE2EDuration="4.686836584s" totalImagesPullingTime="3.401382849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:53.686165725 +0000 UTC m=+53.821591587" watchObservedRunningTime="2026-07-07 15:41:53.686836584 +0000 UTC m=+53.822262446"
Jul 07 15:41:55.616758 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:55.616713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:41:55.617282 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:55.616845    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:55.617282 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:55.616907    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls podName:501c8998-d6be-4933-93cd-191bdb0bdc73 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:11.616891602 +0000 UTC m=+71.752317443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q7s74" (UID: "501c8998-d6be-4933-93cd-191bdb0bdc73") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:41:57.384048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.384015    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m66pk"]
Jul 07 15:41:57.386245 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.386214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.388639 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.388617    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 15:41:57.388775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.388683    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 15:41:57.388775 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.388754    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 15:41:57.389669 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.389649    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 15:41:57.389746 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.389649    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9vggt\""
Jul 07 15:41:57.400287 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.400263    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m66pk"]
Jul 07 15:41:57.428803 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.428776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b89846d-a75a-4196-9127-d150811f8727-signing-key\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.428953 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.428807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b89846d-a75a-4196-9127-d150811f8727-signing-cabundle\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.428953 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.428839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26hqt\" (UniqueName: \"kubernetes.io/projected/8b89846d-a75a-4196-9127-d150811f8727-kube-api-access-26hqt\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.529545 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.529513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b89846d-a75a-4196-9127-d150811f8727-signing-key\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.529545 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.529546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b89846d-a75a-4196-9127-d150811f8727-signing-cabundle\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.529707 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.529577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26hqt\" (UniqueName: \"kubernetes.io/projected/8b89846d-a75a-4196-9127-d150811f8727-kube-api-access-26hqt\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.530390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.530370    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b89846d-a75a-4196-9127-d150811f8727-signing-cabundle\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.532064 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.532040    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b89846d-a75a-4196-9127-d150811f8727-signing-key\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.538509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.538486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26hqt\" (UniqueName: \"kubernetes.io/projected/8b89846d-a75a-4196-9127-d150811f8727-kube-api-access-26hqt\") pod \"service-ca-758f599c5-m66pk\" (UID: \"8b89846d-a75a-4196-9127-d150811f8727\") " pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.630749 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.630699    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:41:57.630925 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:57.630846    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 15:41:57.630925 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:41:57.630912    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls podName:12614454-dfe2-4a47-9b1b-6c14ba3bffb1 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:05.630894094 +0000 UTC m=+65.766319958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7n4dv" (UID: "12614454-dfe2-4a47-9b1b-6c14ba3bffb1") : secret "samples-operator-tls" not found
Jul 07 15:41:57.695452 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.695374    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-m66pk"
Jul 07 15:41:57.815574 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:57.815540    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m66pk"]
Jul 07 15:41:57.818678 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:41:57.818652    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b89846d_a75a_4196_9127_d150811f8727.slice/crio-c2b0fd6b8c56f80dc4f68c863c8f60b6c8b1f90f4aa7fa4a698c988132d19838 WatchSource:0}: Error finding container c2b0fd6b8c56f80dc4f68c863c8f60b6c8b1f90f4aa7fa4a698c988132d19838: Status 404 returned error can't find the container with id c2b0fd6b8c56f80dc4f68c863c8f60b6c8b1f90f4aa7fa4a698c988132d19838
Jul 07 15:41:58.684440 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:58.684397    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-m66pk" event={"ID":"8b89846d-a75a-4196-9127-d150811f8727","Type":"ContainerStarted","Data":"2186de953c4ed25614be025a8f3446bed79b65ec0e94090b7b5366943434c0fc"}
Jul 07 15:41:58.684824 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:58.684493    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-m66pk" event={"ID":"8b89846d-a75a-4196-9127-d150811f8727","Type":"ContainerStarted","Data":"c2b0fd6b8c56f80dc4f68c863c8f60b6c8b1f90f4aa7fa4a698c988132d19838"}
Jul 07 15:41:58.704420 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:41:58.704173    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-m66pk" podStartSLOduration=1.704155456 podStartE2EDuration="1.704155456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:58.703903457 +0000 UTC m=+58.839329322" watchObservedRunningTime="2026-07-07 15:41:58.704155456 +0000 UTC m=+58.839581320"
Jul 07 15:42:00.656781 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:00.656734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:42:00.657251 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:42:00.656878    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:42:00.657251 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:42:00.656945    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls podName:3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb nodeName:}" failed. No retries permitted until 2026-07-07 15:42:16.656929051 +0000 UTC m=+76.792354891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45qcb" (UID: "3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:42:02.610605 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:02.610572    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bxhmn"
Jul 07 15:42:05.699307 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:05.699268    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:42:05.702087 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:05.702064    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12614454-dfe2-4a47-9b1b-6c14ba3bffb1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7n4dv\" (UID: \"12614454-dfe2-4a47-9b1b-6c14ba3bffb1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:42:06.000595 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.000508    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-75t84\""
Jul 07 15:42:06.008273 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.008222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"
Jul 07 15:42:06.102907 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.102523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:42:06.105424 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.105402    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:42:06.115599 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.115571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0524fef0-1941-4668-a60a-168f43fd6802-original-pull-secret\") pod \"global-pull-secret-syncer-swpt5\" (UID: \"0524fef0-1941-4668-a60a-168f43fd6802\") " pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:42:06.141149 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.141116    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv"]
Jul 07 15:42:06.203261 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.203212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:42:06.203459 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.203300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:42:06.206066 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.206046    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:42:06.206599 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.206586    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:42:06.213794 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:42:06.213775    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:42:06.213890 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:42:06.213867    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs podName:448dbf99-118f-4db1-a41b-e6949048f4e1 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:10.213838946 +0000 UTC m=+130.349264789 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs") pod "network-metrics-daemon-hcvvl" (UID: "448dbf99-118f-4db1-a41b-e6949048f4e1") : secret "metrics-daemon-secret" not found
Jul 07 15:42:06.216155 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.216138    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:42:06.226167 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.226142    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcm7k\" (UniqueName: \"kubernetes.io/projected/22827ac4-e9de-4125-9364-737fd6a6034c-kube-api-access-kcm7k\") pod \"network-check-target-vr4ds\" (UID: \"22827ac4-e9de-4125-9364-737fd6a6034c\") " pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:42:06.385040 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.385012    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k55hz\""
Jul 07 15:42:06.389125 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.389103    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-swpt5"
Jul 07 15:42:06.392883 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.392864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:42:06.530796 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.530753    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vr4ds"]
Jul 07 15:42:06.533909 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:06.533878    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22827ac4_e9de_4125_9364_737fd6a6034c.slice/crio-c67f69038575df8c8e7dff4ede383acaacb9842e624758a33f556d7ec4147fe4 WatchSource:0}: Error finding container c67f69038575df8c8e7dff4ede383acaacb9842e624758a33f556d7ec4147fe4: Status 404 returned error can't find the container with id c67f69038575df8c8e7dff4ede383acaacb9842e624758a33f556d7ec4147fe4
Jul 07 15:42:06.546010 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.545984    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-swpt5"]
Jul 07 15:42:06.548875 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:06.548847    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0524fef0_1941_4668_a60a_168f43fd6802.slice/crio-3c3322302b2efe902685bc94e33b7a96956fde80d818a3f0bc85558581f6a228 WatchSource:0}: Error finding container 3c3322302b2efe902685bc94e33b7a96956fde80d818a3f0bc85558581f6a228: Status 404 returned error can't find the container with id 3c3322302b2efe902685bc94e33b7a96956fde80d818a3f0bc85558581f6a228
Jul 07 15:42:06.706334 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.706214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vr4ds" event={"ID":"22827ac4-e9de-4125-9364-737fd6a6034c","Type":"ContainerStarted","Data":"c67f69038575df8c8e7dff4ede383acaacb9842e624758a33f556d7ec4147fe4"}
Jul 07 15:42:06.707788 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.707755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-swpt5" event={"ID":"0524fef0-1941-4668-a60a-168f43fd6802","Type":"ContainerStarted","Data":"3c3322302b2efe902685bc94e33b7a96956fde80d818a3f0bc85558581f6a228"}
Jul 07 15:42:06.708962 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:06.708936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv" event={"ID":"12614454-dfe2-4a47-9b1b-6c14ba3bffb1","Type":"ContainerStarted","Data":"7c35bc6d03dcb51eb9bd851c1c6eecd4808ac0e5c992a06f97ec41b91a5acc4f"}
Jul 07 15:42:07.111218 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.111186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:42:07.111218 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.111224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:42:07.114955 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.114643    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"image-registry-7d5db9c7bd-68rfh\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") " pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:42:07.116511 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.116479    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4b3b134-c678-4bce-84ba-07631be5f5b4-metrics-tls\") pod \"dns-default-fl9q7\" (UID: \"b4b3b134-c678-4bce-84ba-07631be5f5b4\") " pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:42:07.336436 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.336399    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bxv9m\""
Jul 07 15:42:07.344138 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.344107    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:42:07.362408 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.362338    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w75vl\""
Jul 07 15:42:07.369986 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.369955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:42:07.525635 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.525592    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d5db9c7bd-68rfh"]
Jul 07 15:42:07.529541 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:07.529504    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42225cf4_5fa1_4f4f_9277_e8e56aa8d892.slice/crio-04c77d70c764467693e11ff3dca71313356f1e350fba69f0c2ebc966c780bb21 WatchSource:0}: Error finding container 04c77d70c764467693e11ff3dca71313356f1e350fba69f0c2ebc966c780bb21: Status 404 returned error can't find the container with id 04c77d70c764467693e11ff3dca71313356f1e350fba69f0c2ebc966c780bb21
Jul 07 15:42:07.552303 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.552135    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fl9q7"]
Jul 07 15:42:07.713849 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:07.713766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" event={"ID":"42225cf4-5fa1-4f4f-9277-e8e56aa8d892","Type":"ContainerStarted","Data":"04c77d70c764467693e11ff3dca71313356f1e350fba69f0c2ebc966c780bb21"}
Jul 07 15:42:08.140634 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:08.140590    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3b134_c678_4bce_84ba_07631be5f5b4.slice/crio-657881a54b8eb813c380765bba036c500172c9eac6f581b073f9ef0e0ac362ba WatchSource:0}: Error finding container 657881a54b8eb813c380765bba036c500172c9eac6f581b073f9ef0e0ac362ba: Status 404 returned error can't find the container with id 657881a54b8eb813c380765bba036c500172c9eac6f581b073f9ef0e0ac362ba
Jul 07 15:42:08.720580 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:08.720474    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" event={"ID":"42225cf4-5fa1-4f4f-9277-e8e56aa8d892","Type":"ContainerStarted","Data":"d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559"}
Jul 07 15:42:08.721034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:08.720674    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:42:08.722577 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:08.722498    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv" event={"ID":"12614454-dfe2-4a47-9b1b-6c14ba3bffb1","Type":"ContainerStarted","Data":"3a9d20c76ff6501f41861fec1649458a63a1a3e2c35157f2f4675515ffde25f8"}
Jul 07 15:42:08.723899 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:08.723869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fl9q7" event={"ID":"b4b3b134-c678-4bce-84ba-07631be5f5b4","Type":"ContainerStarted","Data":"657881a54b8eb813c380765bba036c500172c9eac6f581b073f9ef0e0ac362ba"}
Jul 07 15:42:08.747683 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:08.747553    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" podStartSLOduration=67.747532333 podStartE2EDuration="1m7.747532333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:08.746081217 +0000 UTC m=+68.881507092" watchObservedRunningTime="2026-07-07 15:42:08.747532333 +0000 UTC m=+68.882958402"
Jul 07 15:42:09.730421 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:09.730345    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv" event={"ID":"12614454-dfe2-4a47-9b1b-6c14ba3bffb1","Type":"ContainerStarted","Data":"a88ae71f18ddadef8ca855661f65f632749d8d6b5b7e042863de4d5d139ee486"}
Jul 07 15:42:09.750329 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:09.750256    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7n4dv" podStartSLOduration=18.459740694 podStartE2EDuration="20.750217399s" totalImagesPullingTime="2.290476705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:09.749750254 +0000 UTC m=+69.885176120" watchObservedRunningTime="2026-07-07 15:42:09.750217399 +0000 UTC m=+69.885643262"
Jul 07 15:42:11.650005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:11.649959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:42:11.652621 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:11.652590    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c8998-d6be-4933-93cd-191bdb0bdc73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q7s74\" (UID: \"501c8998-d6be-4933-93cd-191bdb0bdc73\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:42:11.901184 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:11.901101    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nhjgh\""
Jul 07 15:42:11.908694 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:11.908655    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"
Jul 07 15:42:12.371713 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.371643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74"]
Jul 07 15:42:12.378072 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:12.378006    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501c8998_d6be_4933_93cd_191bdb0bdc73.slice/crio-8e31a5a88995709363c571bf2b5af4c1402f1c7f2cc14cb28d7980a3c1ca65e0 WatchSource:0}: Error finding container 8e31a5a88995709363c571bf2b5af4c1402f1c7f2cc14cb28d7980a3c1ca65e0: Status 404 returned error can't find the container with id 8e31a5a88995709363c571bf2b5af4c1402f1c7f2cc14cb28d7980a3c1ca65e0
Jul 07 15:42:12.743942 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.743902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-swpt5" event={"ID":"0524fef0-1941-4668-a60a-168f43fd6802","Type":"ContainerStarted","Data":"e30f6757d80e411c5a9aea22c94329c89900f70fb4ee3efb9959bef6ff7bec12"}
Jul 07 15:42:12.745759 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.745734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fl9q7" event={"ID":"b4b3b134-c678-4bce-84ba-07631be5f5b4","Type":"ContainerStarted","Data":"b62ed01b9d1a55684702dd1fe9457656623b13ce935805978c5f821aed92f615"}
Jul 07 15:42:12.745894 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.745785    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:42:12.745894 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.745811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fl9q7" event={"ID":"b4b3b134-c678-4bce-84ba-07631be5f5b4","Type":"ContainerStarted","Data":"a745c4c0db4eebaed4fd830acddea9144f33ce334471808a201e25bd78bb63d0"}
Jul 07 15:42:12.747246 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.747205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vr4ds" event={"ID":"22827ac4-e9de-4125-9364-737fd6a6034c","Type":"ContainerStarted","Data":"913e6f8263166b12ee7db6ac83f729c2fd571ce0b48e9b346c09f490cd4cb263"}
Jul 07 15:42:12.747345 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.747320    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:42:12.748294 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.748275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74" event={"ID":"501c8998-d6be-4933-93cd-191bdb0bdc73","Type":"ContainerStarted","Data":"8e31a5a88995709363c571bf2b5af4c1402f1c7f2cc14cb28d7980a3c1ca65e0"}
Jul 07 15:42:12.763991 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.763947    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-swpt5" podStartSLOduration=67.081679346 podStartE2EDuration="1m12.763933795s" totalImagesPullingTime="5.682254449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:12.763294475 +0000 UTC m=+72.898720339" watchObservedRunningTime="2026-07-07 15:42:12.763933795 +0000 UTC m=+72.899359666"
Jul 07 15:42:12.784622 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.784577    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fl9q7" podStartSLOduration=33.708671015 podStartE2EDuration="37.78456172s" totalImagesPullingTime="4.075890705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:12.784211585 +0000 UTC m=+72.919637448" watchObservedRunningTime="2026-07-07 15:42:12.78456172 +0000 UTC m=+72.919987574"
Jul 07 15:42:12.805399 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:12.805350    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vr4ds" podStartSLOduration=67.122682895 podStartE2EDuration="1m12.8053342s" totalImagesPullingTime="5.682651305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:12.804721486 +0000 UTC m=+72.940147340" watchObservedRunningTime="2026-07-07 15:42:12.8053342 +0000 UTC m=+72.940760083"
Jul 07 15:42:14.759120 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:14.759079    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74" event={"ID":"501c8998-d6be-4933-93cd-191bdb0bdc73","Type":"ContainerStarted","Data":"bce7934edc197cf16ad8cb044ae669055c737870caf709f7e8c759daa2d1c5c3"}
Jul 07 15:42:14.782456 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:14.782394    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q7s74" podStartSLOduration=33.50895479 podStartE2EDuration="35.782378233s" totalImagesPullingTime="2.273423443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:14.781928133 +0000 UTC m=+74.917353997" watchObservedRunningTime="2026-07-07 15:42:14.782378233 +0000 UTC m=+74.917804096"
Jul 07 15:42:16.693849 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:16.693808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:42:16.696188 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:16.696163    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45qcb\" (UID: \"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb\") " pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:42:16.944927 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:16.944842    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4xbb9\""
Jul 07 15:42:16.952925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:16.952908    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45qcb"
Jul 07 15:42:17.090606 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:17.090572    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45qcb"]
Jul 07 15:42:17.093543 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:17.093513    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8bbe9a_dde5_44e2_a42d_beb5d623a1cb.slice/crio-8503767f2b9583b74b8473217c1dc22593648fc236b03332fb5ca44130e96fb8 WatchSource:0}: Error finding container 8503767f2b9583b74b8473217c1dc22593648fc236b03332fb5ca44130e96fb8: Status 404 returned error can't find the container with id 8503767f2b9583b74b8473217c1dc22593648fc236b03332fb5ca44130e96fb8
Jul 07 15:42:17.773840 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:17.773752    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45qcb" event={"ID":"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb","Type":"ContainerStarted","Data":"8503767f2b9583b74b8473217c1dc22593648fc236b03332fb5ca44130e96fb8"}
Jul 07 15:42:19.121888 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.121852    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"]
Jul 07 15:42:19.137442 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.137407    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"
Jul 07 15:42:19.152401 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.152369    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m424s\""
Jul 07 15:42:19.164335 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.164299    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"]
Jul 07 15:42:19.168955 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.168927    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"]
Jul 07 15:42:19.169109 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.169040    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.172143 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.172119    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 15:42:19.172310 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.172153    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 15:42:19.172578 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.172553    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 15:42:19.172957 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.172939    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 15:42:19.178388 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.178364    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"]
Jul 07 15:42:19.183185 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.183161    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"]
Jul 07 15:42:19.183347 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.183313    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.186227 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.186206    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sbgpl\""
Jul 07 15:42:19.186984 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.186955    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 15:42:19.194072 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.194049    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"]
Jul 07 15:42:19.209925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.209889    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"]
Jul 07 15:42:19.214597 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.214570    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dqh92"]
Jul 07 15:42:19.214747 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.214723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:19.215533 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.215501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqst\" (UniqueName: \"kubernetes.io/projected/8ebcf947-41e5-4c46-bfe6-02bde7d7e673-kube-api-access-8xqst\") pod \"network-check-source-989f8b8dc-fzwmm\" (UID: \"8ebcf947-41e5-4c46-bfe6-02bde7d7e673\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"
Jul 07 15:42:19.217762 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.217739    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-c5cg8\""
Jul 07 15:42:19.217925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.217865    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 15:42:19.218165 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.218145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:19.220726 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.220707    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7flx2\""
Jul 07 15:42:19.220841 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.220714    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 15:42:19.221253 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.221219    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 15:42:19.231831 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.231800    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"]
Jul 07 15:42:19.244139 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.244108    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dqh92"]
Jul 07 15:42:19.316415 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r48fr\" (UniqueName: \"kubernetes.io/projected/52a12c3a-9620-4341-a854-f40856dfb048-kube-api-access-r48fr\") pod \"downloads-685bfb5f64-dqh92\" (UID: \"52a12c3a-9620-4341-a854-f40856dfb048\") " pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:19.316415 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-tmp\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.316666 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e5e7aa84-da4f-495d-bd50-8d60f27ce157-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-986lp\" (UID: \"e5e7aa84-da4f-495d-bd50-8d60f27ce157\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:19.316666 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s22h\" (UniqueName: \"kubernetes.io/projected/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-kube-api-access-5s22h\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.316666 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqst\" (UniqueName: \"kubernetes.io/projected/8ebcf947-41e5-4c46-bfe6-02bde7d7e673-kube-api-access-8xqst\") pod \"network-check-source-989f8b8dc-fzwmm\" (UID: \"8ebcf947-41e5-4c46-bfe6-02bde7d7e673\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"
Jul 07 15:42:19.316666 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316614    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.316666 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8de75b05-7e5c-48c6-bd7e-b9fc92079d68-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55bffb6958-qw26c\" (UID: \"8de75b05-7e5c-48c6-bd7e-b9fc92079d68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.317065 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.316685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppsss\" (UniqueName: \"kubernetes.io/projected/8de75b05-7e5c-48c6-bd7e-b9fc92079d68-kube-api-access-ppsss\") pod \"managed-serviceaccount-addon-agent-55bffb6958-qw26c\" (UID: \"8de75b05-7e5c-48c6-bd7e-b9fc92079d68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.332138 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.332100    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqst\" (UniqueName: \"kubernetes.io/projected/8ebcf947-41e5-4c46-bfe6-02bde7d7e673-kube-api-access-8xqst\") pod \"network-check-source-989f8b8dc-fzwmm\" (UID: \"8ebcf947-41e5-4c46-bfe6-02bde7d7e673\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"
Jul 07 15:42:19.417781 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.417689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8de75b05-7e5c-48c6-bd7e-b9fc92079d68-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55bffb6958-qw26c\" (UID: \"8de75b05-7e5c-48c6-bd7e-b9fc92079d68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.417781 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.417737    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppsss\" (UniqueName: \"kubernetes.io/projected/8de75b05-7e5c-48c6-bd7e-b9fc92079d68-kube-api-access-ppsss\") pod \"managed-serviceaccount-addon-agent-55bffb6958-qw26c\" (UID: \"8de75b05-7e5c-48c6-bd7e-b9fc92079d68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.417983 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.417784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r48fr\" (UniqueName: \"kubernetes.io/projected/52a12c3a-9620-4341-a854-f40856dfb048-kube-api-access-r48fr\") pod \"downloads-685bfb5f64-dqh92\" (UID: \"52a12c3a-9620-4341-a854-f40856dfb048\") " pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:19.417983 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.417955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-tmp\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.418059 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.418029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e5e7aa84-da4f-495d-bd50-8d60f27ce157-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-986lp\" (UID: \"e5e7aa84-da4f-495d-bd50-8d60f27ce157\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:19.418111 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.418068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s22h\" (UniqueName: \"kubernetes.io/projected/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-kube-api-access-5s22h\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.418160 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.418147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.418444 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.418418    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-tmp\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.420844 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.420812    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e5e7aa84-da4f-495d-bd50-8d60f27ce157-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-986lp\" (UID: \"e5e7aa84-da4f-495d-bd50-8d60f27ce157\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:19.421094 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.421072    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8de75b05-7e5c-48c6-bd7e-b9fc92079d68-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55bffb6958-qw26c\" (UID: \"8de75b05-7e5c-48c6-bd7e-b9fc92079d68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.421193 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.421099    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.429549 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.429501    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r48fr\" (UniqueName: \"kubernetes.io/projected/52a12c3a-9620-4341-a854-f40856dfb048-kube-api-access-r48fr\") pod \"downloads-685bfb5f64-dqh92\" (UID: \"52a12c3a-9620-4341-a854-f40856dfb048\") " pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:19.436714 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.436685    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppsss\" (UniqueName: \"kubernetes.io/projected/8de75b05-7e5c-48c6-bd7e-b9fc92079d68-kube-api-access-ppsss\") pod \"managed-serviceaccount-addon-agent-55bffb6958-qw26c\" (UID: \"8de75b05-7e5c-48c6-bd7e-b9fc92079d68\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.437059 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.437034    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s22h\" (UniqueName: \"kubernetes.io/projected/29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119-kube-api-access-5s22h\") pod \"klusterlet-addon-workmgr-6d4789db84-7xxtw\" (UID: \"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.449350 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.449316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"
Jul 07 15:42:19.482721 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.482681    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:19.499367 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.499340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"
Jul 07 15:42:19.527664 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.527559    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:19.533960 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:19.533929    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:21.018517 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.018483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"]
Jul 07 15:42:21.020804 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:21.020760    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f6f8f7_d9bb_4a46_9bb3_ced65d3a9119.slice/crio-56211e600cb16fb8102d8f77098fb59adf0b5dcfe7325295f0353121c1ea438e WatchSource:0}: Error finding container 56211e600cb16fb8102d8f77098fb59adf0b5dcfe7325295f0353121c1ea438e: Status 404 returned error can't find the container with id 56211e600cb16fb8102d8f77098fb59adf0b5dcfe7325295f0353121c1ea438e
Jul 07 15:42:21.030372 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.030311    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c"]
Jul 07 15:42:21.035209 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:21.035184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8de75b05_7e5c_48c6_bd7e_b9fc92079d68.slice/crio-51d78e1633b6cd9f0ca2dadc7a5222a0fe61ffe5cc30b1a744aabb520a46d7a4 WatchSource:0}: Error finding container 51d78e1633b6cd9f0ca2dadc7a5222a0fe61ffe5cc30b1a744aabb520a46d7a4: Status 404 returned error can't find the container with id 51d78e1633b6cd9f0ca2dadc7a5222a0fe61ffe5cc30b1a744aabb520a46d7a4
Jul 07 15:42:21.263155 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.263133    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm"]
Jul 07 15:42:21.265961 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.265938    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"]
Jul 07 15:42:21.266437 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:21.266413    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebcf947_41e5_4c46_bfe6_02bde7d7e673.slice/crio-d207067270c3179bdeea4253f952a9f1a91e85bb0a4630efd1422ea8f90707e6 WatchSource:0}: Error finding container d207067270c3179bdeea4253f952a9f1a91e85bb0a4630efd1422ea8f90707e6: Status 404 returned error can't find the container with id d207067270c3179bdeea4253f952a9f1a91e85bb0a4630efd1422ea8f90707e6
Jul 07 15:42:21.267071 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.267050    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dqh92"]
Jul 07 15:42:21.268261 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:21.268214    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e7aa84_da4f_495d_bd50_8d60f27ce157.slice/crio-0378836f6023d57bd330f68252220e2a0960be6d31701ffdb8b2f2c36f9a229f WatchSource:0}: Error finding container 0378836f6023d57bd330f68252220e2a0960be6d31701ffdb8b2f2c36f9a229f: Status 404 returned error can't find the container with id 0378836f6023d57bd330f68252220e2a0960be6d31701ffdb8b2f2c36f9a229f
Jul 07 15:42:21.268983 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:21.268950    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a12c3a_9620_4341_a854_f40856dfb048.slice/crio-b06db2a42f2220a9af642d45882004c78bc6285163c0aed9765cd816aa87ffbe WatchSource:0}: Error finding container b06db2a42f2220a9af642d45882004c78bc6285163c0aed9765cd816aa87ffbe: Status 404 returned error can't find the container with id b06db2a42f2220a9af642d45882004c78bc6285163c0aed9765cd816aa87ffbe
Jul 07 15:42:21.798610 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.798532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c" event={"ID":"8de75b05-7e5c-48c6-bd7e-b9fc92079d68","Type":"ContainerStarted","Data":"51d78e1633b6cd9f0ca2dadc7a5222a0fe61ffe5cc30b1a744aabb520a46d7a4"}
Jul 07 15:42:21.805537 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.805339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp" event={"ID":"e5e7aa84-da4f-495d-bd50-8d60f27ce157","Type":"ContainerStarted","Data":"0378836f6023d57bd330f68252220e2a0960be6d31701ffdb8b2f2c36f9a229f"}
Jul 07 15:42:21.807587 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.807505    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dqh92" event={"ID":"52a12c3a-9620-4341-a854-f40856dfb048","Type":"ContainerStarted","Data":"b06db2a42f2220a9af642d45882004c78bc6285163c0aed9765cd816aa87ffbe"}
Jul 07 15:42:21.813864 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.813839    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45qcb" event={"ID":"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb","Type":"ContainerStarted","Data":"d779df4da2a2318aa2ad948a06f421749058096ffee51f5b70773082b11c7fc0"}
Jul 07 15:42:21.813980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.813894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45qcb" event={"ID":"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb","Type":"ContainerStarted","Data":"43d5b0366dbcdf6fdca946e2602061ca0c83422187fbc595e5144d034cd7ab03"}
Jul 07 15:42:21.817258 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.816812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm" event={"ID":"8ebcf947-41e5-4c46-bfe6-02bde7d7e673","Type":"ContainerStarted","Data":"73fab76771d67fb9499daf9f2ecc5e88cbbb6b3987d7c1973b3723bdc8be1142"}
Jul 07 15:42:21.817258 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.816854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm" event={"ID":"8ebcf947-41e5-4c46-bfe6-02bde7d7e673","Type":"ContainerStarted","Data":"d207067270c3179bdeea4253f952a9f1a91e85bb0a4630efd1422ea8f90707e6"}
Jul 07 15:42:21.821307 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:21.821185    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw" event={"ID":"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119","Type":"ContainerStarted","Data":"56211e600cb16fb8102d8f77098fb59adf0b5dcfe7325295f0353121c1ea438e"}
Jul 07 15:42:22.756670 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:22.756220    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fl9q7"
Jul 07 15:42:22.777383 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:22.777229    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-fzwmm" podStartSLOduration=3.777208059 podStartE2EDuration="3.777208059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:21.838221032 +0000 UTC m=+81.973646897" watchObservedRunningTime="2026-07-07 15:42:22.777208059 +0000 UTC m=+82.912633923"
Jul 07 15:42:23.310049 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.309035    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d98cf4d45-gp8hz"]
Jul 07 15:42:23.316672 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.316585    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.321328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.320845    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 15:42:23.321328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.320892    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 15:42:23.321328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.320948    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 15:42:23.321328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.320845    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 15:42:23.321328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.320892    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 15:42:23.321328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.321137    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2ljcb\""
Jul 07 15:42:23.327273 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.327242    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98cf4d45-gp8hz"]
Jul 07 15:42:23.462400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.461995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-service-ca\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.462400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.462053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-oauth-serving-cert\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.462400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.462100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rp47\" (UniqueName: \"kubernetes.io/projected/e17023b7-af0f-4f54-a086-7396e9ff7feb-kube-api-access-2rp47\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.462400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.462182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-config\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.462400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.462251    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-oauth-config\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.462400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.462290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-serving-cert\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.563580 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.563490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-oauth-config\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.563580 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.563549    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-serving-cert\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.563580 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.563579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-service-ca\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.563880 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.563606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-oauth-serving-cert\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.563880 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.563645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rp47\" (UniqueName: \"kubernetes.io/projected/e17023b7-af0f-4f54-a086-7396e9ff7feb-kube-api-access-2rp47\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.563880 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.563716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-config\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.565908 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.564485    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-config\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.565908 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.565472    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-service-ca\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.565908 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.565831    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-oauth-serving-cert\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.568968 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.568944    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-oauth-config\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.571202 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.571162    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-serving-cert\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.582132 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.582098    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rp47\" (UniqueName: \"kubernetes.io/projected/e17023b7-af0f-4f54-a086-7396e9ff7feb-kube-api-access-2rp47\") pod \"console-6d98cf4d45-gp8hz\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") " pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:23.633830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:23.633458    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:27.349128 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.349089    2570 patch_prober.go:28] interesting pod/image-registry-7d5db9c7bd-68rfh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 15:42:27.349520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.349158    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" podUID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 15:42:27.458808 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.458776    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98cf4d45-gp8hz"]
Jul 07 15:42:27.464117 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:27.464088    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17023b7_af0f_4f54_a086_7396e9ff7feb.slice/crio-271688c1f68f3234b05c46c32ffda21b4ab0c5b6d95fc9da94cf67e52c483775 WatchSource:0}: Error finding container 271688c1f68f3234b05c46c32ffda21b4ab0c5b6d95fc9da94cf67e52c483775: Status 404 returned error can't find the container with id 271688c1f68f3234b05c46c32ffda21b4ab0c5b6d95fc9da94cf67e52c483775
Jul 07 15:42:27.871091 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.871028    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c" event={"ID":"8de75b05-7e5c-48c6-bd7e-b9fc92079d68","Type":"ContainerStarted","Data":"10234844f5f7e331d27020fdc1265b993692833fdff6964b610e64ee27738926"}
Jul 07 15:42:27.872905 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.872878    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp" event={"ID":"e5e7aa84-da4f-495d-bd50-8d60f27ce157","Type":"ContainerStarted","Data":"86fdd991aa27888c8f47e8a9477e9710c5117c294a21899811aa721751cceaed"}
Jul 07 15:42:27.873366 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.873341    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:27.876101 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.876073    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45qcb" event={"ID":"3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb","Type":"ContainerStarted","Data":"393158cf590bfeb604a8ae3ecaaef4ed97b5b41acc15a47c627809ddcb5cd6c6"}
Jul 07 15:42:27.877885 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.877859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw" event={"ID":"29f6f8f7-d9bb-4a46-9bb3-ced65d3a9119","Type":"ContainerStarted","Data":"e12b1a5f772edd37835431cbf6555f7fcffd74d591f83537ee4ac415f473ec32"}
Jul 07 15:42:27.878037 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.878006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:27.879473 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.879450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98cf4d45-gp8hz" event={"ID":"e17023b7-af0f-4f54-a086-7396e9ff7feb","Type":"ContainerStarted","Data":"271688c1f68f3234b05c46c32ffda21b4ab0c5b6d95fc9da94cf67e52c483775"}
Jul 07 15:42:27.879791 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.879773    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw"
Jul 07 15:42:27.880069 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.880048    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp"
Jul 07 15:42:27.889984 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.889933    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55bffb6958-qw26c" podStartSLOduration=2.604529968 podStartE2EDuration="8.889916102s" totalImagesPullingTime="6.285386134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:27.888462737 +0000 UTC m=+88.023888601" watchObservedRunningTime="2026-07-07 15:42:27.889916102 +0000 UTC m=+88.025341966"
Jul 07 15:42:27.909478 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.909409    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d4789db84-7xxtw" podStartSLOduration=2.532235807 podStartE2EDuration="8.90938684s" totalImagesPullingTime="6.377151033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:27.909069105 +0000 UTC m=+88.044494969" watchObservedRunningTime="2026-07-07 15:42:27.90938684 +0000 UTC m=+88.044812705"
Jul 07 15:42:27.932276 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.932196    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-45qcb" podStartSLOduration=33.907793167 podStartE2EDuration="43.932173982s" totalImagesPullingTime="10.024380815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:27.930890264 +0000 UTC m=+88.066316129" watchObservedRunningTime="2026-07-07 15:42:27.932173982 +0000 UTC m=+88.067599846"
Jul 07 15:42:27.950520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:27.950464    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-986lp" podStartSLOduration=4.242002718 podStartE2EDuration="8.950446508s" totalImagesPullingTime="4.70844379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:27.949611387 +0000 UTC m=+88.085037251" watchObservedRunningTime="2026-07-07 15:42:27.950446508 +0000 UTC m=+88.085872379"
Jul 07 15:42:29.735891 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:29.735857    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:42:30.896889 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:30.896845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98cf4d45-gp8hz" event={"ID":"e17023b7-af0f-4f54-a086-7396e9ff7feb","Type":"ContainerStarted","Data":"584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1"}
Jul 07 15:42:30.924001 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:30.923891    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d98cf4d45-gp8hz" podStartSLOduration=4.7151721779999995 podStartE2EDuration="7.923868352s" totalImagesPullingTime="3.208696174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:30.922778084 +0000 UTC m=+91.058203974" watchObservedRunningTime="2026-07-07 15:42:30.923868352 +0000 UTC m=+91.059294216"
Jul 07 15:42:33.634832 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:33.634791    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:33.635314 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:33.634871    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:33.640198 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:33.640163    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:33.912917 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:33.912836    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:42:34.672619 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.672580    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9sp5x"]
Jul 07 15:42:34.679026 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.678998    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.681847 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.681820    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 15:42:34.682016 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.681995    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 15:42:34.682142 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.682064    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 15:42:34.682785 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.682764    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p7tzj\""
Jul 07 15:42:34.683042 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.683021    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 15:42:34.869199 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-textfile\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869407 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-tls\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869407 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-root\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869407 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-sys\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869576 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-wtmp\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869576 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzkd8\" (UniqueName: \"kubernetes.io/projected/95108425-433d-4a5f-a9b9-e3337023b185-kube-api-access-gzkd8\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869576 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95108425-433d-4a5f-a9b9-e3337023b185-metrics-client-ca\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869576 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.869576 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.869550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-accelerators-collector-config\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.970687 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-sys\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.970854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-wtmp\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.970854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzkd8\" (UniqueName: \"kubernetes.io/projected/95108425-433d-4a5f-a9b9-e3337023b185-kube-api-access-gzkd8\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.970854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95108425-433d-4a5f-a9b9-e3337023b185-metrics-client-ca\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.970854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970796    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.970854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-accelerators-collector-config\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971108 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-textfile\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971108 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970926    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-tls\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971108 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.970950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-root\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971108 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.971043    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-root\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971108 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.971090    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-sys\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971356 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.971209    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-wtmp\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.971867 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.971838    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-textfile\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.972060 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.972033    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-accelerators-collector-config\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.972184 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.972160    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95108425-433d-4a5f-a9b9-e3337023b185-metrics-client-ca\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.974463 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.974426    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.974772 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.974750    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95108425-433d-4a5f-a9b9-e3337023b185-node-exporter-tls\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.981937 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.981883    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzkd8\" (UniqueName: \"kubernetes.io/projected/95108425-433d-4a5f-a9b9-e3337023b185-kube-api-access-gzkd8\") pod \"node-exporter-9sp5x\" (UID: \"95108425-433d-4a5f-a9b9-e3337023b185\") " pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:34.991739 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:34.991707    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9sp5x"
Jul 07 15:42:40.429789 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:42:40.429760    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95108425_433d_4a5f_a9b9_e3337023b185.slice/crio-68ae795abbf37e992caad9a5b7bad56ac48c11839cda961f484827147d3c85dd WatchSource:0}: Error finding container 68ae795abbf37e992caad9a5b7bad56ac48c11839cda961f484827147d3c85dd: Status 404 returned error can't find the container with id 68ae795abbf37e992caad9a5b7bad56ac48c11839cda961f484827147d3c85dd
Jul 07 15:42:40.938178 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:40.938144    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dqh92" event={"ID":"52a12c3a-9620-4341-a854-f40856dfb048","Type":"ContainerStarted","Data":"3ef30716e875b933f4907e5f60534b4c2080b8c7f8e02330dcbef9d003184814"}
Jul 07 15:42:40.938575 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:40.938365    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:40.939559 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:40.939537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sp5x" event={"ID":"95108425-433d-4a5f-a9b9-e3337023b185","Type":"ContainerStarted","Data":"68ae795abbf37e992caad9a5b7bad56ac48c11839cda961f484827147d3c85dd"}
Jul 07 15:42:40.940062 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:40.940031    2570 patch_prober.go:28] interesting pod/downloads-685bfb5f64-dqh92 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.19:8080/\": dial tcp 10.132.0.19:8080: connect: connection refused" start-of-body=
Jul 07 15:42:40.940137 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:40.940071    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-dqh92" podUID="52a12c3a-9620-4341-a854-f40856dfb048" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.19:8080/\": dial tcp 10.132.0.19:8080: connect: connection refused"
Jul 07 15:42:40.960870 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:40.960822    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dqh92" podStartSLOduration=2.421175334 podStartE2EDuration="21.960807242s" totalImagesPullingTime="19.539631908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:40.958642491 +0000 UTC m=+101.094068352" watchObservedRunningTime="2026-07-07 15:42:40.960807242 +0000 UTC m=+101.096233139"
Jul 07 15:42:41.962026 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:41.961991    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dqh92"
Jul 07 15:42:42.186530 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:42.186494    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d5db9c7bd-68rfh"]
Jul 07 15:42:42.950366 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:42.950323    2570 generic.go:356] "Generic (PLEG): container finished" podID="95108425-433d-4a5f-a9b9-e3337023b185" containerID="967d64f0d4cdf4e3966c5029747877a4dfe57bf27e9e511cf0eeb65839cc9c9c" exitCode=0
Jul 07 15:42:42.950559 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:42.950424    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sp5x" event={"ID":"95108425-433d-4a5f-a9b9-e3337023b185","Type":"ContainerDied","Data":"967d64f0d4cdf4e3966c5029747877a4dfe57bf27e9e511cf0eeb65839cc9c9c"}
Jul 07 15:42:43.755197 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:43.755166    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vr4ds"
Jul 07 15:42:43.957200 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:43.957155    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sp5x" event={"ID":"95108425-433d-4a5f-a9b9-e3337023b185","Type":"ContainerStarted","Data":"a33d1115bf447664d5781df18b24a89c1f58a796eac9d446da0c3544a2c981a7"}
Jul 07 15:42:43.957455 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:43.957228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9sp5x" event={"ID":"95108425-433d-4a5f-a9b9-e3337023b185","Type":"ContainerStarted","Data":"a8c1d2a920f556f60d4dddea42f348dc62fad9187cf663c2ea60c00d77c4c720"}
Jul 07 15:42:43.979862 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:43.979806    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9sp5x" podStartSLOduration=8.008726628 podStartE2EDuration="9.979781681s" totalImagesPullingTime="1.873658555s" totalInitContainerRuntime="97.396498ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:43.979049626 +0000 UTC m=+104.114475596" watchObservedRunningTime="2026-07-07 15:42:43.979781681 +0000 UTC m=+104.115207548"
Jul 07 15:42:50.261148 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:42:50.261112    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98cf4d45-gp8hz"]
Jul 07 15:43:00.019645 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:00.019609    2570 generic.go:356] "Generic (PLEG): container finished" podID="c073b469-e22d-49db-af2b-1d52543bdfe5" containerID="e838bf8838eea2fd4f931f48c0f18d074414d04fcf8880932f5f2de402a272b6" exitCode=0
Jul 07 15:43:00.020050 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:00.019682    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4" event={"ID":"c073b469-e22d-49db-af2b-1d52543bdfe5","Type":"ContainerDied","Data":"e838bf8838eea2fd4f931f48c0f18d074414d04fcf8880932f5f2de402a272b6"}
Jul 07 15:43:00.020050 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:00.020037    2570 scope.go:117] "RemoveContainer" containerID="e838bf8838eea2fd4f931f48c0f18d074414d04fcf8880932f5f2de402a272b6"
Jul 07 15:43:01.025181 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:01.025143    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qnqc4" event={"ID":"c073b469-e22d-49db-af2b-1d52543bdfe5","Type":"ContainerStarted","Data":"175fcb352ee9c24ff9fac6ce0f3589f0ec6d11e594eec71c462ed111b1c6a7a3"}
Jul 07 15:43:07.213458 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.213387    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" podUID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" containerName="registry" containerID="cri-o://d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559" gracePeriod=30
Jul 07 15:43:07.526544 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.526513    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:43:07.672617 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.672577    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.672841 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.672811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-certificates\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.672917 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.672858    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-ca-trust-extracted\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.672917 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.672903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-trusted-ca\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.673018 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.672961    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbbh8\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-kube-api-access-fbbh8\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.673018 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.672994    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-bound-sa-token\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.673121 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.673028    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-installation-pull-secrets\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.673121 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.673056    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-image-registry-private-configuration\") pod \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\" (UID: \"42225cf4-5fa1-4f4f-9277-e8e56aa8d892\") "
Jul 07 15:43:07.673422 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.673228    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:07.673422 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.673378    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-certificates\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.673611 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.673443    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:07.675965 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.675917    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:07.675965 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.675949    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-kube-api-access-fbbh8" (OuterVolumeSpecName: "kube-api-access-fbbh8") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "kube-api-access-fbbh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:07.676124 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.676015    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:07.676124 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.676042    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:07.676478 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.676442    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:07.682849 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.682822    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "42225cf4-5fa1-4f4f-9277-e8e56aa8d892" (UID: "42225cf4-5fa1-4f4f-9277-e8e56aa8d892"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774223    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-trusted-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774274    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbbh8\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-kube-api-access-fbbh8\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774285    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-bound-sa-token\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774294    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-installation-pull-secrets\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774305    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-image-registry-private-configuration\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774319    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-registry-tls\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:07.774325 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:07.774330    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/42225cf4-5fa1-4f4f-9277-e8e56aa8d892-ca-trust-extracted\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:08.056166 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.056090    2570 generic.go:356] "Generic (PLEG): container finished" podID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" containerID="d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559" exitCode=0
Jul 07 15:43:08.056166 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.056137    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh"
Jul 07 15:43:08.056352 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.056137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" event={"ID":"42225cf4-5fa1-4f4f-9277-e8e56aa8d892","Type":"ContainerDied","Data":"d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559"}
Jul 07 15:43:08.056352 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.056306    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d5db9c7bd-68rfh" event={"ID":"42225cf4-5fa1-4f4f-9277-e8e56aa8d892","Type":"ContainerDied","Data":"04c77d70c764467693e11ff3dca71313356f1e350fba69f0c2ebc966c780bb21"}
Jul 07 15:43:08.056352 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.056339    2570 scope.go:117] "RemoveContainer" containerID="d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559"
Jul 07 15:43:08.065635 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.065617    2570 scope.go:117] "RemoveContainer" containerID="d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559"
Jul 07 15:43:08.065928 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:43:08.065906    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559\": container with ID starting with d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559 not found: ID does not exist" containerID="d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559"
Jul 07 15:43:08.066022 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.065934    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559"} err="failed to get container status \"d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559\": rpc error: code = NotFound desc = could not find container \"d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559\": container with ID starting with d41a1360226c624620244946f8ac2d75ddf2d7955f6ff786b3d56afda93ca559 not found: ID does not exist"
Jul 07 15:43:08.080881 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.080852    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d5db9c7bd-68rfh"]
Jul 07 15:43:08.091422 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.091303    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d5db9c7bd-68rfh"]
Jul 07 15:43:08.457474 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:08.454998    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" path="/var/lib/kubelet/pods/42225cf4-5fa1-4f4f-9277-e8e56aa8d892/volumes"
Jul 07 15:43:10.293468 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:10.293427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:43:10.295797 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:10.295770    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/448dbf99-118f-4db1-a41b-e6949048f4e1-metrics-certs\") pod \"network-metrics-daemon-hcvvl\" (UID: \"448dbf99-118f-4db1-a41b-e6949048f4e1\") " pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:43:10.596746 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:10.596713    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2q2r\""
Jul 07 15:43:10.604928 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:10.604898    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcvvl"
Jul 07 15:43:10.774148 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:10.774118    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hcvvl"]
Jul 07 15:43:10.777031 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:43:10.777003    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448dbf99_118f_4db1_a41b_e6949048f4e1.slice/crio-90fb2c6adc21360a017b8b60a7705f6f675903713e51f9e8aa449dee213aad3e WatchSource:0}: Error finding container 90fb2c6adc21360a017b8b60a7705f6f675903713e51f9e8aa449dee213aad3e: Status 404 returned error can't find the container with id 90fb2c6adc21360a017b8b60a7705f6f675903713e51f9e8aa449dee213aad3e
Jul 07 15:43:11.069312 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:11.069210    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hcvvl" event={"ID":"448dbf99-118f-4db1-a41b-e6949048f4e1","Type":"ContainerStarted","Data":"90fb2c6adc21360a017b8b60a7705f6f675903713e51f9e8aa449dee213aad3e"}
Jul 07 15:43:13.078499 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:13.078460    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hcvvl" event={"ID":"448dbf99-118f-4db1-a41b-e6949048f4e1","Type":"ContainerStarted","Data":"9b4788460a53d7f4d99fc8d78dba9616c5eaf2d72f45f50b93792464a6fa90f9"}
Jul 07 15:43:13.078992 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:13.078523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hcvvl" event={"ID":"448dbf99-118f-4db1-a41b-e6949048f4e1","Type":"ContainerStarted","Data":"f8c6d456c3cc247ca1fa0577de0b3565aeb694bbb6d0ae820044293f78bd5a96"}
Jul 07 15:43:13.099903 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:13.099849    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hcvvl" podStartSLOduration=131.634596651 podStartE2EDuration="2m13.099830002s" totalImagesPullingTime="1.465233351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:13.098619961 +0000 UTC m=+133.234045826" watchObservedRunningTime="2026-07-07 15:43:13.099830002 +0000 UTC m=+133.235255864"
Jul 07 15:43:15.282133 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.282092    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d98cf4d45-gp8hz" podUID="e17023b7-af0f-4f54-a086-7396e9ff7feb" containerName="console" containerID="cri-o://584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1" gracePeriod=15
Jul 07 15:43:15.558712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.558644    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:43:15.734372 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734341    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-service-ca\") pod \"e17023b7-af0f-4f54-a086-7396e9ff7feb\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") "
Jul 07 15:43:15.734565 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734390    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-oauth-serving-cert\") pod \"e17023b7-af0f-4f54-a086-7396e9ff7feb\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") "
Jul 07 15:43:15.734565 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734437    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-config\") pod \"e17023b7-af0f-4f54-a086-7396e9ff7feb\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") "
Jul 07 15:43:15.734565 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734539    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-oauth-config\") pod \"e17023b7-af0f-4f54-a086-7396e9ff7feb\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") "
Jul 07 15:43:15.734798 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734598    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-serving-cert\") pod \"e17023b7-af0f-4f54-a086-7396e9ff7feb\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") "
Jul 07 15:43:15.734798 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734632    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rp47\" (UniqueName: \"kubernetes.io/projected/e17023b7-af0f-4f54-a086-7396e9ff7feb-kube-api-access-2rp47\") pod \"e17023b7-af0f-4f54-a086-7396e9ff7feb\" (UID: \"e17023b7-af0f-4f54-a086-7396e9ff7feb\") "
Jul 07 15:43:15.734897 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734811    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-service-ca" (OuterVolumeSpecName: "service-ca") pod "e17023b7-af0f-4f54-a086-7396e9ff7feb" (UID: "e17023b7-af0f-4f54-a086-7396e9ff7feb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:15.734897 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734823    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-config" (OuterVolumeSpecName: "console-config") pod "e17023b7-af0f-4f54-a086-7396e9ff7feb" (UID: "e17023b7-af0f-4f54-a086-7396e9ff7feb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:15.734897 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.734818    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e17023b7-af0f-4f54-a086-7396e9ff7feb" (UID: "e17023b7-af0f-4f54-a086-7396e9ff7feb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:15.736777 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.736732    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17023b7-af0f-4f54-a086-7396e9ff7feb-kube-api-access-2rp47" (OuterVolumeSpecName: "kube-api-access-2rp47") pod "e17023b7-af0f-4f54-a086-7396e9ff7feb" (UID: "e17023b7-af0f-4f54-a086-7396e9ff7feb"). InnerVolumeSpecName "kube-api-access-2rp47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:15.736893 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.736787    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e17023b7-af0f-4f54-a086-7396e9ff7feb" (UID: "e17023b7-af0f-4f54-a086-7396e9ff7feb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:15.736893 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.736851    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e17023b7-af0f-4f54-a086-7396e9ff7feb" (UID: "e17023b7-af0f-4f54-a086-7396e9ff7feb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:15.835269 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.835168    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-oauth-config\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:15.835269 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.835271    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-serving-cert\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:15.835450 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.835284    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rp47\" (UniqueName: \"kubernetes.io/projected/e17023b7-af0f-4f54-a086-7396e9ff7feb-kube-api-access-2rp47\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:15.835450 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.835295    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:15.835450 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.835306    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-oauth-serving-cert\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:15.835450 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:15.835314    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e17023b7-af0f-4f54-a086-7396e9ff7feb-console-config\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:43:16.089925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.089837    2570 generic.go:356] "Generic (PLEG): container finished" podID="e17023b7-af0f-4f54-a086-7396e9ff7feb" containerID="584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1" exitCode=0
Jul 07 15:43:16.089925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.089887    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98cf4d45-gp8hz"
Jul 07 15:43:16.090092 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.089922    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98cf4d45-gp8hz" event={"ID":"e17023b7-af0f-4f54-a086-7396e9ff7feb","Type":"ContainerDied","Data":"584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1"}
Jul 07 15:43:16.090092 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.089978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98cf4d45-gp8hz" event={"ID":"e17023b7-af0f-4f54-a086-7396e9ff7feb","Type":"ContainerDied","Data":"271688c1f68f3234b05c46c32ffda21b4ab0c5b6d95fc9da94cf67e52c483775"}
Jul 07 15:43:16.090092 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.090000    2570 scope.go:117] "RemoveContainer" containerID="584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1"
Jul 07 15:43:16.099332 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.099313    2570 scope.go:117] "RemoveContainer" containerID="584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1"
Jul 07 15:43:16.099579 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:43:16.099563    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1\": container with ID starting with 584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1 not found: ID does not exist" containerID="584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1"
Jul 07 15:43:16.099624 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.099587    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1"} err="failed to get container status \"584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1\": rpc error: code = NotFound desc = could not find container \"584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1\": container with ID starting with 584ab247e71bdd586237e8d2e404a3b3ee29471f31326f18aab56a724273cfd1 not found: ID does not exist"
Jul 07 15:43:16.112742 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.112708    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98cf4d45-gp8hz"]
Jul 07 15:43:16.117275 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.117251    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d98cf4d45-gp8hz"]
Jul 07 15:43:16.454656 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:43:16.454577    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17023b7-af0f-4f54-a086-7396e9ff7feb" path="/var/lib/kubelet/pods/e17023b7-af0f-4f54-a086-7396e9ff7feb/volumes"
Jul 07 15:44:03.338522 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338488    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f6b78f6c-v74wm"]
Jul 07 15:44:03.338918 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338780    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" containerName="registry"
Jul 07 15:44:03.338918 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338793    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" containerName="registry"
Jul 07 15:44:03.338918 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338806    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17023b7-af0f-4f54-a086-7396e9ff7feb" containerName="console"
Jul 07 15:44:03.338918 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338812    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17023b7-af0f-4f54-a086-7396e9ff7feb" containerName="console"
Jul 07 15:44:03.338918 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338864    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="42225cf4-5fa1-4f4f-9277-e8e56aa8d892" containerName="registry"
Jul 07 15:44:03.338918 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.338873    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17023b7-af0f-4f54-a086-7396e9ff7feb" containerName="console"
Jul 07 15:44:03.342960 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.342944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.348774 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.348750    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 15:44:03.348902 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.348834    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 15:44:03.348902 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.348790    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2ljcb\""
Jul 07 15:44:03.349527 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.348866    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 15:44:03.349811 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.349792    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 15:44:03.349917 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.349824    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 15:44:03.354560 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.354541    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 15:44:03.357520 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.357501    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f6b78f6c-v74wm"]
Jul 07 15:44:03.493839 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.493796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-console-config\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.493839 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.493842    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-oauth-serving-cert\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.494053 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.493875    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-serving-cert\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.494053 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.493932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-service-ca\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.494053 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.493991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-trusted-ca-bundle\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.494053 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.494028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7wf\" (UniqueName: \"kubernetes.io/projected/6df10327-fb5a-4177-aa46-a646b5acc2df-kube-api-access-lg7wf\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.494053 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.494050    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-oauth-config\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.594966 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.594863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-service-ca\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595122 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595011    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-trusted-ca-bundle\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595122 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7wf\" (UniqueName: \"kubernetes.io/projected/6df10327-fb5a-4177-aa46-a646b5acc2df-kube-api-access-lg7wf\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595122 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-oauth-config\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595284 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-console-config\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595284 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595161    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-oauth-serving-cert\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595393 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-serving-cert\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595670 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595639    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-service-ca\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595859 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595838    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-console-config\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.595978 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.595957    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-oauth-serving-cert\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.596065 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.596046    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-trusted-ca-bundle\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.597589 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.597564    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-oauth-config\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.597758 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.597741    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-serving-cert\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.605390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.605368    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7wf\" (UniqueName: \"kubernetes.io/projected/6df10327-fb5a-4177-aa46-a646b5acc2df-kube-api-access-lg7wf\") pod \"console-57f6b78f6c-v74wm\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") " pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.651921 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.651885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:03.783746 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:03.783712    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f6b78f6c-v74wm"]
Jul 07 15:44:03.787224 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:44:03.787196    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df10327_fb5a_4177_aa46_a646b5acc2df.slice/crio-c39ace46bf7511ed2c973307d38d23725086334bde916a3eacadc1f5ad128822 WatchSource:0}: Error finding container c39ace46bf7511ed2c973307d38d23725086334bde916a3eacadc1f5ad128822: Status 404 returned error can't find the container with id c39ace46bf7511ed2c973307d38d23725086334bde916a3eacadc1f5ad128822
Jul 07 15:44:04.265219 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:04.265182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f6b78f6c-v74wm" event={"ID":"6df10327-fb5a-4177-aa46-a646b5acc2df","Type":"ContainerStarted","Data":"a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f"}
Jul 07 15:44:04.265411 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:04.265245    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f6b78f6c-v74wm" event={"ID":"6df10327-fb5a-4177-aa46-a646b5acc2df","Type":"ContainerStarted","Data":"c39ace46bf7511ed2c973307d38d23725086334bde916a3eacadc1f5ad128822"}
Jul 07 15:44:04.288011 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:04.287960    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f6b78f6c-v74wm" podStartSLOduration=1.287944669 podStartE2EDuration="1.287944669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:44:04.286987406 +0000 UTC m=+184.422413269" watchObservedRunningTime="2026-07-07 15:44:04.287944669 +0000 UTC m=+184.423370588"
Jul 07 15:44:13.652441 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:13.652387    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:13.653070 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:13.652457    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:13.657138 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:13.657115    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:44:14.301754 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:44:14.301725    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:45:14.885801 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:14.885769    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cfd65fb67-5gkh4"]
Jul 07 15:45:14.888872 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:14.888854    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:14.903135 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:14.903100    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfd65fb67-5gkh4"]
Jul 07 15:45:15.021696 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021664    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-oauth-config\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.021875 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvqvc\" (UniqueName: \"kubernetes.io/projected/88feb010-c943-4501-ae65-09976bbe7794-kube-api-access-lvqvc\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.021875 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-oauth-serving-cert\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.021875 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-console-config\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.021875 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-service-ca\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.021875 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-trusted-ca-bundle\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.022039 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.021908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-serving-cert\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123271 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-serving-cert\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123271 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123274    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-oauth-config\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123529 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvqvc\" (UniqueName: \"kubernetes.io/projected/88feb010-c943-4501-ae65-09976bbe7794-kube-api-access-lvqvc\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123529 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-oauth-serving-cert\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123529 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-console-config\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123684 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-service-ca\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.123684 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.123669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-trusted-ca-bundle\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.124151 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.124123    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-oauth-serving-cert\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.124299 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.124177    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-console-config\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.124299 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.124201    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-service-ca\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.124436 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.124415    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-trusted-ca-bundle\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.125812 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.125789    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-serving-cert\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.125911 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.125868    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-oauth-config\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.133110 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.133087    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvqvc\" (UniqueName: \"kubernetes.io/projected/88feb010-c943-4501-ae65-09976bbe7794-kube-api-access-lvqvc\") pod \"console-5cfd65fb67-5gkh4\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") " pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.197898 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.197800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:15.330967 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.330941    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfd65fb67-5gkh4"]
Jul 07 15:45:15.333576 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:45:15.333553    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88feb010_c943_4501_ae65_09976bbe7794.slice/crio-b5e38b15293d0eefd43b322c54921456f7fe7b0d011eed0a9f5444109bd35eb6 WatchSource:0}: Error finding container b5e38b15293d0eefd43b322c54921456f7fe7b0d011eed0a9f5444109bd35eb6: Status 404 returned error can't find the container with id b5e38b15293d0eefd43b322c54921456f7fe7b0d011eed0a9f5444109bd35eb6
Jul 07 15:45:15.513994 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.513896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfd65fb67-5gkh4" event={"ID":"88feb010-c943-4501-ae65-09976bbe7794","Type":"ContainerStarted","Data":"49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec"}
Jul 07 15:45:15.513994 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.513956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfd65fb67-5gkh4" event={"ID":"88feb010-c943-4501-ae65-09976bbe7794","Type":"ContainerStarted","Data":"b5e38b15293d0eefd43b322c54921456f7fe7b0d011eed0a9f5444109bd35eb6"}
Jul 07 15:45:15.535088 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:15.535021    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cfd65fb67-5gkh4" podStartSLOduration=1.535003801 podStartE2EDuration="1.535003801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:45:15.534438668 +0000 UTC m=+255.669864522" watchObservedRunningTime="2026-07-07 15:45:15.535003801 +0000 UTC m=+255.670429664"
Jul 07 15:45:25.198497 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:25.198393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:25.198497 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:25.198470    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:25.203428 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:25.203403    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:25.551772 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:25.551679    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:45:25.604904 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:25.604865    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f6b78f6c-v74wm"]
Jul 07 15:45:50.631498 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.631434    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57f6b78f6c-v74wm" podUID="6df10327-fb5a-4177-aa46-a646b5acc2df" containerName="console" containerID="cri-o://a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f" gracePeriod=15
Jul 07 15:45:50.873035 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.873006    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:45:50.907795 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.907723    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-trusted-ca-bundle\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.907795 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.907762    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-serving-cert\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.907795 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.907789    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-oauth-config\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.908033 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.907905    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-console-config\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.908033 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.907961    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg7wf\" (UniqueName: \"kubernetes.io/projected/6df10327-fb5a-4177-aa46-a646b5acc2df-kube-api-access-lg7wf\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.908033 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.908021    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-oauth-serving-cert\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.908189 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.908047    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-service-ca\") pod \"6df10327-fb5a-4177-aa46-a646b5acc2df\" (UID: \"6df10327-fb5a-4177-aa46-a646b5acc2df\") "
Jul 07 15:45:50.908267 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.908202    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:50.908330 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.908280    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-console-config" (OuterVolumeSpecName: "console-config") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:50.908554 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.908530    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-service-ca" (OuterVolumeSpecName: "service-ca") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:50.908651 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.908570    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:50.910439 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.910412    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:45:50.910540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.910455    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df10327-fb5a-4177-aa46-a646b5acc2df-kube-api-access-lg7wf" (OuterVolumeSpecName: "kube-api-access-lg7wf") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "kube-api-access-lg7wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:45:50.910540 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:50.910461    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6df10327-fb5a-4177-aa46-a646b5acc2df" (UID: "6df10327-fb5a-4177-aa46-a646b5acc2df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:45:51.009365 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009314    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg7wf\" (UniqueName: \"kubernetes.io/projected/6df10327-fb5a-4177-aa46-a646b5acc2df-kube-api-access-lg7wf\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.009365 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009358    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-oauth-serving-cert\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.009365 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009369    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.009365 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009378    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-trusted-ca-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.009629 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009387    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-serving-cert\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.009629 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009395    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6df10327-fb5a-4177-aa46-a646b5acc2df-console-oauth-config\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.009629 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.009404    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6df10327-fb5a-4177-aa46-a646b5acc2df-console-config\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:45:51.642052 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.642016    2570 generic.go:356] "Generic (PLEG): container finished" podID="6df10327-fb5a-4177-aa46-a646b5acc2df" containerID="a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f" exitCode=0
Jul 07 15:45:51.642568 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.642066    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f6b78f6c-v74wm"
Jul 07 15:45:51.642568 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.642071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f6b78f6c-v74wm" event={"ID":"6df10327-fb5a-4177-aa46-a646b5acc2df","Type":"ContainerDied","Data":"a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f"}
Jul 07 15:45:51.642568 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.642193    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f6b78f6c-v74wm" event={"ID":"6df10327-fb5a-4177-aa46-a646b5acc2df","Type":"ContainerDied","Data":"c39ace46bf7511ed2c973307d38d23725086334bde916a3eacadc1f5ad128822"}
Jul 07 15:45:51.642568 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.642217    2570 scope.go:117] "RemoveContainer" containerID="a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f"
Jul 07 15:45:51.651522 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.651502    2570 scope.go:117] "RemoveContainer" containerID="a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f"
Jul 07 15:45:51.651813 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:45:51.651791    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f\": container with ID starting with a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f not found: ID does not exist" containerID="a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f"
Jul 07 15:45:51.651862 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.651822    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f"} err="failed to get container status \"a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f\": rpc error: code = NotFound desc = could not find container \"a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f\": container with ID starting with a5c0a9d884ebea2780abce00789c9772c02055dbc018b69c34defe3545d4613f not found: ID does not exist"
Jul 07 15:45:51.665705 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.665678    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f6b78f6c-v74wm"]
Jul 07 15:45:51.672104 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:51.672077    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57f6b78f6c-v74wm"]
Jul 07 15:45:52.454728 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:52.454690    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df10327-fb5a-4177-aa46-a646b5acc2df" path="/var/lib/kubelet/pods/6df10327-fb5a-4177-aa46-a646b5acc2df/volumes"
Jul 07 15:45:58.647857 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.647816    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"]
Jul 07 15:45:58.648260 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.648200    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df10327-fb5a-4177-aa46-a646b5acc2df" containerName="console"
Jul 07 15:45:58.648260 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.648216    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df10327-fb5a-4177-aa46-a646b5acc2df" containerName="console"
Jul 07 15:45:58.648343 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.648297    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df10327-fb5a-4177-aa46-a646b5acc2df" containerName="console"
Jul 07 15:45:58.651405 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.651389    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.660627 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.660610    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:45:58.660900 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.660881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.660941 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.660920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxszl\" (UniqueName: \"kubernetes.io/projected/d31e55aa-a575-46f9-8d44-704b88b13d52-kube-api-access-gxszl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.660984 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.660969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.662515 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.662499    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:45:58.667534 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.667508    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"]
Jul 07 15:45:58.669440 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.669420    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szxdp\""
Jul 07 15:45:58.761891 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.761851    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.762081 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.761908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxszl\" (UniqueName: \"kubernetes.io/projected/d31e55aa-a575-46f9-8d44-704b88b13d52-kube-api-access-gxszl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.762081 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.761944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.762333 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.762311    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.762386 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.762322    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.777511 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.777478    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxszl\" (UniqueName: \"kubernetes.io/projected/d31e55aa-a575-46f9-8d44-704b88b13d52-kube-api-access-gxszl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:58.960554 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:58.960454    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:45:59.101415 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:59.101385    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"]
Jul 07 15:45:59.103548 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:45:59.103520    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31e55aa_a575_46f9_8d44_704b88b13d52.slice/crio-7d7b62efbc3e9c87be6ad53a793ad41766c2b8776ca3a1976a862c52ef633793 WatchSource:0}: Error finding container 7d7b62efbc3e9c87be6ad53a793ad41766c2b8776ca3a1976a862c52ef633793: Status 404 returned error can't find the container with id 7d7b62efbc3e9c87be6ad53a793ad41766c2b8776ca3a1976a862c52ef633793
Jul 07 15:45:59.673276 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:45:59.673221    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" event={"ID":"d31e55aa-a575-46f9-8d44-704b88b13d52","Type":"ContainerStarted","Data":"7d7b62efbc3e9c87be6ad53a793ad41766c2b8776ca3a1976a862c52ef633793"}
Jul 07 15:46:00.296254 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:00.296212    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 15:46:06.701978 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:06.701942    2570 generic.go:356] "Generic (PLEG): container finished" podID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerID="42be86750b6f061f2b010a1223302a38030fb79c752d92d689de0bb8414f8e4c" exitCode=0
Jul 07 15:46:06.702395 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:06.702030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" event={"ID":"d31e55aa-a575-46f9-8d44-704b88b13d52","Type":"ContainerDied","Data":"42be86750b6f061f2b010a1223302a38030fb79c752d92d689de0bb8414f8e4c"}
Jul 07 15:46:06.703010 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:06.702996    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:46:12.725876 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:12.725840    2570 generic.go:356] "Generic (PLEG): container finished" podID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerID="f971b93e26c6edf3b40dacfb75ae29885e2488f7d84e716b3d583555e9a7deea" exitCode=0
Jul 07 15:46:12.726276 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:12.725924    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" event={"ID":"d31e55aa-a575-46f9-8d44-704b88b13d52","Type":"ContainerDied","Data":"f971b93e26c6edf3b40dacfb75ae29885e2488f7d84e716b3d583555e9a7deea"}
Jul 07 15:46:18.758847 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:18.758812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" event={"ID":"d31e55aa-a575-46f9-8d44-704b88b13d52","Type":"ContainerStarted","Data":"3e0dc1b2e24220a14f87c6061a6fd89ba073d7515f817203ef4519221afe4bdd"}
Jul 07 15:46:18.779954 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:18.779881    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" podStartSLOduration=2.25694549 podStartE2EDuration="20.779865545s" totalImagesPullingTime="18.522920055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:45:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:18.778170437 +0000 UTC m=+318.913596301" watchObservedRunningTime="2026-07-07 15:46:18.779865545 +0000 UTC m=+318.915291409"
Jul 07 15:46:19.764613 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:19.764579    2570 generic.go:356] "Generic (PLEG): container finished" podID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerID="3e0dc1b2e24220a14f87c6061a6fd89ba073d7515f817203ef4519221afe4bdd" exitCode=0
Jul 07 15:46:19.765001 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:19.764642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" event={"ID":"d31e55aa-a575-46f9-8d44-704b88b13d52","Type":"ContainerDied","Data":"3e0dc1b2e24220a14f87c6061a6fd89ba073d7515f817203ef4519221afe4bdd"}
Jul 07 15:46:20.887981 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.887954    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:46:20.945201 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.945169    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-util\") pod \"d31e55aa-a575-46f9-8d44-704b88b13d52\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") "
Jul 07 15:46:20.945201 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.945205    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-bundle\") pod \"d31e55aa-a575-46f9-8d44-704b88b13d52\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") "
Jul 07 15:46:20.945445 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.945272    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxszl\" (UniqueName: \"kubernetes.io/projected/d31e55aa-a575-46f9-8d44-704b88b13d52-kube-api-access-gxszl\") pod \"d31e55aa-a575-46f9-8d44-704b88b13d52\" (UID: \"d31e55aa-a575-46f9-8d44-704b88b13d52\") "
Jul 07 15:46:20.945889 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.945862    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-bundle" (OuterVolumeSpecName: "bundle") pod "d31e55aa-a575-46f9-8d44-704b88b13d52" (UID: "d31e55aa-a575-46f9-8d44-704b88b13d52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:20.947503 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.947479    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31e55aa-a575-46f9-8d44-704b88b13d52-kube-api-access-gxszl" (OuterVolumeSpecName: "kube-api-access-gxszl") pod "d31e55aa-a575-46f9-8d44-704b88b13d52" (UID: "d31e55aa-a575-46f9-8d44-704b88b13d52"). InnerVolumeSpecName "kube-api-access-gxszl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:46:20.949851 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:20.949824    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-util" (OuterVolumeSpecName: "util") pod "d31e55aa-a575-46f9-8d44-704b88b13d52" (UID: "d31e55aa-a575-46f9-8d44-704b88b13d52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:21.046723 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:21.046639    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxszl\" (UniqueName: \"kubernetes.io/projected/d31e55aa-a575-46f9-8d44-704b88b13d52-kube-api-access-gxszl\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:21.046723 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:21.046670    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:21.046723 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:21.046679    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d31e55aa-a575-46f9-8d44-704b88b13d52-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:21.773161 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:21.773133    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp"
Jul 07 15:46:21.773353 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:21.773135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402xwgp" event={"ID":"d31e55aa-a575-46f9-8d44-704b88b13d52","Type":"ContainerDied","Data":"7d7b62efbc3e9c87be6ad53a793ad41766c2b8776ca3a1976a862c52ef633793"}
Jul 07 15:46:21.773353 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:21.773272    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d7b62efbc3e9c87be6ad53a793ad41766c2b8776ca3a1976a862c52ef633793"
Jul 07 15:46:27.120688 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120650    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"]
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120916    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="pull"
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120927    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="pull"
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120942    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="util"
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120946    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="util"
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120954    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="extract"
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.120959    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="extract"
Jul 07 15:46:27.121163 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.121002    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31e55aa-a575-46f9-8d44-704b88b13d52" containerName="extract"
Jul 07 15:46:27.124333 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.124317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.127021 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.126992    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:46:27.127021 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.127010    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lmkmr\""
Jul 07 15:46:27.127021 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.127013    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 15:46:27.138496 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.138472    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"]
Jul 07 15:46:27.194888 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.194850    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6305b041-a50e-4662-9106-0f71c4a1652f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xxtjh\" (UID: \"6305b041-a50e-4662-9106-0f71c4a1652f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.195053 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.194906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcd72\" (UniqueName: \"kubernetes.io/projected/6305b041-a50e-4662-9106-0f71c4a1652f-kube-api-access-tcd72\") pod \"cert-manager-operator-controller-manager-55c444bf86-xxtjh\" (UID: \"6305b041-a50e-4662-9106-0f71c4a1652f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.295555 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.295518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6305b041-a50e-4662-9106-0f71c4a1652f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xxtjh\" (UID: \"6305b041-a50e-4662-9106-0f71c4a1652f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.295711 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.295581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcd72\" (UniqueName: \"kubernetes.io/projected/6305b041-a50e-4662-9106-0f71c4a1652f-kube-api-access-tcd72\") pod \"cert-manager-operator-controller-manager-55c444bf86-xxtjh\" (UID: \"6305b041-a50e-4662-9106-0f71c4a1652f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.295969 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.295947    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6305b041-a50e-4662-9106-0f71c4a1652f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xxtjh\" (UID: \"6305b041-a50e-4662-9106-0f71c4a1652f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.309962 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.309928    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcd72\" (UniqueName: \"kubernetes.io/projected/6305b041-a50e-4662-9106-0f71c4a1652f-kube-api-access-tcd72\") pod \"cert-manager-operator-controller-manager-55c444bf86-xxtjh\" (UID: \"6305b041-a50e-4662-9106-0f71c4a1652f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.433338 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.433253    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"
Jul 07 15:46:27.584248 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.584210    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh"]
Jul 07 15:46:27.589249 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:46:27.589198    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6305b041_a50e_4662_9106_0f71c4a1652f.slice/crio-fe52b7a3c9f140df86911c4a512791213c9b80686d2e03e26aec27bb24dddc2d WatchSource:0}: Error finding container fe52b7a3c9f140df86911c4a512791213c9b80686d2e03e26aec27bb24dddc2d: Status 404 returned error can't find the container with id fe52b7a3c9f140df86911c4a512791213c9b80686d2e03e26aec27bb24dddc2d
Jul 07 15:46:27.798739 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:27.798642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh" event={"ID":"6305b041-a50e-4662-9106-0f71c4a1652f","Type":"ContainerStarted","Data":"fe52b7a3c9f140df86911c4a512791213c9b80686d2e03e26aec27bb24dddc2d"}
Jul 07 15:46:29.810293 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:29.810258    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh" event={"ID":"6305b041-a50e-4662-9106-0f71c4a1652f","Type":"ContainerStarted","Data":"726623ed2db55504ae6193929f10a3be0ab3970c48d3ce64f9ca80e4ffd10cca"}
Jul 07 15:46:29.837302 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:29.837218    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xxtjh" podStartSLOduration=1.6443560860000002 podStartE2EDuration="2.837203058s" totalImagesPullingTime="1.192846972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:29.835518111 +0000 UTC m=+329.970943974" watchObservedRunningTime="2026-07-07 15:46:29.837203058 +0000 UTC m=+329.972628921"
Jul 07 15:46:30.542345 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.542313    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"]
Jul 07 15:46:30.544482 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.544463    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.547003 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.546980    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:46:30.547103 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.547024    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:46:30.547911 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.547897    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szxdp\""
Jul 07 15:46:30.559956 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.559926    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"]
Jul 07 15:46:30.623743 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.623712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.623911 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.623747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfp8c\" (UniqueName: \"kubernetes.io/projected/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-kube-api-access-rfp8c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.623911 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.623827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.724694 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.724656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.724694 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.724697    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfp8c\" (UniqueName: \"kubernetes.io/projected/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-kube-api-access-rfp8c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.724938 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.724765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.725152 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.725129    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.725197 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.725165    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.735763 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.735733    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfp8c\" (UniqueName: \"kubernetes.io/projected/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-kube-api-access-rfp8c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.853796 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.853763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:30.986605 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:30.986567    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"]
Jul 07 15:46:30.989328 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:46:30.989303    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f42215c_be8f_4ec2_b9fc_acdcb502b71f.slice/crio-a09b2db133661dc484668fe53b4c404f0ed913efc3bb1f008d4f77fcb6c42f33 WatchSource:0}: Error finding container a09b2db133661dc484668fe53b4c404f0ed913efc3bb1f008d4f77fcb6c42f33: Status 404 returned error can't find the container with id a09b2db133661dc484668fe53b4c404f0ed913efc3bb1f008d4f77fcb6c42f33
Jul 07 15:46:31.819165 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:31.819131    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerID="707b4d7bfcea28b7dbb7753b5fe988aca7e0a074754bfd70b81ee1b825c07cd7" exitCode=0
Jul 07 15:46:31.819363 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:31.819219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9" event={"ID":"3f42215c-be8f-4ec2-b9fc-acdcb502b71f","Type":"ContainerDied","Data":"707b4d7bfcea28b7dbb7753b5fe988aca7e0a074754bfd70b81ee1b825c07cd7"}
Jul 07 15:46:31.819363 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:31.819301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9" event={"ID":"3f42215c-be8f-4ec2-b9fc-acdcb502b71f","Type":"ContainerStarted","Data":"a09b2db133661dc484668fe53b4c404f0ed913efc3bb1f008d4f77fcb6c42f33"}
Jul 07 15:46:33.243753 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.243710    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"]
Jul 07 15:46:33.249663 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.249636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.256372 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.256344    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 15:46:33.256521 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.256391    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 15:46:33.256521 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.256343    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qjtb5\""
Jul 07 15:46:33.263491 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.263461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"]
Jul 07 15:46:33.349574 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.349537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c1b7850-1015-4dfb-8025-000d7c0ab10a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6kmd\" (UID: \"6c1b7850-1015-4dfb-8025-000d7c0ab10a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.349755 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.349629    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5h2\" (UniqueName: \"kubernetes.io/projected/6c1b7850-1015-4dfb-8025-000d7c0ab10a-kube-api-access-nr5h2\") pod \"cert-manager-cainjector-559cdd8c87-g6kmd\" (UID: \"6c1b7850-1015-4dfb-8025-000d7c0ab10a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.450628 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.450593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5h2\" (UniqueName: \"kubernetes.io/projected/6c1b7850-1015-4dfb-8025-000d7c0ab10a-kube-api-access-nr5h2\") pod \"cert-manager-cainjector-559cdd8c87-g6kmd\" (UID: \"6c1b7850-1015-4dfb-8025-000d7c0ab10a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.450786 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.450652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c1b7850-1015-4dfb-8025-000d7c0ab10a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6kmd\" (UID: \"6c1b7850-1015-4dfb-8025-000d7c0ab10a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.461642 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.461609    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5h2\" (UniqueName: \"kubernetes.io/projected/6c1b7850-1015-4dfb-8025-000d7c0ab10a-kube-api-access-nr5h2\") pod \"cert-manager-cainjector-559cdd8c87-g6kmd\" (UID: \"6c1b7850-1015-4dfb-8025-000d7c0ab10a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.462906 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.462834    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c1b7850-1015-4dfb-8025-000d7c0ab10a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6kmd\" (UID: \"6c1b7850-1015-4dfb-8025-000d7c0ab10a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.560269 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.560218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"
Jul 07 15:46:33.700774 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.696192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd"]
Jul 07 15:46:33.828920 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.828825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd" event={"ID":"6c1b7850-1015-4dfb-8025-000d7c0ab10a","Type":"ContainerStarted","Data":"f351fc324d71d549e11971159e5a6b1dbde3c96048fc41562ed3335e6650015d"}
Jul 07 15:46:33.830642 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.830604    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerID="c1558a8f32386c43b6fb2f59b8a4611832b9c37d2df5260a2400f29eb2b897b3" exitCode=0
Jul 07 15:46:33.830768 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:33.830642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9" event={"ID":"3f42215c-be8f-4ec2-b9fc-acdcb502b71f","Type":"ContainerDied","Data":"c1558a8f32386c43b6fb2f59b8a4611832b9c37d2df5260a2400f29eb2b897b3"}
Jul 07 15:46:34.838809 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:34.838770    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerID="71226b143a5264170b1f7dab2ca188ee3c384a827ade2b11db972eee3895bc0e" exitCode=0
Jul 07 15:46:34.839286 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:34.838849    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9" event={"ID":"3f42215c-be8f-4ec2-b9fc-acdcb502b71f","Type":"ContainerDied","Data":"71226b143a5264170b1f7dab2ca188ee3c384a827ade2b11db972eee3895bc0e"}
Jul 07 15:46:36.289179 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.289156    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:36.374328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.374291    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-bundle\") pod \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") "
Jul 07 15:46:36.374489 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.374350    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-util\") pod \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") "
Jul 07 15:46:36.374489 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.374414    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfp8c\" (UniqueName: \"kubernetes.io/projected/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-kube-api-access-rfp8c\") pod \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\" (UID: \"3f42215c-be8f-4ec2-b9fc-acdcb502b71f\") "
Jul 07 15:46:36.374768 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.374739    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-bundle" (OuterVolumeSpecName: "bundle") pod "3f42215c-be8f-4ec2-b9fc-acdcb502b71f" (UID: "3f42215c-be8f-4ec2-b9fc-acdcb502b71f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:36.376770 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.376742    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-kube-api-access-rfp8c" (OuterVolumeSpecName: "kube-api-access-rfp8c") pod "3f42215c-be8f-4ec2-b9fc-acdcb502b71f" (UID: "3f42215c-be8f-4ec2-b9fc-acdcb502b71f"). InnerVolumeSpecName "kube-api-access-rfp8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:46:36.380534 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.380504    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-util" (OuterVolumeSpecName: "util") pod "3f42215c-be8f-4ec2-b9fc-acdcb502b71f" (UID: "3f42215c-be8f-4ec2-b9fc-acdcb502b71f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:36.475579 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.475540    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:36.475579 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.475576    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfp8c\" (UniqueName: \"kubernetes.io/projected/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-kube-api-access-rfp8c\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:36.475802 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.475593    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f42215c-be8f-4ec2-b9fc-acdcb502b71f-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:36.849880 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.849846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd" event={"ID":"6c1b7850-1015-4dfb-8025-000d7c0ab10a","Type":"ContainerStarted","Data":"58597c995ad5cf7dc077dd5177e8d299336b92dee60f49aad70eb9a6ce103b96"}
Jul 07 15:46:36.851915 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.851871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9" event={"ID":"3f42215c-be8f-4ec2-b9fc-acdcb502b71f","Type":"ContainerDied","Data":"a09b2db133661dc484668fe53b4c404f0ed913efc3bb1f008d4f77fcb6c42f33"}
Jul 07 15:46:36.852042 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.851932    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a09b2db133661dc484668fe53b4c404f0ed913efc3bb1f008d4f77fcb6c42f33"
Jul 07 15:46:36.852042 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.851888    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frljw9"
Jul 07 15:46:36.887468 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:36.887414    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6kmd" podStartSLOduration=1.286059256 podStartE2EDuration="3.887395926s" totalImagesPullingTime="2.60133667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:36.883277355 +0000 UTC m=+337.018703221" watchObservedRunningTime="2026-07-07 15:46:36.887395926 +0000 UTC m=+337.022821788"
Jul 07 15:46:43.374640 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374603    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"]
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374881    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="pull"
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374892    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="pull"
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374905    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="util"
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374911    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="util"
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374926    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="extract"
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374931    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="extract"
Jul 07 15:46:43.375082 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.374980    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f42215c-be8f-4ec2-b9fc-acdcb502b71f" containerName="extract"
Jul 07 15:46:43.377479 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.377459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.380858 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.380833    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 15:46:43.381071 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.381055    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-w7tzh\""
Jul 07 15:46:43.381896 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.381877    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:46:43.398812 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.398779    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"]
Jul 07 15:46:43.533159 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.533114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5njc\" (UniqueName: \"kubernetes.io/projected/52226476-bb38-4544-9c4f-8917ad03e786-kube-api-access-p5njc\") pod \"openshift-lws-operator-fd8ccff4c-vp88r\" (UID: \"52226476-bb38-4544-9c4f-8917ad03e786\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.533159 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.533177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52226476-bb38-4544-9c4f-8917ad03e786-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vp88r\" (UID: \"52226476-bb38-4544-9c4f-8917ad03e786\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.633925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.633827    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5njc\" (UniqueName: \"kubernetes.io/projected/52226476-bb38-4544-9c4f-8917ad03e786-kube-api-access-p5njc\") pod \"openshift-lws-operator-fd8ccff4c-vp88r\" (UID: \"52226476-bb38-4544-9c4f-8917ad03e786\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.633925 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.633896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52226476-bb38-4544-9c4f-8917ad03e786-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vp88r\" (UID: \"52226476-bb38-4544-9c4f-8917ad03e786\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.634274 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.634259    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52226476-bb38-4544-9c4f-8917ad03e786-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vp88r\" (UID: \"52226476-bb38-4544-9c4f-8917ad03e786\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.656599 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.656573    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5njc\" (UniqueName: \"kubernetes.io/projected/52226476-bb38-4544-9c4f-8917ad03e786-kube-api-access-p5njc\") pod \"openshift-lws-operator-fd8ccff4c-vp88r\" (UID: \"52226476-bb38-4544-9c4f-8917ad03e786\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.687276 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.687219    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"
Jul 07 15:46:43.824894 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.824856    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r"]
Jul 07 15:46:43.827927 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:46:43.827900    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52226476_bb38_4544_9c4f_8917ad03e786.slice/crio-2e50e1917c3996a8e835e65657f486a97763e00c7ee4e8723dde2812c4bfc16c WatchSource:0}: Error finding container 2e50e1917c3996a8e835e65657f486a97763e00c7ee4e8723dde2812c4bfc16c: Status 404 returned error can't find the container with id 2e50e1917c3996a8e835e65657f486a97763e00c7ee4e8723dde2812c4bfc16c
Jul 07 15:46:43.880937 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:43.880903    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r" event={"ID":"52226476-bb38-4544-9c4f-8917ad03e786","Type":"ContainerStarted","Data":"2e50e1917c3996a8e835e65657f486a97763e00c7ee4e8723dde2812c4bfc16c"}
Jul 07 15:46:45.892342 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:45.892249    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r" event={"ID":"52226476-bb38-4544-9c4f-8917ad03e786","Type":"ContainerStarted","Data":"79f3c42a8a6d0ac444e73be44c2d63dac5d0c3e29696479fc22cb39d4fb6808e"}
Jul 07 15:46:45.910739 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:45.910677    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vp88r" podStartSLOduration=1.140885165 podStartE2EDuration="2.910655248s" totalImagesPullingTime="1.769770083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:45.910007648 +0000 UTC m=+346.045433517" watchObservedRunningTime="2026-07-07 15:46:45.910655248 +0000 UTC m=+346.046081115"
Jul 07 15:46:48.864477 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.864437    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"]
Jul 07 15:46:48.866576 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.866561    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:48.869400 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.869381    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szxdp\""
Jul 07 15:46:48.869506 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.869414    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:46:48.869506 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.869414    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:46:48.877807 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.877782    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"]
Jul 07 15:46:48.980675 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.980640    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:48.980854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.980682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs65s\" (UniqueName: \"kubernetes.io/projected/cf58509c-49a4-4e72-845d-b5d4a4f86cee-kube-api-access-xs65s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:48.980854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:48.980736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.082032 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.081995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.082195 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.082040    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs65s\" (UniqueName: \"kubernetes.io/projected/cf58509c-49a4-4e72-845d-b5d4a4f86cee-kube-api-access-xs65s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.082195 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.082082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.082430 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.082408    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.082467 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.082436    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.091387 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.091361    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs65s\" (UniqueName: \"kubernetes.io/projected/cf58509c-49a4-4e72-845d-b5d4a4f86cee-kube-api-access-xs65s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.176040 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.175955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:49.309749 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.309695    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"]
Jul 07 15:46:49.311838 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:46:49.311812    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf58509c_49a4_4e72_845d_b5d4a4f86cee.slice/crio-dc9bbfdee5bb39b63d4ead3cf201a4cb4d90bf96598b737e86a65d5fa19f545b WatchSource:0}: Error finding container dc9bbfdee5bb39b63d4ead3cf201a4cb4d90bf96598b737e86a65d5fa19f545b: Status 404 returned error can't find the container with id dc9bbfdee5bb39b63d4ead3cf201a4cb4d90bf96598b737e86a65d5fa19f545b
Jul 07 15:46:49.909471 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.909438    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerID="35d660c86d3f7db4b041ee7a4f61686ee656275db62c20f82761f32c70832279" exitCode=0
Jul 07 15:46:49.909860 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.909529    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2" event={"ID":"cf58509c-49a4-4e72-845d-b5d4a4f86cee","Type":"ContainerDied","Data":"35d660c86d3f7db4b041ee7a4f61686ee656275db62c20f82761f32c70832279"}
Jul 07 15:46:49.909860 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:49.909576    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2" event={"ID":"cf58509c-49a4-4e72-845d-b5d4a4f86cee","Type":"ContainerStarted","Data":"dc9bbfdee5bb39b63d4ead3cf201a4cb4d90bf96598b737e86a65d5fa19f545b"}
Jul 07 15:46:50.915583 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:50.915550    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerID="0ccc9658b7bf0907399171a7a08981ad8f38983ef09a36cf743dab72a8bcb865" exitCode=0
Jul 07 15:46:50.916003 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:50.915641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2" event={"ID":"cf58509c-49a4-4e72-845d-b5d4a4f86cee","Type":"ContainerDied","Data":"0ccc9658b7bf0907399171a7a08981ad8f38983ef09a36cf743dab72a8bcb865"}
Jul 07 15:46:51.922570 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:51.922536    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerID="da485f37122b9d70bf1bd87dd17a443b10e7a2944cc271686ba4055c79b44b89" exitCode=0
Jul 07 15:46:51.922968 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:51.922627    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2" event={"ID":"cf58509c-49a4-4e72-845d-b5d4a4f86cee","Type":"ContainerDied","Data":"da485f37122b9d70bf1bd87dd17a443b10e7a2944cc271686ba4055c79b44b89"}
Jul 07 15:46:53.073245 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.073195    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:46:53.111831 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.111801    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-bundle\") pod \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") "
Jul 07 15:46:53.111831 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.111835    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs65s\" (UniqueName: \"kubernetes.io/projected/cf58509c-49a4-4e72-845d-b5d4a4f86cee-kube-api-access-xs65s\") pod \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") "
Jul 07 15:46:53.112029 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.111869    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-util\") pod \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\" (UID: \"cf58509c-49a4-4e72-845d-b5d4a4f86cee\") "
Jul 07 15:46:53.112826 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.112790    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-bundle" (OuterVolumeSpecName: "bundle") pod "cf58509c-49a4-4e72-845d-b5d4a4f86cee" (UID: "cf58509c-49a4-4e72-845d-b5d4a4f86cee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:53.114378 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.114347    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf58509c-49a4-4e72-845d-b5d4a4f86cee-kube-api-access-xs65s" (OuterVolumeSpecName: "kube-api-access-xs65s") pod "cf58509c-49a4-4e72-845d-b5d4a4f86cee" (UID: "cf58509c-49a4-4e72-845d-b5d4a4f86cee"). InnerVolumeSpecName "kube-api-access-xs65s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:46:53.118894 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.118849    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-util" (OuterVolumeSpecName: "util") pod "cf58509c-49a4-4e72-845d-b5d4a4f86cee" (UID: "cf58509c-49a4-4e72-845d-b5d4a4f86cee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:53.212564 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.212466    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:53.212564 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.212502    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf58509c-49a4-4e72-845d-b5d4a4f86cee-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:53.212564 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.212516    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs65s\" (UniqueName: \"kubernetes.io/projected/cf58509c-49a4-4e72-845d-b5d4a4f86cee-kube-api-access-xs65s\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:46:53.932513 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.932480    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2" event={"ID":"cf58509c-49a4-4e72-845d-b5d4a4f86cee","Type":"ContainerDied","Data":"dc9bbfdee5bb39b63d4ead3cf201a4cb4d90bf96598b737e86a65d5fa19f545b"}
Jul 07 15:46:53.932680 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.932527    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc9bbfdee5bb39b63d4ead3cf201a4cb4d90bf96598b737e86a65d5fa19f545b"
Jul 07 15:46:53.932680 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:46:53.932496    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz88p2"
Jul 07 15:47:05.071465 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071425    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7444699877-czv55"]
Jul 07 15:47:05.071830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071757    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="util"
Jul 07 15:47:05.071830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071771    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="util"
Jul 07 15:47:05.071830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071785    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="pull"
Jul 07 15:47:05.071830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071791    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="pull"
Jul 07 15:47:05.071830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071811    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="extract"
Jul 07 15:47:05.071830 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071817    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="extract"
Jul 07 15:47:05.072011 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.071867    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf58509c-49a4-4e72-845d-b5d4a4f86cee" containerName="extract"
Jul 07 15:47:05.074261 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.074245    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.081613 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.081588    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 15:47:05.081739 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.081612    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-df7tn\""
Jul 07 15:47:05.081739 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.081617    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 15:47:05.081739 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.081717    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 15:47:05.087510 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.087486    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7444699877-czv55"]
Jul 07 15:47:05.104670 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.104646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7b73d3b-b1c4-4136-9100-1eb80cae737f-cert\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.104821 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.104682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjf2\" (UniqueName: \"kubernetes.io/projected/b7b73d3b-b1c4-4136-9100-1eb80cae737f-kube-api-access-mfjf2\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.104821 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.104720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b7b73d3b-b1c4-4136-9100-1eb80cae737f-manager-config\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.104821 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.104778    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7b73d3b-b1c4-4136-9100-1eb80cae737f-metrics-cert\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.205890 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.205858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7b73d3b-b1c4-4136-9100-1eb80cae737f-cert\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.206145 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.205908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjf2\" (UniqueName: \"kubernetes.io/projected/b7b73d3b-b1c4-4136-9100-1eb80cae737f-kube-api-access-mfjf2\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.206145 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.205952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b7b73d3b-b1c4-4136-9100-1eb80cae737f-manager-config\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.206145 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.205987    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7b73d3b-b1c4-4136-9100-1eb80cae737f-metrics-cert\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.206640 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.206613    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b7b73d3b-b1c4-4136-9100-1eb80cae737f-manager-config\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.208369 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.208339    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7b73d3b-b1c4-4136-9100-1eb80cae737f-metrics-cert\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.208466 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.208434    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7b73d3b-b1c4-4136-9100-1eb80cae737f-cert\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.217390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.217368    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjf2\" (UniqueName: \"kubernetes.io/projected/b7b73d3b-b1c4-4136-9100-1eb80cae737f-kube-api-access-mfjf2\") pod \"lws-controller-manager-7444699877-czv55\" (UID: \"b7b73d3b-b1c4-4136-9100-1eb80cae737f\") " pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.383301 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.383267    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:05.545375 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.545260    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7444699877-czv55"]
Jul 07 15:47:05.547186 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:47:05.547164    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b73d3b_b1c4_4136_9100_1eb80cae737f.slice/crio-3e4c9eb03a829040294c586829fef0e94d622fc37f4e0443f7fc68e4795479a4 WatchSource:0}: Error finding container 3e4c9eb03a829040294c586829fef0e94d622fc37f4e0443f7fc68e4795479a4: Status 404 returned error can't find the container with id 3e4c9eb03a829040294c586829fef0e94d622fc37f4e0443f7fc68e4795479a4
Jul 07 15:47:05.591297 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.591258    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"]
Jul 07 15:47:05.596046 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.596023    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.604910 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.604888    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 15:47:05.605034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.604915    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 15:47:05.605034 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.604966    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 15:47:05.605151 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.605069    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 15:47:05.605295 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.605271    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kvnwl\""
Jul 07 15:47:05.616767 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.616745    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"]
Jul 07 15:47:05.711118 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.711027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/827b5763-2dde-46db-baae-4382121b0e2f-tmp\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.711118 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.711070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mgv\" (UniqueName: \"kubernetes.io/projected/827b5763-2dde-46db-baae-4382121b0e2f-kube-api-access-l4mgv\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.711118 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.711099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/827b5763-2dde-46db-baae-4382121b0e2f-manifests\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.711365 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.711158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/827b5763-2dde-46db-baae-4382121b0e2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.711365 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.711216    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/827b5763-2dde-46db-baae-4382121b0e2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.812518 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.812483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/827b5763-2dde-46db-baae-4382121b0e2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.812701 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.812532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/827b5763-2dde-46db-baae-4382121b0e2f-tmp\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.812701 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.812554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mgv\" (UniqueName: \"kubernetes.io/projected/827b5763-2dde-46db-baae-4382121b0e2f-kube-api-access-l4mgv\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.812701 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.812587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/827b5763-2dde-46db-baae-4382121b0e2f-manifests\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.812701 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.812623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/827b5763-2dde-46db-baae-4382121b0e2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.813016 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.812995    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/827b5763-2dde-46db-baae-4382121b0e2f-manifests\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.814885 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.814865    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/827b5763-2dde-46db-baae-4382121b0e2f-tmp\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.815005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.814986    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/827b5763-2dde-46db-baae-4382121b0e2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.815125 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.815109    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/827b5763-2dde-46db-baae-4382121b0e2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.826376 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.826348    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mgv\" (UniqueName: \"kubernetes.io/projected/827b5763-2dde-46db-baae-4382121b0e2f-kube-api-access-l4mgv\") pod \"opendatahub-operator-controller-manager-685dff6fcf-cmjjp\" (UID: \"827b5763-2dde-46db-baae-4382121b0e2f\") " pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.906356 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.906316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:05.985328 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:05.985225    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55" event={"ID":"b7b73d3b-b1c4-4136-9100-1eb80cae737f","Type":"ContainerStarted","Data":"3e4c9eb03a829040294c586829fef0e94d622fc37f4e0443f7fc68e4795479a4"}
Jul 07 15:47:06.056670 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:06.056634    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"]
Jul 07 15:47:06.060587 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:47:06.060560    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827b5763_2dde_46db_baae_4382121b0e2f.slice/crio-520d0ae6be41dba4eea6526ae81a8a7c5f378746c99ce2c0f885bbf5b61b548b WatchSource:0}: Error finding container 520d0ae6be41dba4eea6526ae81a8a7c5f378746c99ce2c0f885bbf5b61b548b: Status 404 returned error can't find the container with id 520d0ae6be41dba4eea6526ae81a8a7c5f378746c99ce2c0f885bbf5b61b548b
Jul 07 15:47:06.994180 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:06.994108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp" event={"ID":"827b5763-2dde-46db-baae-4382121b0e2f","Type":"ContainerStarted","Data":"520d0ae6be41dba4eea6526ae81a8a7c5f378746c99ce2c0f885bbf5b61b548b"}
Jul 07 15:47:08.001331 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:08.001279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55" event={"ID":"b7b73d3b-b1c4-4136-9100-1eb80cae737f","Type":"ContainerStarted","Data":"a31e8a4d138867d9c778c993f35da3adb4178d8a43500de3591b8f2dab727d8e"}
Jul 07 15:47:08.001768 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:08.001367    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:08.027586 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:08.027533    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55" podStartSLOduration=1.328770247 podStartE2EDuration="3.027514746s" totalImagesPullingTime="1.698744499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:08.026406399 +0000 UTC m=+368.161832262" watchObservedRunningTime="2026-07-07 15:47:08.027514746 +0000 UTC m=+368.162940610"
Jul 07 15:47:10.012125 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:10.012086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp" event={"ID":"827b5763-2dde-46db-baae-4382121b0e2f","Type":"ContainerStarted","Data":"75f96a649af700bab77e70f90fb51999bb3e1e9f909684cc8624826c58699db7"}
Jul 07 15:47:11.018279 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:11.018228    2570 generic.go:356] "Generic (PLEG): container finished" podID="827b5763-2dde-46db-baae-4382121b0e2f" containerID="75f96a649af700bab77e70f90fb51999bb3e1e9f909684cc8624826c58699db7" exitCode=0
Jul 07 15:47:11.018766 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:11.018300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp" event={"ID":"827b5763-2dde-46db-baae-4382121b0e2f","Type":"ContainerDied","Data":"75f96a649af700bab77e70f90fb51999bb3e1e9f909684cc8624826c58699db7"}
Jul 07 15:47:12.024704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:12.024661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp" event={"ID":"827b5763-2dde-46db-baae-4382121b0e2f","Type":"ContainerStarted","Data":"4b05b2011365cd999bacfc121dfafc7cfdc3a4156c0856252e2cfbc1638c4b15"}
Jul 07 15:47:12.025171 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:12.024756    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:12.052661 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:12.052610    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp" podStartSLOduration=2.618632202 podStartE2EDuration="7.052593189s" totalImagesPullingTime="3.265081522s" totalInitContainerRuntime="1.168879465s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:12.051495458 +0000 UTC m=+372.186921332" watchObservedRunningTime="2026-07-07 15:47:12.052593189 +0000 UTC m=+372.188019052"
Jul 07 15:47:19.009179 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:19.009147    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7444699877-czv55"
Jul 07 15:47:23.031850 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:23.031816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-685dff6fcf-cmjjp"
Jul 07 15:47:35.575714 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.575676    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"]
Jul 07 15:47:35.577671 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.577654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.580334 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580309    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 15:47:35.580486 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580314    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 15:47:35.580486 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580406    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 15:47:35.580486 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580436    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gq5pn\""
Jul 07 15:47:35.580662 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580569    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 15:47:35.580721 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580666    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 15:47:35.580780 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.580722    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 15:47:35.600959 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.600932    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"]
Jul 07 15:47:35.664458 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.664458 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4s2s\" (UniqueName: \"kubernetes.io/projected/18c8cee2-a293-4582-bad1-8cb352594b7f-kube-api-access-r4s2s\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.664682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.664682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c8cee2-a293-4582-bad1-8cb352594b7f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.664682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664575    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.664682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.664682 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.664676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766072 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766283 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766080    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766283 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4s2s\" (UniqueName: \"kubernetes.io/projected/18c8cee2-a293-4582-bad1-8cb352594b7f-kube-api-access-r4s2s\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766283 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766183    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766283 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c8cee2-a293-4582-bad1-8cb352594b7f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766283 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.766522 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.767015 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.766953    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.768546 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.768511    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c8cee2-a293-4582-bad1-8cb352594b7f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.768658 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.768564    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.768658 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.768626    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.768774 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.768720    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.782721 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.782698    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c8cee2-a293-4582-bad1-8cb352594b7f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.783499 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.783479    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4s2s\" (UniqueName: \"kubernetes.io/projected/18c8cee2-a293-4582-bad1-8cb352594b7f-kube-api-access-r4s2s\") pod \"istiod-openshift-gateway-94bb8fbfd-nzwjn\" (UID: \"18c8cee2-a293-4582-bad1-8cb352594b7f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:35.887206 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:35.887168    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:36.053104 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:36.052962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"]
Jul 07 15:47:36.055933 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:47:36.055905    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c8cee2_a293_4582_bad1_8cb352594b7f.slice/crio-89b3efea80ec4d2e4a29e0d04effbb5ce30d221c1a150c91fe41af2392a59bfe WatchSource:0}: Error finding container 89b3efea80ec4d2e4a29e0d04effbb5ce30d221c1a150c91fe41af2392a59bfe: Status 404 returned error can't find the container with id 89b3efea80ec4d2e4a29e0d04effbb5ce30d221c1a150c91fe41af2392a59bfe
Jul 07 15:47:36.136043 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:36.136008    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn" event={"ID":"18c8cee2-a293-4582-bad1-8cb352594b7f","Type":"ContainerStarted","Data":"89b3efea80ec4d2e4a29e0d04effbb5ce30d221c1a150c91fe41af2392a59bfe"}
Jul 07 15:47:38.379980 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:38.379938    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 15:47:38.380289 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:38.380007    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 15:47:39.152119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:39.152083    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn" event={"ID":"18c8cee2-a293-4582-bad1-8cb352594b7f","Type":"ContainerStarted","Data":"74a344925aa5f2f1a6735da5af7f027a78a02b415fb6ed6dcce89a83d71c09bd"}
Jul 07 15:47:39.152326 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:39.152264    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:39.153859 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:39.153833    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nzwjn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 15:47:39.153965 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:39.153881    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn" podUID="18c8cee2-a293-4582-bad1-8cb352594b7f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 15:47:40.157781 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:40.157742    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn"
Jul 07 15:47:40.208634 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:47:40.208568    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzwjn" podStartSLOduration=2.886857435 podStartE2EDuration="5.208551626s" totalImagesPullingTime="2.321694191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:39.283812058 +0000 UTC m=+399.419237926" watchObservedRunningTime="2026-07-07 15:47:40.208551626 +0000 UTC m=+400.343977489"
Jul 07 15:48:42.766619 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.766579    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"]
Jul 07 15:48:42.769932 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.769916    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:42.772854 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.772831    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:48:42.773786 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.773769    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:48:42.773859 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.773780    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jglv8\""
Jul 07 15:48:42.779149 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.779114    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"]
Jul 07 15:48:42.915570 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.915526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjstq\" (UniqueName: \"kubernetes.io/projected/6bb2d778-9316-4cc7-824a-98d580b26955-kube-api-access-mjstq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:42.915764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.915584    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:42.915764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:42.915655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.017142 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.017036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.017356 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.017142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjstq\" (UniqueName: \"kubernetes.io/projected/6bb2d778-9316-4cc7-824a-98d580b26955-kube-api-access-mjstq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.017356 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.017190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.017490 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.017434    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.017606 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.017524    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.027464 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.027433    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjstq\" (UniqueName: \"kubernetes.io/projected/6bb2d778-9316-4cc7-824a-98d580b26955-kube-api-access-mjstq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.080079 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.080040    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:43.221675 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.221640    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"]
Jul 07 15:48:43.224762 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:48:43.224733    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb2d778_9316_4cc7_824a_98d580b26955.slice/crio-ce068b28778b8bdffd2b3c047fce7b7fb596f0a163a076e98c5aab45a9f97b8e WatchSource:0}: Error finding container ce068b28778b8bdffd2b3c047fce7b7fb596f0a163a076e98c5aab45a9f97b8e: Status 404 returned error can't find the container with id ce068b28778b8bdffd2b3c047fce7b7fb596f0a163a076e98c5aab45a9f97b8e
Jul 07 15:48:43.371643 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.371611    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"]
Jul 07 15:48:43.375061 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.375044    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.385316 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.385292    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"]
Jul 07 15:48:43.436270 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.436221    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bb2d778-9316-4cc7-824a-98d580b26955" containerID="fc198c757a4d1f0a7b291b2f0c6e7a81dc939f4e4e712e332f4c3cdc92a71676" exitCode=0
Jul 07 15:48:43.436472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.436307    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l" event={"ID":"6bb2d778-9316-4cc7-824a-98d580b26955","Type":"ContainerDied","Data":"fc198c757a4d1f0a7b291b2f0c6e7a81dc939f4e4e712e332f4c3cdc92a71676"}
Jul 07 15:48:43.436472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.436363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l" event={"ID":"6bb2d778-9316-4cc7-824a-98d580b26955","Type":"ContainerStarted","Data":"ce068b28778b8bdffd2b3c047fce7b7fb596f0a163a076e98c5aab45a9f97b8e"}
Jul 07 15:48:43.521944 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.521856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.521944 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.521916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9fk\" (UniqueName: \"kubernetes.io/projected/c083d2ed-f96f-459c-b6ed-c847e729eb21-kube-api-access-6l9fk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.522125 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.521959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.622920 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.622877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.623119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.622964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.623119 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.622996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9fk\" (UniqueName: \"kubernetes.io/projected/c083d2ed-f96f-459c-b6ed-c847e729eb21-kube-api-access-6l9fk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.623413 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.623391    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.623413 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.623405    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.633941 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.633912    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9fk\" (UniqueName: \"kubernetes.io/projected/c083d2ed-f96f-459c-b6ed-c847e729eb21-kube-api-access-6l9fk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.684627 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.684588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:43.771447 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.771415    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"]
Jul 07 15:48:43.775193 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.775134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:43.786601 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.786422    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"]
Jul 07 15:48:43.823735 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.823709    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"]
Jul 07 15:48:43.825613 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:48:43.825591    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc083d2ed_f96f_459c_b6ed_c847e729eb21.slice/crio-7fe4c50108eaa7da3f1b5ad6376cdf34311460f68bc711e2de9ff3ac49aa61a4 WatchSource:0}: Error finding container 7fe4c50108eaa7da3f1b5ad6376cdf34311460f68bc711e2de9ff3ac49aa61a4: Status 404 returned error can't find the container with id 7fe4c50108eaa7da3f1b5ad6376cdf34311460f68bc711e2de9ff3ac49aa61a4
Jul 07 15:48:43.924647 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.924616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:43.924785 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.924673    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxph\" (UniqueName: \"kubernetes.io/projected/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-kube-api-access-wgxph\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:43.924785 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:43.924740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.025423 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.025348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.025423 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.025397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxph\" (UniqueName: \"kubernetes.io/projected/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-kube-api-access-wgxph\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.025423 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.025422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.025777 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.025755    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.025777 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.025766    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.036010 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.035983    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxph\" (UniqueName: \"kubernetes.io/projected/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-kube-api-access-wgxph\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.086716 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.086512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:44.180349 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.180323    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"]
Jul 07 15:48:44.183728 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.183689    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.196772 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.196734    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"]
Jul 07 15:48:44.245132 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.245078    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"]
Jul 07 15:48:44.283175 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:48:44.283091    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3e5971_b3f3_49a9_a3dc_39829fcb1e5b.slice/crio-a87c6290622ddafa80b4aa1db4bff258575bc14262c3895ab408f83879e9cf16 WatchSource:0}: Error finding container a87c6290622ddafa80b4aa1db4bff258575bc14262c3895ab408f83879e9cf16: Status 404 returned error can't find the container with id a87c6290622ddafa80b4aa1db4bff258575bc14262c3895ab408f83879e9cf16
Jul 07 15:48:44.328280 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.328256    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.328390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.328299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjlp\" (UniqueName: \"kubernetes.io/projected/c69ac680-c66a-440a-a0eb-0be9500df0e7-kube-api-access-lwjlp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.328390 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.328361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.429326 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.429283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.429487 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.429333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjlp\" (UniqueName: \"kubernetes.io/projected/c69ac680-c66a-440a-a0eb-0be9500df0e7-kube-api-access-lwjlp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.429487 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.429430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.429706 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.429680    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.429778 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.429739    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.439200 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.439174    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjlp\" (UniqueName: \"kubernetes.io/projected/c69ac680-c66a-440a-a0eb-0be9500df0e7-kube-api-access-lwjlp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.442077 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.442053    2570 generic.go:356] "Generic (PLEG): container finished" podID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerID="c23e65a5234da03845b259856699fa480a7952b7732c93906725cd5b41ba581c" exitCode=0
Jul 07 15:48:44.442176 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.442135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm" event={"ID":"c083d2ed-f96f-459c-b6ed-c847e729eb21","Type":"ContainerDied","Data":"c23e65a5234da03845b259856699fa480a7952b7732c93906725cd5b41ba581c"}
Jul 07 15:48:44.442223 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.442190    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm" event={"ID":"c083d2ed-f96f-459c-b6ed-c847e729eb21","Type":"ContainerStarted","Data":"7fe4c50108eaa7da3f1b5ad6376cdf34311460f68bc711e2de9ff3ac49aa61a4"}
Jul 07 15:48:44.443997 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.443978    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bb2d778-9316-4cc7-824a-98d580b26955" containerID="5eee7bffbbb611c187924098625e798301ac64b34c839dc626f9ecfdf9f8fe83" exitCode=0
Jul 07 15:48:44.444079 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.444061    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l" event={"ID":"6bb2d778-9316-4cc7-824a-98d580b26955","Type":"ContainerDied","Data":"5eee7bffbbb611c187924098625e798301ac64b34c839dc626f9ecfdf9f8fe83"}
Jul 07 15:48:44.445648 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.445631    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerID="024a1d721ffc1b636461152ed9d24dacec6241516e90e9fb67eeb12d5ecbe293" exitCode=0
Jul 07 15:48:44.445698 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.445663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g" event={"ID":"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b","Type":"ContainerDied","Data":"024a1d721ffc1b636461152ed9d24dacec6241516e90e9fb67eeb12d5ecbe293"}
Jul 07 15:48:44.445698 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.445692    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g" event={"ID":"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b","Type":"ContainerStarted","Data":"a87c6290622ddafa80b4aa1db4bff258575bc14262c3895ab408f83879e9cf16"}
Jul 07 15:48:44.494573 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.494555    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:44.636921 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:44.636876    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"]
Jul 07 15:48:44.642256 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:48:44.642216    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69ac680_c66a_440a_a0eb_0be9500df0e7.slice/crio-56a007703bd631c9548d8c1220a1e501cfe361ab9ba8c4d5299366cb21f8fe67 WatchSource:0}: Error finding container 56a007703bd631c9548d8c1220a1e501cfe361ab9ba8c4d5299366cb21f8fe67: Status 404 returned error can't find the container with id 56a007703bd631c9548d8c1220a1e501cfe361ab9ba8c4d5299366cb21f8fe67
Jul 07 15:48:45.456281 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.456219    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bb2d778-9316-4cc7-824a-98d580b26955" containerID="5b6a5bec965b5ad75cbd93476e4710f4f6f6ea1dd0b6e5de1ad812cb3e45d230" exitCode=0
Jul 07 15:48:45.456720 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.456359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l" event={"ID":"6bb2d778-9316-4cc7-824a-98d580b26955","Type":"ContainerDied","Data":"5b6a5bec965b5ad75cbd93476e4710f4f6f6ea1dd0b6e5de1ad812cb3e45d230"}
Jul 07 15:48:45.458126 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.458102    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerID="90846f5e21a0cf9e1d50f050e4f246962ac54a48dccb7b58294bddaa2888892b" exitCode=0
Jul 07 15:48:45.458260 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.458186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g" event={"ID":"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b","Type":"ContainerDied","Data":"90846f5e21a0cf9e1d50f050e4f246962ac54a48dccb7b58294bddaa2888892b"}
Jul 07 15:48:45.459915 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.459895    2570 generic.go:356] "Generic (PLEG): container finished" podID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerID="c5b27447fea7798669695234c18b94d201dbe2e76679748f8829e72034bba10f" exitCode=0
Jul 07 15:48:45.460002 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.459984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm" event={"ID":"c083d2ed-f96f-459c-b6ed-c847e729eb21","Type":"ContainerDied","Data":"c5b27447fea7798669695234c18b94d201dbe2e76679748f8829e72034bba10f"}
Jul 07 15:48:45.461733 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.461714    2570 generic.go:356] "Generic (PLEG): container finished" podID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerID="e81849a1385378d49d62ffc8ad8edcdc1772c06d3c2d7957d1c80c8c4c52dc31" exitCode=0
Jul 07 15:48:45.461813 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.461766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz" event={"ID":"c69ac680-c66a-440a-a0eb-0be9500df0e7","Type":"ContainerDied","Data":"e81849a1385378d49d62ffc8ad8edcdc1772c06d3c2d7957d1c80c8c4c52dc31"}
Jul 07 15:48:45.461813 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:45.461799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz" event={"ID":"c69ac680-c66a-440a-a0eb-0be9500df0e7","Type":"ContainerStarted","Data":"56a007703bd631c9548d8c1220a1e501cfe361ab9ba8c4d5299366cb21f8fe67"}
Jul 07 15:48:46.468360 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.468272    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerID="ce54872034ad47ba54f2fb3d2233960dc9a208ed7d68088670fb35642e73f97b" exitCode=0
Jul 07 15:48:46.468360 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.468324    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g" event={"ID":"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b","Type":"ContainerDied","Data":"ce54872034ad47ba54f2fb3d2233960dc9a208ed7d68088670fb35642e73f97b"}
Jul 07 15:48:46.470298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.470273    2570 generic.go:356] "Generic (PLEG): container finished" podID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerID="97dbd3f391531f476a4006c81eb019ec42ba602a8405e7bd56b883b27206c0f7" exitCode=0
Jul 07 15:48:46.470564 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.470344    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm" event={"ID":"c083d2ed-f96f-459c-b6ed-c847e729eb21","Type":"ContainerDied","Data":"97dbd3f391531f476a4006c81eb019ec42ba602a8405e7bd56b883b27206c0f7"}
Jul 07 15:48:46.471863 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.471839    2570 generic.go:356] "Generic (PLEG): container finished" podID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerID="26f938c44f29d96a4ca5641fa9b63b1adfddb855ddbcaf5fa4bc35591102ee97" exitCode=0
Jul 07 15:48:46.471971 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.471863    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz" event={"ID":"c69ac680-c66a-440a-a0eb-0be9500df0e7","Type":"ContainerDied","Data":"26f938c44f29d96a4ca5641fa9b63b1adfddb855ddbcaf5fa4bc35591102ee97"}
Jul 07 15:48:46.610496 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.610469    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:46.751352 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.751257    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-bundle\") pod \"6bb2d778-9316-4cc7-824a-98d580b26955\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") "
Jul 07 15:48:46.751352 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.751297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-util\") pod \"6bb2d778-9316-4cc7-824a-98d580b26955\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") "
Jul 07 15:48:46.751539 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.751406    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjstq\" (UniqueName: \"kubernetes.io/projected/6bb2d778-9316-4cc7-824a-98d580b26955-kube-api-access-mjstq\") pod \"6bb2d778-9316-4cc7-824a-98d580b26955\" (UID: \"6bb2d778-9316-4cc7-824a-98d580b26955\") "
Jul 07 15:48:46.751796 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.751769    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-bundle" (OuterVolumeSpecName: "bundle") pod "6bb2d778-9316-4cc7-824a-98d580b26955" (UID: "6bb2d778-9316-4cc7-824a-98d580b26955"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:46.753636 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.753610    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb2d778-9316-4cc7-824a-98d580b26955-kube-api-access-mjstq" (OuterVolumeSpecName: "kube-api-access-mjstq") pod "6bb2d778-9316-4cc7-824a-98d580b26955" (UID: "6bb2d778-9316-4cc7-824a-98d580b26955"). InnerVolumeSpecName "kube-api-access-mjstq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:46.757081 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.757056    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-util" (OuterVolumeSpecName: "util") pod "6bb2d778-9316-4cc7-824a-98d580b26955" (UID: "6bb2d778-9316-4cc7-824a-98d580b26955"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:46.852786 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.852748    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjstq\" (UniqueName: \"kubernetes.io/projected/6bb2d778-9316-4cc7-824a-98d580b26955-kube-api-access-mjstq\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:46.852786 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.852782    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:46.852786 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:46.852793    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bb2d778-9316-4cc7-824a-98d580b26955-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:47.478438 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.478405    2570 generic.go:356] "Generic (PLEG): container finished" podID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerID="4434779fd7de937d4349e9d2d87a460eba63e691e90b4900a9dcbc8dabc4cfa4" exitCode=0
Jul 07 15:48:47.478921 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.478492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz" event={"ID":"c69ac680-c66a-440a-a0eb-0be9500df0e7","Type":"ContainerDied","Data":"4434779fd7de937d4349e9d2d87a460eba63e691e90b4900a9dcbc8dabc4cfa4"}
Jul 07 15:48:47.480391 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.480370    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l"
Jul 07 15:48:47.480511 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.480408    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l" event={"ID":"6bb2d778-9316-4cc7-824a-98d580b26955","Type":"ContainerDied","Data":"ce068b28778b8bdffd2b3c047fce7b7fb596f0a163a076e98c5aab45a9f97b8e"}
Jul 07 15:48:47.480511 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.480443    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce068b28778b8bdffd2b3c047fce7b7fb596f0a163a076e98c5aab45a9f97b8e"
Jul 07 15:48:47.617624 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.617594    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:47.650092 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.650067    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:47.760511 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.760425    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgxph\" (UniqueName: \"kubernetes.io/projected/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-kube-api-access-wgxph\") pod \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") "
Jul 07 15:48:47.760511 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.760476    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9fk\" (UniqueName: \"kubernetes.io/projected/c083d2ed-f96f-459c-b6ed-c847e729eb21-kube-api-access-6l9fk\") pod \"c083d2ed-f96f-459c-b6ed-c847e729eb21\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") "
Jul 07 15:48:47.760764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.760519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-bundle\") pod \"c083d2ed-f96f-459c-b6ed-c847e729eb21\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") "
Jul 07 15:48:47.760764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.760568    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-bundle\") pod \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") "
Jul 07 15:48:47.760764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.760595    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-util\") pod \"c083d2ed-f96f-459c-b6ed-c847e729eb21\" (UID: \"c083d2ed-f96f-459c-b6ed-c847e729eb21\") "
Jul 07 15:48:47.760764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.760617    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-util\") pod \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\" (UID: \"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b\") "
Jul 07 15:48:47.761326 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.761295    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-bundle" (OuterVolumeSpecName: "bundle") pod "c083d2ed-f96f-459c-b6ed-c847e729eb21" (UID: "c083d2ed-f96f-459c-b6ed-c847e729eb21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:47.761430 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.761341    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-bundle" (OuterVolumeSpecName: "bundle") pod "ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" (UID: "ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:47.763185 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.763167    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c083d2ed-f96f-459c-b6ed-c847e729eb21-kube-api-access-6l9fk" (OuterVolumeSpecName: "kube-api-access-6l9fk") pod "c083d2ed-f96f-459c-b6ed-c847e729eb21" (UID: "c083d2ed-f96f-459c-b6ed-c847e729eb21"). InnerVolumeSpecName "kube-api-access-6l9fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:47.763260 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.763191    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-kube-api-access-wgxph" (OuterVolumeSpecName: "kube-api-access-wgxph") pod "ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" (UID: "ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b"). InnerVolumeSpecName "kube-api-access-wgxph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:47.768952 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.768906    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-util" (OuterVolumeSpecName: "util") pod "ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" (UID: "ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:47.769338 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.769316    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-util" (OuterVolumeSpecName: "util") pod "c083d2ed-f96f-459c-b6ed-c847e729eb21" (UID: "c083d2ed-f96f-459c-b6ed-c847e729eb21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:47.861284 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.861223    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgxph\" (UniqueName: \"kubernetes.io/projected/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-kube-api-access-wgxph\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:47.861284 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.861281    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9fk\" (UniqueName: \"kubernetes.io/projected/c083d2ed-f96f-459c-b6ed-c847e729eb21-kube-api-access-6l9fk\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:47.861284 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.861291    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:47.861502 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.861303    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:47.861502 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.861312    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c083d2ed-f96f-459c-b6ed-c847e729eb21-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:47.861502 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:47.861319    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:48.486698 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.486671    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g"
Jul 07 15:48:48.486698 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.486680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g" event={"ID":"ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b","Type":"ContainerDied","Data":"a87c6290622ddafa80b4aa1db4bff258575bc14262c3895ab408f83879e9cf16"}
Jul 07 15:48:48.487162 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.486724    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a87c6290622ddafa80b4aa1db4bff258575bc14262c3895ab408f83879e9cf16"
Jul 07 15:48:48.488604 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.488570    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm" event={"ID":"c083d2ed-f96f-459c-b6ed-c847e729eb21","Type":"ContainerDied","Data":"7fe4c50108eaa7da3f1b5ad6376cdf34311460f68bc711e2de9ff3ac49aa61a4"}
Jul 07 15:48:48.488712 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.488618    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fe4c50108eaa7da3f1b5ad6376cdf34311460f68bc711e2de9ff3ac49aa61a4"
Jul 07 15:48:48.488852 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.488828    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm"
Jul 07 15:48:48.626449 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.626425    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:48.769431 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.769335    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwjlp\" (UniqueName: \"kubernetes.io/projected/c69ac680-c66a-440a-a0eb-0be9500df0e7-kube-api-access-lwjlp\") pod \"c69ac680-c66a-440a-a0eb-0be9500df0e7\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") "
Jul 07 15:48:48.769431 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.769393    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-bundle\") pod \"c69ac680-c66a-440a-a0eb-0be9500df0e7\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") "
Jul 07 15:48:48.769431 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.769421    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-util\") pod \"c69ac680-c66a-440a-a0eb-0be9500df0e7\" (UID: \"c69ac680-c66a-440a-a0eb-0be9500df0e7\") "
Jul 07 15:48:48.770005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.769977    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-bundle" (OuterVolumeSpecName: "bundle") pod "c69ac680-c66a-440a-a0eb-0be9500df0e7" (UID: "c69ac680-c66a-440a-a0eb-0be9500df0e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:48.771470 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.771446    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69ac680-c66a-440a-a0eb-0be9500df0e7-kube-api-access-lwjlp" (OuterVolumeSpecName: "kube-api-access-lwjlp") pod "c69ac680-c66a-440a-a0eb-0be9500df0e7" (UID: "c69ac680-c66a-440a-a0eb-0be9500df0e7"). InnerVolumeSpecName "kube-api-access-lwjlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:48.775527 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.775478    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-util" (OuterVolumeSpecName: "util") pod "c69ac680-c66a-440a-a0eb-0be9500df0e7" (UID: "c69ac680-c66a-440a-a0eb-0be9500df0e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:48.871048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.870997    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwjlp\" (UniqueName: \"kubernetes.io/projected/c69ac680-c66a-440a-a0eb-0be9500df0e7-kube-api-access-lwjlp\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:48.871048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.871042    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:48.871048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:48.871053    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69ac680-c66a-440a-a0eb-0be9500df0e7-util\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:48:49.494529 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:49.494500    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz"
Jul 07 15:48:49.494529 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:49.494508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz" event={"ID":"c69ac680-c66a-440a-a0eb-0be9500df0e7","Type":"ContainerDied","Data":"56a007703bd631c9548d8c1220a1e501cfe361ab9ba8c4d5299366cb21f8fe67"}
Jul 07 15:48:49.495028 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:48:49.494547    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56a007703bd631c9548d8c1220a1e501cfe361ab9ba8c4d5299366cb21f8fe67"
Jul 07 15:49:16.941468 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:16.941420    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfd65fb67-5gkh4"]
Jul 07 15:49:41.968242 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:41.968176    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cfd65fb67-5gkh4" podUID="88feb010-c943-4501-ae65-09976bbe7794" containerName="console" containerID="cri-o://49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec" gracePeriod=15
Jul 07 15:49:42.213265 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.213224    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:49:42.218850 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.218797    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-service-ca\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.218850 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.218832    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-oauth-serving-cert\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.219005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.218883    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvqvc\" (UniqueName: \"kubernetes.io/projected/88feb010-c943-4501-ae65-09976bbe7794-kube-api-access-lvqvc\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.219005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.218920    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-console-config\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.219005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.218952    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-trusted-ca-bundle\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.219005 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.218979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-oauth-config\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.219201 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.219030    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-serving-cert\") pod \"88feb010-c943-4501-ae65-09976bbe7794\" (UID: \"88feb010-c943-4501-ae65-09976bbe7794\") "
Jul 07 15:49:42.219355 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.219325    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-service-ca" (OuterVolumeSpecName: "service-ca") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:42.219355 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.219339    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:42.219504 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.219347    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-console-config" (OuterVolumeSpecName: "console-config") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:42.219504 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.219407    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:42.221104 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.221074    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:49:42.221210 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.221131    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:49:42.221210 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.221195    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88feb010-c943-4501-ae65-09976bbe7794-kube-api-access-lvqvc" (OuterVolumeSpecName: "kube-api-access-lvqvc") pod "88feb010-c943-4501-ae65-09976bbe7794" (UID: "88feb010-c943-4501-ae65-09976bbe7794"). InnerVolumeSpecName "kube-api-access-lvqvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:49:42.319505 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319470    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.319505 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319500    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-oauth-serving-cert\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.319505 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319511    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvqvc\" (UniqueName: \"kubernetes.io/projected/88feb010-c943-4501-ae65-09976bbe7794-kube-api-access-lvqvc\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.319732 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319521    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-console-config\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.319732 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319530    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88feb010-c943-4501-ae65-09976bbe7794-trusted-ca-bundle\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.319732 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319538    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-oauth-config\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.319732 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.319546    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88feb010-c943-4501-ae65-09976bbe7794-console-serving-cert\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 15:49:42.751557 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.751521    2570 generic.go:356] "Generic (PLEG): container finished" podID="88feb010-c943-4501-ae65-09976bbe7794" containerID="49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec" exitCode=0
Jul 07 15:49:42.751729 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.751566    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfd65fb67-5gkh4"
Jul 07 15:49:42.751729 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.751593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfd65fb67-5gkh4" event={"ID":"88feb010-c943-4501-ae65-09976bbe7794","Type":"ContainerDied","Data":"49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec"}
Jul 07 15:49:42.751729 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.751631    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfd65fb67-5gkh4" event={"ID":"88feb010-c943-4501-ae65-09976bbe7794","Type":"ContainerDied","Data":"b5e38b15293d0eefd43b322c54921456f7fe7b0d011eed0a9f5444109bd35eb6"}
Jul 07 15:49:42.751729 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.751650    2570 scope.go:117] "RemoveContainer" containerID="49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec"
Jul 07 15:49:42.760113 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.760093    2570 scope.go:117] "RemoveContainer" containerID="49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec"
Jul 07 15:49:42.760388 ip-10-0-141-63 kubenswrapper[2570]: E0707 15:49:42.760367    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec\": container with ID starting with 49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec not found: ID does not exist" containerID="49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec"
Jul 07 15:49:42.760472 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.760401    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec"} err="failed to get container status \"49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec\": rpc error: code = NotFound desc = could not find container \"49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec\": container with ID starting with 49658a29bbf97591492a81dd5c48dd75d2514e7d260baa42186391af91a97aec not found: ID does not exist"
Jul 07 15:49:42.788033 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.787998    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfd65fb67-5gkh4"]
Jul 07 15:49:42.793088 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:42.793057    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cfd65fb67-5gkh4"]
Jul 07 15:49:44.455282 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:49:44.455223    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88feb010-c943-4501-ae65-09976bbe7794" path="/var/lib/kubelet/pods/88feb010-c943-4501-ae65-09976bbe7794/volumes"
Jul 07 15:50:08.077468 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077428    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077844    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077863    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077881    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077889    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077904    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077913    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077923    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077932    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077943    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88feb010-c943-4501-ae65-09976bbe7794" containerName="console"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077951    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="88feb010-c943-4501-ae65-09976bbe7794" containerName="console"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077960    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="pull"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077970    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="pull"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077984    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.077992    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078002    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="pull"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078010    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="pull"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078018    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078026    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078037    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078044    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="util"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078053    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="extract"
Jul 07 15:50:08.078048 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078061    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="extract"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078071    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="pull"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078079    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="pull"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078091    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="pull"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078099    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="pull"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078181    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b" containerName="extract"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078194    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="88feb010-c943-4501-ae65-09976bbe7794" containerName="console"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078202    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69ac680-c66a-440a-a0eb-0be9500df0e7" containerName="extract"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078213    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb2d778-9316-4cc7-824a-98d580b26955" containerName="extract"
Jul 07 15:50:08.079097 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.078222    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c083d2ed-f96f-459c-b6ed-c847e729eb21" containerName="extract"
Jul 07 15:50:08.082656 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.082636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.086866 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.086846    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:50:08.088335 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.088316    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jglv8\""
Jul 07 15:50:08.088466 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.088426    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:50:08.088466 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.088426    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 15:50:08.104386 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.104362    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:50:08.122773 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.122746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0f2bf66-3706-4633-818d-6f07e3757d1f-config-file\") pod \"limitador-limitador-54d6d988d5-2hfrk\" (UID: \"f0f2bf66-3706-4633-818d-6f07e3757d1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.122885 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.122793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvdt\" (UniqueName: \"kubernetes.io/projected/f0f2bf66-3706-4633-818d-6f07e3757d1f-kube-api-access-bxvdt\") pod \"limitador-limitador-54d6d988d5-2hfrk\" (UID: \"f0f2bf66-3706-4633-818d-6f07e3757d1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.140741 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.140709    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:50:08.223154 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.223117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0f2bf66-3706-4633-818d-6f07e3757d1f-config-file\") pod \"limitador-limitador-54d6d988d5-2hfrk\" (UID: \"f0f2bf66-3706-4633-818d-6f07e3757d1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.223349 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.223168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvdt\" (UniqueName: \"kubernetes.io/projected/f0f2bf66-3706-4633-818d-6f07e3757d1f-kube-api-access-bxvdt\") pod \"limitador-limitador-54d6d988d5-2hfrk\" (UID: \"f0f2bf66-3706-4633-818d-6f07e3757d1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.223815 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.223793    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f0f2bf66-3706-4633-818d-6f07e3757d1f-config-file\") pod \"limitador-limitador-54d6d988d5-2hfrk\" (UID: \"f0f2bf66-3706-4633-818d-6f07e3757d1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.242552 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.242520    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvdt\" (UniqueName: \"kubernetes.io/projected/f0f2bf66-3706-4633-818d-6f07e3757d1f-kube-api-access-bxvdt\") pod \"limitador-limitador-54d6d988d5-2hfrk\" (UID: \"f0f2bf66-3706-4633-818d-6f07e3757d1f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.393150 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.393115    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:08.580222 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.580163    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:50:08.582535 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:50:08.582509    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f2bf66_3706_4633_818d_6f07e3757d1f.slice/crio-57a11cd7ed7bb74cfae16700280d60360ffa025059a28716f2ed084dcdd8248c WatchSource:0}: Error finding container 57a11cd7ed7bb74cfae16700280d60360ffa025059a28716f2ed084dcdd8248c: Status 404 returned error can't find the container with id 57a11cd7ed7bb74cfae16700280d60360ffa025059a28716f2ed084dcdd8248c
Jul 07 15:50:08.879960 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:08.879923    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk" event={"ID":"f0f2bf66-3706-4633-818d-6f07e3757d1f","Type":"ContainerStarted","Data":"57a11cd7ed7bb74cfae16700280d60360ffa025059a28716f2ed084dcdd8248c"}
Jul 07 15:50:11.897088 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:11.897048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk" event={"ID":"f0f2bf66-3706-4633-818d-6f07e3757d1f","Type":"ContainerStarted","Data":"f07490a1f0de5c11c6c218cf7ec3d6f118412e8016d714ea792c2b1fa678e28a"}
Jul 07 15:50:11.897509 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:11.897138    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:50:11.931838 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:11.931777    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk" podStartSLOduration=1.447606366 podStartE2EDuration="3.931762518s" totalImagesPullingTime="2.484156152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:11.929923844 +0000 UTC m=+552.065349708" watchObservedRunningTime="2026-07-07 15:50:11.931762518 +0000 UTC m=+552.067188390"
Jul 07 15:50:22.903349 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:50:22.903319    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"
Jul 07 15:51:25.131704 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:51:25.129546    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:51:59.255227 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:51:59.255189    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:52:06.821423 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.821385    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"]
Jul 07 15:52:06.824774 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.824755    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.827652 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.827629    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 15:52:06.828341 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.828320    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4zfhc\""
Jul 07 15:52:06.828464 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.828349    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 15:52:06.828591 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.828569    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 15:52:06.835829 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.835808    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"]
Jul 07 15:52:06.888933 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.888897    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53c32dc-337d-4b91-bff7-bd22e89d3b43-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.889096 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.888940    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.889096 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.888982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nwvb\" (UniqueName: \"kubernetes.io/projected/a53c32dc-337d-4b91-bff7-bd22e89d3b43-kube-api-access-8nwvb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.889096 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.889008    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.889096 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.889029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.889096 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.889082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.989629 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.989595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53c32dc-337d-4b91-bff7-bd22e89d3b43-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.989805 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.989643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.989805 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.989680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nwvb\" (UniqueName: \"kubernetes.io/projected/a53c32dc-337d-4b91-bff7-bd22e89d3b43-kube-api-access-8nwvb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.989805 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.989719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.990012 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.989973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.990153 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.990048    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.990226 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.990182    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.990298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.990223    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.990298 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.990288    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.992061 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.992033    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53c32dc-337d-4b91-bff7-bd22e89d3b43-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:06.992156 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:06.992143    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53c32dc-337d-4b91-bff7-bd22e89d3b43-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:07.001138 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:07.001109    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nwvb\" (UniqueName: \"kubernetes.io/projected/a53c32dc-337d-4b91-bff7-bd22e89d3b43-kube-api-access-8nwvb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwrxh\" (UID: \"a53c32dc-337d-4b91-bff7-bd22e89d3b43\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:07.135409 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:07.135371    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:07.267899 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:07.267873    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"]
Jul 07 15:52:07.276108 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:07.271604    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:52:07.431622 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:07.431527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh" event={"ID":"a53c32dc-337d-4b91-bff7-bd22e89d3b43","Type":"ContainerStarted","Data":"9efbb1843a5af9b20b624719ef635f7a6c85624de7dee34fda5cf0263b0fcafb"}
Jul 07 15:52:07.547197 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:07.547159    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:52:08.439641 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:08.439606    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh" event={"ID":"a53c32dc-337d-4b91-bff7-bd22e89d3b43","Type":"ContainerStarted","Data":"8a6da48298b3983eb28b301b03d0487e8348412b183e7cbeba3c14f388c5775a"}
Jul 07 15:52:08.460137 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:08.460087    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh" podStartSLOduration=1.4158834790000001 podStartE2EDuration="2.46007096s" totalImagesPullingTime="1.044187481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:08.458630573 +0000 UTC m=+668.594056430" watchObservedRunningTime="2026-07-07 15:52:08.46007096 +0000 UTC m=+668.595496823"
Jul 07 15:52:16.552982 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:16.552943    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:52:17.135787 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:17.135744    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:17.135967 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:17.135804    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:17.148132 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:17.148103    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:17.493294 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:17.493213    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwrxh"
Jul 07 15:52:22.050785 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:22.050743    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:52:37.573579 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.573544    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"]
Jul 07 15:52:37.576743 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.576722    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.581349 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.581328    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 15:52:37.594865 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.594838    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"]
Jul 07 15:52:37.644941 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.644909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.644941 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.644946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37708914-3521-4e44-9027-a6af73abdedf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.645184 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.644979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnjnj\" (UniqueName: \"kubernetes.io/projected/37708914-3521-4e44-9027-a6af73abdedf-kube-api-access-wnjnj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.645184 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.645026    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.645184 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.645084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.645184 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.645103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746255 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746421 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37708914-3521-4e44-9027-a6af73abdedf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746421 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnjnj\" (UniqueName: \"kubernetes.io/projected/37708914-3521-4e44-9027-a6af73abdedf-kube-api-access-wnjnj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746421 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746421 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746421 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746686 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746666    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746733    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.746764 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.746760    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.748693 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.748667    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37708914-3521-4e44-9027-a6af73abdedf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.748973 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.748953    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37708914-3521-4e44-9027-a6af73abdedf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.755672 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.755649    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnjnj\" (UniqueName: \"kubernetes.io/projected/37708914-3521-4e44-9027-a6af73abdedf-kube-api-access-wnjnj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hc2km\" (UID: \"37708914-3521-4e44-9027-a6af73abdedf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:37.886866 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:37.886837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:38.020272 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:38.020246    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"]
Jul 07 15:52:38.022353 ip-10-0-141-63 kubenswrapper[2570]: W0707 15:52:38.022281    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37708914_3521_4e44_9027_a6af73abdedf.slice/crio-8d880a4ef7d71a6cde5a738df451c4c22e676f3a0eba5669ddb80d26fe7d00aa WatchSource:0}: Error finding container 8d880a4ef7d71a6cde5a738df451c4c22e676f3a0eba5669ddb80d26fe7d00aa: Status 404 returned error can't find the container with id 8d880a4ef7d71a6cde5a738df451c4c22e676f3a0eba5669ddb80d26fe7d00aa
Jul 07 15:52:38.589823 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:38.589776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km" event={"ID":"37708914-3521-4e44-9027-a6af73abdedf","Type":"ContainerStarted","Data":"c09ac341d9bb84550a654d248ff066c6e68422d8e59619b1fb88c99ba6dc61a9"}
Jul 07 15:52:38.590317 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:38.589869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km" event={"ID":"37708914-3521-4e44-9027-a6af73abdedf","Type":"ContainerStarted","Data":"8d880a4ef7d71a6cde5a738df451c4c22e676f3a0eba5669ddb80d26fe7d00aa"}
Jul 07 15:52:38.614315 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:38.614263    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km" podStartSLOduration=1.235153406 podStartE2EDuration="1.614219533s" totalImagesPullingTime="379.066127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:38.613295088 +0000 UTC m=+698.748720950" watchObservedRunningTime="2026-07-07 15:52:38.614219533 +0000 UTC m=+698.749645398"
Jul 07 15:52:39.466864 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:39.466825    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:52:47.887884 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:47.887847    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:47.888384 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:47.887907    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:47.900413 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:47.900382    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:52:48.651662 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:52:48.651634    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hc2km"
Jul 07 15:53:13.459008 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:53:13.458909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:54:44.680500 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:54:44.680456    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:54:55.648995 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:54:55.648956    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:55:06.550678 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:55:06.550641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:55:14.748461 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:55:14.748422    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:55:26.148977 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:55:26.148942    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:55:53.054553 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:55:53.054463    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:56:04.352718 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:56:04.352681    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:56:41.157363 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:56:41.157269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:56:48.559263 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:56:48.559212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:56:58.462611 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:56:58.462577    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:57:06.776345 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:57:06.776301    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:57:16.455788 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:57:16.455749    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:57:28.264188 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:57:28.264107    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:57:39.380552 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:57:39.380516    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:57:48.973253 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:57:48.973197    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:58:11.949442 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:58:11.949406    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:58:24.191135 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:58:24.191096    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:58:47.562387 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:58:47.562350    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:58:58.844331 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:58:58.844228    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:59:13.458895 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:59:13.458857    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:59:23.277586 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:59:23.277548    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:59:34.866902 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:59:34.866861    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:59:43.879749 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:59:43.879714    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 15:59:52.952746 ip-10-0-141-63 kubenswrapper[2570]: I0707 15:59:52.952707    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:01:40.689632 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:01:40.689593    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:01:52.078018 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:01:52.077981    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:02:00.459398 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:02:00.459325    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:02:12.559648 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:02:12.559611    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:02:23.556765 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:02:23.556715    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:02:34.064317 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:02:34.064280    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:02:43.156856 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:02:43.156817    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:02:54.289695 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:02:54.289646    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:03:05.549989 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:03:05.549950    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:03:15.053590 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:03:15.053548    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:03:25.267732 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:03:25.267641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:03:47.073683 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:03:47.073642    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:03:57.368656 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:03:57.368618    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:04:06.985709 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:04:06.985678    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:04:18.820591 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:04:18.820550    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:04:35.182490 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:04:35.182446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:04:46.658428 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:04:46.658389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:04:55.966819 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:04:55.966729    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:05:05.767397 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:05:05.767356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:05:14.864004 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:05:14.863968    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:05:24.257062 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:05:24.257024    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:05:37.261170 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:05:37.261134    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:05:48.260403 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:05:48.260369    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:05:57.568821 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:05:57.568778    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:06:09.555821 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:06:09.555787    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:06:20.355692 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:06:20.355644    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:06:27.179179 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:06:27.179083    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:06:38.777942 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:06:38.777909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:06:52.751949 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:06:52.751910    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:07:05.455832 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:07:05.455770    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:07:14.069418 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:07:14.069380    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:07:22.658216 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:07:22.658174    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:07:35.263981 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:07:35.263939    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:07:43.586113 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:07:43.586074    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:07:55.573381 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:07:55.573340    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:08:04.175355 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:08:04.175318    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:08:13.666503 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:08:13.666457    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:08:21.261368 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:08:21.261331    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:08:30.660649 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:08:30.660606    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:08:38.793649 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:08:38.793611    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:10:05.465621 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:10:05.465578    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:10:13.260543 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:10:13.260503    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:10:20.866013 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:10:20.865979    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:10:30.364013 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:10:30.363975    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:10:40.756950 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:10:40.756912    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:11:16.155022 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:11:16.154981    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:11:32.305594 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:11:32.305552    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:11:52.653879 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:11:52.653835    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:12:02.483738 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:12:02.483700    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:12:14.951095 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:12:14.951055    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:12:59.462267 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:12:59.462216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:13:08.251132 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:13:08.251089    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:13:19.355174 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:13:19.355132    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:14:11.961053 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:11.961011    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:14:14.242882 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.242849    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"]
Jul 07 16:14:14.246149 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.246130    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.248657 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.248628    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-bda481-serving-cert\""
Jul 07 16:14:14.248779 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.248669    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bqq6\""
Jul 07 16:14:14.258505 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.258481    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"]
Jul 07 16:14:14.339538 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.339499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkvjb\" (UniqueName: \"kubernetes.io/projected/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-kube-api-access-fkvjb\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.339706 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.339601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.339706 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.339676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.440857 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.440822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.441037 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.440876    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.441037 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.440909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkvjb\" (UniqueName: \"kubernetes.io/projected/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-kube-api-access-fkvjb\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.441037 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:14:14.440970    2570 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-bda481-serving-cert: secret "maas-api-e2e-inf-b-bda481-serving-cert" not found
Jul 07 16:14:14.441270 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:14:14.441054    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls podName:efa20cd1-4b6b-4130-8aad-1f51d1d30fcc nodeName:}" failed. No retries permitted until 2026-07-07 16:14:14.941034353 +0000 UTC m=+1995.076460197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls") pod "maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" (UID: "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc") : secret "maas-api-e2e-inf-b-bda481-serving-cert" not found
Jul 07 16:14:14.441742 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.441718    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.450326 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.450292    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkvjb\" (UniqueName: \"kubernetes.io/projected/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-kube-api-access-fkvjb\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.955084 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.955041    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:14.957564 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:14.957540    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls\") pod \"maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") " pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:15.157418 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:15.157375    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:15.318337 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:15.316351    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"]
Jul 07 16:14:15.320889 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:15.320119    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:14:15.860047 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:15.860002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" event={"ID":"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc","Type":"ContainerStarted","Data":"50f10687fbbb149192edc6792650440560ccb2f92424111cf5fc1ec6acc5c727"}
Jul 07 16:14:17.872149 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:17.872107    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" event={"ID":"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc","Type":"ContainerStarted","Data":"4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68"}
Jul 07 16:14:17.872624 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:17.872275    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:17.895812 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:17.895751    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" podStartSLOduration=2.349540671 podStartE2EDuration="3.895731584s" totalImagesPullingTime="1.546190913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:14:17.895417309 +0000 UTC m=+1998.030843172" watchObservedRunningTime="2026-07-07 16:14:17.895731584 +0000 UTC m=+1998.031157448"
Jul 07 16:14:23.357356 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:23.357318    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:14:23.883390 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:23.883357    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:14:45.255479 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:45.255442    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:14:56.070536 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:14:56.070494    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:15:00.151824 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.151784    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724015-p6wvk"]
Jul 07 16:15:00.156440 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.156420    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"]
Jul 07 16:15:00.156551 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.156529    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:00.160495 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.160477    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"]
Jul 07 16:15:00.160580 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.160566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:00.166070 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.166036    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:00.166650 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.166621    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724015-p6wvk"]
Jul 07 16:15:00.169621 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.169594    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"]
Jul 07 16:15:00.172213 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.172190    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"]
Jul 07 16:15:00.229331 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.229293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxd9s\" (UniqueName: \"kubernetes.io/projected/d28f1e2c-d805-440d-a951-2adef56f15af-kube-api-access-dxd9s\") pod \"maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn\" (UID: \"d28f1e2c-d805-440d-a951-2adef56f15af\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:00.330634 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.330599    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkfx\" (UniqueName: \"kubernetes.io/projected/e7804dd5-73e8-4e15-ba85-2d0d8784a93e-kube-api-access-prkfx\") pod \"maas-api-key-cleanup-29724015-p6wvk\" (UID: \"e7804dd5-73e8-4e15-ba85-2d0d8784a93e\") " pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:00.330806 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.330642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl55b\" (UniqueName: \"kubernetes.io/projected/f4b8beca-2450-48e4-9396-1174928d257d-kube-api-access-hl55b\") pod \"maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj\" (UID: \"f4b8beca-2450-48e4-9396-1174928d257d\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:00.330806 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.330676    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxd9s\" (UniqueName: \"kubernetes.io/projected/d28f1e2c-d805-440d-a951-2adef56f15af-kube-api-access-dxd9s\") pod \"maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn\" (UID: \"d28f1e2c-d805-440d-a951-2adef56f15af\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:00.341842 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.341817    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxd9s\" (UniqueName: \"kubernetes.io/projected/d28f1e2c-d805-440d-a951-2adef56f15af-kube-api-access-dxd9s\") pod \"maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn\" (UID: \"d28f1e2c-d805-440d-a951-2adef56f15af\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:00.431498 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.431408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkfx\" (UniqueName: \"kubernetes.io/projected/e7804dd5-73e8-4e15-ba85-2d0d8784a93e-kube-api-access-prkfx\") pod \"maas-api-key-cleanup-29724015-p6wvk\" (UID: \"e7804dd5-73e8-4e15-ba85-2d0d8784a93e\") " pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:00.431498 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.431456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl55b\" (UniqueName: \"kubernetes.io/projected/f4b8beca-2450-48e4-9396-1174928d257d-kube-api-access-hl55b\") pod \"maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj\" (UID: \"f4b8beca-2450-48e4-9396-1174928d257d\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:00.442546 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.442510    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl55b\" (UniqueName: \"kubernetes.io/projected/f4b8beca-2450-48e4-9396-1174928d257d-kube-api-access-hl55b\") pod \"maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj\" (UID: \"f4b8beca-2450-48e4-9396-1174928d257d\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:00.442680 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.442659    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkfx\" (UniqueName: \"kubernetes.io/projected/e7804dd5-73e8-4e15-ba85-2d0d8784a93e-kube-api-access-prkfx\") pod \"maas-api-key-cleanup-29724015-p6wvk\" (UID: \"e7804dd5-73e8-4e15-ba85-2d0d8784a93e\") " pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:00.471350 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.471322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:00.480858 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.480825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:00.487449 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.487422    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:00.641907 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.641878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724015-p6wvk"]
Jul 07 16:15:00.644614 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:15:00.644582    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7804dd5_73e8_4e15_ba85_2d0d8784a93e.slice/crio-f12d14f78176345d2a3a9ec0eec18c662d207d1dc58b5a285ac4a1125851b974 WatchSource:0}: Error finding container f12d14f78176345d2a3a9ec0eec18c662d207d1dc58b5a285ac4a1125851b974: Status 404 returned error can't find the container with id f12d14f78176345d2a3a9ec0eec18c662d207d1dc58b5a285ac4a1125851b974
Jul 07 16:15:00.872559 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.872532    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"]
Jul 07 16:15:00.874998 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:15:00.874967    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b8beca_2450_48e4_9396_1174928d257d.slice/crio-b5c5ce7e31499e35e8e488459bccf938b2101853a47f79340b4d4030a4f899ae WatchSource:0}: Error finding container b5c5ce7e31499e35e8e488459bccf938b2101853a47f79340b4d4030a4f899ae: Status 404 returned error can't find the container with id b5c5ce7e31499e35e8e488459bccf938b2101853a47f79340b4d4030a4f899ae
Jul 07 16:15:00.875478 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:00.875458    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"]
Jul 07 16:15:00.875983 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:15:00.875957    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28f1e2c_d805_440d_a951_2adef56f15af.slice/crio-3e09b05679d083f9d3e5a670ad17413ff9e08f6e86aeba7589774c9fac87dfc9 WatchSource:0}: Error finding container 3e09b05679d083f9d3e5a670ad17413ff9e08f6e86aeba7589774c9fac87dfc9: Status 404 returned error can't find the container with id 3e09b05679d083f9d3e5a670ad17413ff9e08f6e86aeba7589774c9fac87dfc9
Jul 07 16:15:01.086299 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:01.086259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj" event={"ID":"f4b8beca-2450-48e4-9396-1174928d257d","Type":"ContainerStarted","Data":"b5c5ce7e31499e35e8e488459bccf938b2101853a47f79340b4d4030a4f899ae"}
Jul 07 16:15:01.087505 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:01.087471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn" event={"ID":"d28f1e2c-d805-440d-a951-2adef56f15af","Type":"ContainerStarted","Data":"3e09b05679d083f9d3e5a670ad17413ff9e08f6e86aeba7589774c9fac87dfc9"}
Jul 07 16:15:01.088570 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:01.088543    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk" event={"ID":"e7804dd5-73e8-4e15-ba85-2d0d8784a93e","Type":"ContainerStarted","Data":"f12d14f78176345d2a3a9ec0eec18c662d207d1dc58b5a285ac4a1125851b974"}
Jul 07 16:15:04.110488 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:04.110453    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj" event={"ID":"f4b8beca-2450-48e4-9396-1174928d257d","Type":"ContainerStarted","Data":"7e736d580c512591980ae6cdffea6d5b8dcc3c8d8a789e311fe849f6bf67f3c0"}
Jul 07 16:15:04.112110 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:04.112071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn" event={"ID":"d28f1e2c-d805-440d-a951-2adef56f15af","Type":"ContainerStarted","Data":"3d3669b2bda45c290ccb0c3bc4f5a37b07c6da7a4ed76824a91bb2ed2cdad34b"}
Jul 07 16:15:04.113504 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:04.113480    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk" event={"ID":"e7804dd5-73e8-4e15-ba85-2d0d8784a93e","Type":"ContainerStarted","Data":"99bac21cca884aa101399798e34993ed4145428882033d552ff8152639724293"}
Jul 07 16:15:04.141728 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:04.141676    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj" podStartSLOduration=1.692700544 podStartE2EDuration="4.141658043s" totalImagesPullingTime="2.448957499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:04.140973719 +0000 UTC m=+2044.276399582" watchObservedRunningTime="2026-07-07 16:15:04.141658043 +0000 UTC m=+2044.277083906"
Jul 07 16:15:04.173512 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:04.173455    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk" podStartSLOduration=1.546282885 podStartE2EDuration="4.173439312s" totalImagesPullingTime="2.627156427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:04.171849012 +0000 UTC m=+2044.307274874" watchObservedRunningTime="2026-07-07 16:15:04.173439312 +0000 UTC m=+2044.308865152"
Jul 07 16:15:04.204037 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:04.203971    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn" podStartSLOduration=1.751807568 podStartE2EDuration="4.20395653s" totalImagesPullingTime="2.452148962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:04.202814234 +0000 UTC m=+2044.338240098" watchObservedRunningTime="2026-07-07 16:15:04.20395653 +0000 UTC m=+2044.339382393"
Jul 07 16:15:05.120061 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:05.120025    2570 generic.go:356] "Generic (PLEG): container finished" podID="f4b8beca-2450-48e4-9396-1174928d257d" containerID="7e736d580c512591980ae6cdffea6d5b8dcc3c8d8a789e311fe849f6bf67f3c0" exitCode=0
Jul 07 16:15:05.120495 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:05.120099    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj" event={"ID":"f4b8beca-2450-48e4-9396-1174928d257d","Type":"ContainerDied","Data":"7e736d580c512591980ae6cdffea6d5b8dcc3c8d8a789e311fe849f6bf67f3c0"}
Jul 07 16:15:05.121603 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:05.121584    2570 generic.go:356] "Generic (PLEG): container finished" podID="d28f1e2c-d805-440d-a951-2adef56f15af" containerID="3d3669b2bda45c290ccb0c3bc4f5a37b07c6da7a4ed76824a91bb2ed2cdad34b" exitCode=0
Jul 07 16:15:05.121684 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:05.121666    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn" event={"ID":"d28f1e2c-d805-440d-a951-2adef56f15af","Type":"ContainerDied","Data":"3d3669b2bda45c290ccb0c3bc4f5a37b07c6da7a4ed76824a91bb2ed2cdad34b"}
Jul 07 16:15:05.123009 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:05.122988    2570 generic.go:356] "Generic (PLEG): container finished" podID="e7804dd5-73e8-4e15-ba85-2d0d8784a93e" containerID="99bac21cca884aa101399798e34993ed4145428882033d552ff8152639724293" exitCode=0
Jul 07 16:15:05.123132 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:05.123069    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk" event={"ID":"e7804dd5-73e8-4e15-ba85-2d0d8784a93e","Type":"ContainerDied","Data":"99bac21cca884aa101399798e34993ed4145428882033d552ff8152639724293"}
Jul 07 16:15:06.279136 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.279108    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:06.310493 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.310465    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:06.313789 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.313763    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:06.376794 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.376758    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl55b\" (UniqueName: \"kubernetes.io/projected/f4b8beca-2450-48e4-9396-1174928d257d-kube-api-access-hl55b\") pod \"f4b8beca-2450-48e4-9396-1174928d257d\" (UID: \"f4b8beca-2450-48e4-9396-1174928d257d\") "
Jul 07 16:15:06.376937 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.376809    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxd9s\" (UniqueName: \"kubernetes.io/projected/d28f1e2c-d805-440d-a951-2adef56f15af-kube-api-access-dxd9s\") pod \"d28f1e2c-d805-440d-a951-2adef56f15af\" (UID: \"d28f1e2c-d805-440d-a951-2adef56f15af\") "
Jul 07 16:15:06.376937 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.376842    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prkfx\" (UniqueName: \"kubernetes.io/projected/e7804dd5-73e8-4e15-ba85-2d0d8784a93e-kube-api-access-prkfx\") pod \"e7804dd5-73e8-4e15-ba85-2d0d8784a93e\" (UID: \"e7804dd5-73e8-4e15-ba85-2d0d8784a93e\") "
Jul 07 16:15:06.379162 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.379095    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4b8beca-2450-48e4-9396-1174928d257d-kube-api-access-hl55b" (OuterVolumeSpecName: "kube-api-access-hl55b") pod "f4b8beca-2450-48e4-9396-1174928d257d" (UID: "f4b8beca-2450-48e4-9396-1174928d257d"). InnerVolumeSpecName "kube-api-access-hl55b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:15:06.379162 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.379130    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28f1e2c-d805-440d-a951-2adef56f15af-kube-api-access-dxd9s" (OuterVolumeSpecName: "kube-api-access-dxd9s") pod "d28f1e2c-d805-440d-a951-2adef56f15af" (UID: "d28f1e2c-d805-440d-a951-2adef56f15af"). InnerVolumeSpecName "kube-api-access-dxd9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:15:06.379374 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.379160    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7804dd5-73e8-4e15-ba85-2d0d8784a93e-kube-api-access-prkfx" (OuterVolumeSpecName: "kube-api-access-prkfx") pod "e7804dd5-73e8-4e15-ba85-2d0d8784a93e" (UID: "e7804dd5-73e8-4e15-ba85-2d0d8784a93e"). InnerVolumeSpecName "kube-api-access-prkfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:15:06.477806 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.477775    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl55b\" (UniqueName: \"kubernetes.io/projected/f4b8beca-2450-48e4-9396-1174928d257d-kube-api-access-hl55b\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:06.477806 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.477805    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxd9s\" (UniqueName: \"kubernetes.io/projected/d28f1e2c-d805-440d-a951-2adef56f15af-kube-api-access-dxd9s\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:06.477964 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:06.477814    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prkfx\" (UniqueName: \"kubernetes.io/projected/e7804dd5-73e8-4e15-ba85-2d0d8784a93e-kube-api-access-prkfx\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:07.135493 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.135467    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"
Jul 07 16:15:07.135493 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.135471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj" event={"ID":"f4b8beca-2450-48e4-9396-1174928d257d","Type":"ContainerDied","Data":"b5c5ce7e31499e35e8e488459bccf938b2101853a47f79340b4d4030a4f899ae"}
Jul 07 16:15:07.135723 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.135518    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5c5ce7e31499e35e8e488459bccf938b2101853a47f79340b4d4030a4f899ae"
Jul 07 16:15:07.137003 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.136971    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"
Jul 07 16:15:07.137160 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.136997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn" event={"ID":"d28f1e2c-d805-440d-a951-2adef56f15af","Type":"ContainerDied","Data":"3e09b05679d083f9d3e5a670ad17413ff9e08f6e86aeba7589774c9fac87dfc9"}
Jul 07 16:15:07.137160 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.137046    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e09b05679d083f9d3e5a670ad17413ff9e08f6e86aeba7589774c9fac87dfc9"
Jul 07 16:15:07.138529 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.138511    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk"
Jul 07 16:15:07.138650 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.138555    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724015-p6wvk" event={"ID":"e7804dd5-73e8-4e15-ba85-2d0d8784a93e","Type":"ContainerDied","Data":"f12d14f78176345d2a3a9ec0eec18c662d207d1dc58b5a285ac4a1125851b974"}
Jul 07 16:15:07.138650 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:07.138594    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f12d14f78176345d2a3a9ec0eec18c662d207d1dc58b5a285ac4a1125851b974"
Jul 07 16:15:11.311252 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311209    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"]
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311542    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7804dd5-73e8-4e15-ba85-2d0d8784a93e" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311554    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7804dd5-73e8-4e15-ba85-2d0d8784a93e" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311564    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28f1e2c-d805-440d-a951-2adef56f15af" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311570    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28f1e2c-d805-440d-a951-2adef56f15af" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311582    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4b8beca-2450-48e4-9396-1174928d257d" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311588    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4b8beca-2450-48e4-9396-1174928d257d" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311636    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28f1e2c-d805-440d-a951-2adef56f15af" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311645    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7804dd5-73e8-4e15-ba85-2d0d8784a93e" containerName="cleanup"
Jul 07 16:15:11.311653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.311652    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4b8beca-2450-48e4-9396-1174928d257d" containerName="cleanup"
Jul 07 16:15:11.314730 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.314713    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.317171 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.317146    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bda481\"/\"kube-root-ca.crt\""
Jul 07 16:15:11.318075 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.318046    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bda481\"/\"default-dockercfg-lnrqn\""
Jul 07 16:15:11.318075 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.318047    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bda481\"/\"test-model-bda481-kserve-self-signed-certs\""
Jul 07 16:15:11.318198 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.318107    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bda481\"/\"openshift-service-ca.crt\""
Jul 07 16:15:11.327272 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.327228    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"]
Jul 07 16:15:11.416493 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.416452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-tmp-dir\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.416740 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.416510    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36996630-912c-491e-9614-7e0c83651405-tls-certs\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.416740 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.416587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbq8n\" (UniqueName: \"kubernetes.io/projected/36996630-912c-491e-9614-7e0c83651405-kube-api-access-rbq8n\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.416740 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.416615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-dshm\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.416740 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.416640    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-model-cache\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.416740 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.416737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-home\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.517878 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.517833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbq8n\" (UniqueName: \"kubernetes.io/projected/36996630-912c-491e-9614-7e0c83651405-kube-api-access-rbq8n\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.517878 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.517877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-dshm\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518127 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.517898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-model-cache\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518127 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.517934    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-home\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518127 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.517976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-tmp-dir\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518127 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.518037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36996630-912c-491e-9614-7e0c83651405-tls-certs\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518440 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.518413    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-home\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518520 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.518508    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-model-cache\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.518577 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.518556    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-tmp-dir\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.520229 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.520206    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-dshm\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.520485 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.520469    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36996630-912c-491e-9614-7e0c83651405-tls-certs\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.529292 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.529248    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbq8n\" (UniqueName: \"kubernetes.io/projected/36996630-912c-491e-9614-7e0c83651405-kube-api-access-rbq8n\") pod \"test-model-bda481-kserve-587fd9597-b69sc\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") " pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.624153 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.624113    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:11.775072 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:11.775034    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"]
Jul 07 16:15:11.778520 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:15:11.778486    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36996630_912c_491e_9614_7e0c83651405.slice/crio-b3d049dd5bc7dc9f05b6e702dbd4abcd72bae1fe68338698141dc59e69c1d6e6 WatchSource:0}: Error finding container b3d049dd5bc7dc9f05b6e702dbd4abcd72bae1fe68338698141dc59e69c1d6e6: Status 404 returned error can't find the container with id b3d049dd5bc7dc9f05b6e702dbd4abcd72bae1fe68338698141dc59e69c1d6e6
Jul 07 16:15:12.166343 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:12.166300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc" event={"ID":"36996630-912c-491e-9614-7e0c83651405","Type":"ContainerStarted","Data":"2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923"}
Jul 07 16:15:12.166343 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:12.166343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc" event={"ID":"36996630-912c-491e-9614-7e0c83651405","Type":"ContainerStarted","Data":"b3d049dd5bc7dc9f05b6e702dbd4abcd72bae1fe68338698141dc59e69c1d6e6"}
Jul 07 16:15:14.971552 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:14.971487    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc" podStartSLOduration=3.9714605069999998 podStartE2EDuration="3.971460507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:12.202286335 +0000 UTC m=+2052.337712198" watchObservedRunningTime="2026-07-07 16:15:14.971460507 +0000 UTC m=+2055.106886372"
Jul 07 16:15:14.973925 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:14.973899    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:15:21.624753 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:21.624697    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:21.624753 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:21.624760    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:21.637519 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:21.637495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:22.227896 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:22.227859    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:27.783684 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:27.783640    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:15:39.005155 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:39.005116    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"]
Jul 07 16:15:40.206003 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:40.205969    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"]
Jul 07 16:15:40.209599 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:40.209571    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-10313d-29724015-wj9wj"]
Jul 07 16:15:40.456778 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:40.456695    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4b8beca-2450-48e4-9396-1174928d257d" path="/var/lib/kubelet/pods/f4b8beca-2450-48e4-9396-1174928d257d/volumes"
Jul 07 16:15:44.176157 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:44.176119    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:15:54.025052 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.025003    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc" podUID="36996630-912c-491e-9614-7e0c83651405" containerName="main" containerID="cri-o://2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923" gracePeriod=45
Jul 07 16:15:54.267804 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.267775    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:54.379141 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.379096    2570 generic.go:356] "Generic (PLEG): container finished" podID="36996630-912c-491e-9614-7e0c83651405" containerID="2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923" exitCode=0
Jul 07 16:15:54.379348 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.379156    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"
Jul 07 16:15:54.379348 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.379181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc" event={"ID":"36996630-912c-491e-9614-7e0c83651405","Type":"ContainerDied","Data":"2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923"}
Jul 07 16:15:54.379348 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.379252    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc" event={"ID":"36996630-912c-491e-9614-7e0c83651405","Type":"ContainerDied","Data":"b3d049dd5bc7dc9f05b6e702dbd4abcd72bae1fe68338698141dc59e69c1d6e6"}
Jul 07 16:15:54.379348 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.379270    2570 scope.go:117] "RemoveContainer" containerID="2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923"
Jul 07 16:15:54.385565 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385482    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-home\") pod \"36996630-912c-491e-9614-7e0c83651405\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") "
Jul 07 16:15:54.385565 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbq8n\" (UniqueName: \"kubernetes.io/projected/36996630-912c-491e-9614-7e0c83651405-kube-api-access-rbq8n\") pod \"36996630-912c-491e-9614-7e0c83651405\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") "
Jul 07 16:15:54.385565 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385545    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-dshm\") pod \"36996630-912c-491e-9614-7e0c83651405\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") "
Jul 07 16:15:54.385845 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385589    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-tmp-dir\") pod \"36996630-912c-491e-9614-7e0c83651405\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") "
Jul 07 16:15:54.385845 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385639    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36996630-912c-491e-9614-7e0c83651405-tls-certs\") pod \"36996630-912c-491e-9614-7e0c83651405\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") "
Jul 07 16:15:54.385845 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385737    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-model-cache\") pod \"36996630-912c-491e-9614-7e0c83651405\" (UID: \"36996630-912c-491e-9614-7e0c83651405\") "
Jul 07 16:15:54.385845 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385780    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-home" (OuterVolumeSpecName: "home") pod "36996630-912c-491e-9614-7e0c83651405" (UID: "36996630-912c-491e-9614-7e0c83651405"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:15:54.386057 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.385871    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36996630-912c-491e-9614-7e0c83651405" (UID: "36996630-912c-491e-9614-7e0c83651405"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:15:54.386057 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.386039    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-home\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:54.386175 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.386060    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-tmp-dir\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:54.386175 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.386102    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-model-cache" (OuterVolumeSpecName: "model-cache") pod "36996630-912c-491e-9614-7e0c83651405" (UID: "36996630-912c-491e-9614-7e0c83651405"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:15:54.387834 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.387807    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36996630-912c-491e-9614-7e0c83651405-kube-api-access-rbq8n" (OuterVolumeSpecName: "kube-api-access-rbq8n") pod "36996630-912c-491e-9614-7e0c83651405" (UID: "36996630-912c-491e-9614-7e0c83651405"). InnerVolumeSpecName "kube-api-access-rbq8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:15:54.387927 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.387834    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36996630-912c-491e-9614-7e0c83651405-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36996630-912c-491e-9614-7e0c83651405" (UID: "36996630-912c-491e-9614-7e0c83651405"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:15:54.387981 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.387964    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-dshm" (OuterVolumeSpecName: "dshm") pod "36996630-912c-491e-9614-7e0c83651405" (UID: "36996630-912c-491e-9614-7e0c83651405"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:15:54.388606 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.388588    2570 scope.go:117] "RemoveContainer" containerID="2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923"
Jul 07 16:15:54.388919 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:15:54.388892    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923\": container with ID starting with 2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923 not found: ID does not exist" containerID="2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923"
Jul 07 16:15:54.388985 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.388922    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923"} err="failed to get container status \"2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923\": rpc error: code = NotFound desc = could not find container \"2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923\": container with ID starting with 2c058ae31be6d84259d306df67a4482cccdb7779d46a2c03178baaf3708f3923 not found: ID does not exist"
Jul 07 16:15:54.487307 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.487273    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-model-cache\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:54.487307 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.487303    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbq8n\" (UniqueName: \"kubernetes.io/projected/36996630-912c-491e-9614-7e0c83651405-kube-api-access-rbq8n\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:54.487463 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.487313    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36996630-912c-491e-9614-7e0c83651405-dshm\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:54.487463 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.487322    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36996630-912c-491e-9614-7e0c83651405-tls-certs\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:15:54.697716 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.697638    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"]
Jul 07 16:15:54.701894 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:54.701869    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-bda481/test-model-bda481-kserve-587fd9597-b69sc"]
Jul 07 16:15:56.455372 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:15:56.455333    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36996630-912c-491e-9614-7e0c83651405" path="/var/lib/kubelet/pods/36996630-912c-491e-9614-7e0c83651405/volumes"
Jul 07 16:16:24.815452 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:24.815417    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"]
Jul 07 16:16:24.815893 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:24.815645    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" podUID="efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" containerName="maas-api" containerID="cri-o://4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68" gracePeriod=30
Jul 07 16:16:24.868587 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:24.868543    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"]
Jul 07 16:16:24.871301 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:24.871276    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-bda481-29724015-kmtcn"]
Jul 07 16:16:25.061672 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.061647    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:16:25.145548 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.145513    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkvjb\" (UniqueName: \"kubernetes.io/projected/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-kube-api-access-fkvjb\") pod \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") "
Jul 07 16:16:25.145748 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.145622    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-openshift-service-ca\") pod \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") "
Jul 07 16:16:25.145748 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.145667    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls\") pod \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\" (UID: \"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc\") "
Jul 07 16:16:25.146030 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.146003    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" (UID: "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:16:25.147681 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.147655    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" (UID: "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:16:25.147824 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.147800    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-kube-api-access-fkvjb" (OuterVolumeSpecName: "kube-api-access-fkvjb") pod "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" (UID: "efa20cd1-4b6b-4130-8aad-1f51d1d30fcc"). InnerVolumeSpecName "kube-api-access-fkvjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:16:25.246737 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.246697    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-maas-api-tls\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:16:25.246737 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.246731    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkvjb\" (UniqueName: \"kubernetes.io/projected/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-kube-api-access-fkvjb\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:16:25.246942 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.246752    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc-openshift-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:16:25.534549 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.534460    2570 generic.go:356] "Generic (PLEG): container finished" podID="efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" containerID="4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68" exitCode=0
Jul 07 16:16:25.534549 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.534508    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"
Jul 07 16:16:25.534549 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.534532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" event={"ID":"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc","Type":"ContainerDied","Data":"4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68"}
Jul 07 16:16:25.534773 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.534582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5" event={"ID":"efa20cd1-4b6b-4130-8aad-1f51d1d30fcc","Type":"ContainerDied","Data":"50f10687fbbb149192edc6792650440560ccb2f92424111cf5fc1ec6acc5c727"}
Jul 07 16:16:25.534773 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.534612    2570 scope.go:117] "RemoveContainer" containerID="4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68"
Jul 07 16:16:25.546290 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.546259    2570 scope.go:117] "RemoveContainer" containerID="4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68"
Jul 07 16:16:25.546677 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:16:25.546656    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68\": container with ID starting with 4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68 not found: ID does not exist" containerID="4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68"
Jul 07 16:16:25.546737 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.546687    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68"} err="failed to get container status \"4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68\": rpc error: code = NotFound desc = could not find container \"4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68\": container with ID starting with 4495ff8550b9d788aa45e58743befdbb9b6db060593ab48f33a55d676def6f68 not found: ID does not exist"
Jul 07 16:16:25.558341 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.558317    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"]
Jul 07 16:16:25.570099 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:25.570077    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-bda481-7679775f6b-9gmk5"]
Jul 07 16:16:26.455892 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:26.455859    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28f1e2c-d805-440d-a951-2adef56f15af" path="/var/lib/kubelet/pods/d28f1e2c-d805-440d-a951-2adef56f15af/volumes"
Jul 07 16:16:26.456287 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:26.456228    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" path="/var/lib/kubelet/pods/efa20cd1-4b6b-4130-8aad-1f51d1d30fcc/volumes"
Jul 07 16:16:27.600300 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:27.600258    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:16:36.049459 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.049426    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"]
Jul 07 16:16:36.049899 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.049884    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36996630-912c-491e-9614-7e0c83651405" containerName="main"
Jul 07 16:16:36.049941 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.049902    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="36996630-912c-491e-9614-7e0c83651405" containerName="main"
Jul 07 16:16:36.049941 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.049918    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" containerName="maas-api"
Jul 07 16:16:36.049941 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.049926    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" containerName="maas-api"
Jul 07 16:16:36.050030 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.049997    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="36996630-912c-491e-9614-7e0c83651405" containerName="main"
Jul 07 16:16:36.050030 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.050014    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa20cd1-4b6b-4130-8aad-1f51d1d30fcc" containerName="maas-api"
Jul 07 16:16:36.053059 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.053039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.056149 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.056125    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-78b5af-serving-cert\""
Jul 07 16:16:36.056291 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.056168    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bqq6\""
Jul 07 16:16:36.066686 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.066654    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"]
Jul 07 16:16:36.145610 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.145578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093c52b3-4878-49e1-8e02-f3c4021e9789-maas-api-tls\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.145768 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.145657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7xl\" (UniqueName: \"kubernetes.io/projected/093c52b3-4878-49e1-8e02-f3c4021e9789-kube-api-access-5m7xl\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.145768 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.145680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093c52b3-4878-49e1-8e02-f3c4021e9789-openshift-service-ca\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.247120 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.246716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093c52b3-4878-49e1-8e02-f3c4021e9789-maas-api-tls\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.247514 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.247488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7xl\" (UniqueName: \"kubernetes.io/projected/093c52b3-4878-49e1-8e02-f3c4021e9789-kube-api-access-5m7xl\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.247658 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.247643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093c52b3-4878-49e1-8e02-f3c4021e9789-openshift-service-ca\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.253018 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.248693    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093c52b3-4878-49e1-8e02-f3c4021e9789-openshift-service-ca\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.253018 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.250103    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093c52b3-4878-49e1-8e02-f3c4021e9789-maas-api-tls\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.263461 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.263437    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7xl\" (UniqueName: \"kubernetes.io/projected/093c52b3-4878-49e1-8e02-f3c4021e9789-kube-api-access-5m7xl\") pod \"maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") " pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.363712 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.363672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:36.521698 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.521671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"]
Jul 07 16:16:36.523774 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:16:36.523745    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093c52b3_4878_49e1_8e02_f3c4021e9789.slice/crio-74ca614c7c4112009b709c1bc5a9e61ad0f2f2bc3445a35b80decfde024a893e WatchSource:0}: Error finding container 74ca614c7c4112009b709c1bc5a9e61ad0f2f2bc3445a35b80decfde024a893e: Status 404 returned error can't find the container with id 74ca614c7c4112009b709c1bc5a9e61ad0f2f2bc3445a35b80decfde024a893e
Jul 07 16:16:36.590607 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:36.590572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5" event={"ID":"093c52b3-4878-49e1-8e02-f3c4021e9789","Type":"ContainerStarted","Data":"74ca614c7c4112009b709c1bc5a9e61ad0f2f2bc3445a35b80decfde024a893e"}
Jul 07 16:16:37.597253 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:37.597200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5" event={"ID":"093c52b3-4878-49e1-8e02-f3c4021e9789","Type":"ContainerStarted","Data":"45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580"}
Jul 07 16:16:37.597631 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:37.597298    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:37.624653 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:37.624596    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5" podStartSLOduration=1.19985068 podStartE2EDuration="1.624580381s" totalImagesPullingTime="424.729701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:16:37.624220663 +0000 UTC m=+2137.759646524" watchObservedRunningTime="2026-07-07 16:16:37.624580381 +0000 UTC m=+2137.760006240"
Jul 07 16:16:40.770116 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:40.770078    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:16:43.607939 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:43.607907    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:44.000023 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:43.999934    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"]
Jul 07 16:16:44.004099 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.004074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.007631 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.007605    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-b728d9-serving-cert\""
Jul 07 16:16:44.019535 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.019500    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"]
Jul 07 16:16:44.118825 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.118785    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xz57\" (UniqueName: \"kubernetes.io/projected/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-kube-api-access-7xz57\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.118999 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.118840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-maas-api-tls\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.118999 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.118968    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-openshift-service-ca\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.220141 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.220104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xz57\" (UniqueName: \"kubernetes.io/projected/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-kube-api-access-7xz57\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.220356 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.220146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-maas-api-tls\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.220356 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.220207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-openshift-service-ca\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.221057 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.221029    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-openshift-service-ca\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.222854 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.222832    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-maas-api-tls\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.230002 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.229973    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xz57\" (UniqueName: \"kubernetes.io/projected/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-kube-api-access-7xz57\") pod \"maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") " pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.314968 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.314881    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:44.455917 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:16:44.455887    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5020e7_ba1a_4525_a3e2_3cb4538fa3e2.slice/crio-ea291e196eab25f40b45841c78ccc80efa2913cf2f0d6bafe6fbd038655495f1 WatchSource:0}: Error finding container ea291e196eab25f40b45841c78ccc80efa2913cf2f0d6bafe6fbd038655495f1: Status 404 returned error can't find the container with id ea291e196eab25f40b45841c78ccc80efa2913cf2f0d6bafe6fbd038655495f1
Jul 07 16:16:44.456510 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.456491    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"]
Jul 07 16:16:44.633055 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:44.633022    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" event={"ID":"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2","Type":"ContainerStarted","Data":"ea291e196eab25f40b45841c78ccc80efa2913cf2f0d6bafe6fbd038655495f1"}
Jul 07 16:16:45.639768 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:45.639728    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" event={"ID":"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2","Type":"ContainerStarted","Data":"0da4a9a7e20a974a3f9f5f62e8be550772435a7d419ff4ee5372cb4de2b2ac8b"}
Jul 07 16:16:45.640155 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:45.639809    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:45.661030 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:45.660980    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" podStartSLOduration=2.279979494 podStartE2EDuration="2.660966878s" totalImagesPullingTime="380.987384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:16:45.659189558 +0000 UTC m=+2145.794615448" watchObservedRunningTime="2026-07-07 16:16:45.660966878 +0000 UTC m=+2145.796392740"
Jul 07 16:16:51.651820 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:51.651789    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:16:51.654990 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:51.654962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:16:57.929259 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:57.929210    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"]
Jul 07 16:16:57.929748 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:57.929414    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5" podUID="093c52b3-4878-49e1-8e02-f3c4021e9789" containerName="maas-api" containerID="cri-o://45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580" gracePeriod=30
Jul 07 16:16:58.176626 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.176592    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:58.239330 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.239257    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093c52b3-4878-49e1-8e02-f3c4021e9789-openshift-service-ca\") pod \"093c52b3-4878-49e1-8e02-f3c4021e9789\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") "
Jul 07 16:16:58.239464 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.239349    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093c52b3-4878-49e1-8e02-f3c4021e9789-maas-api-tls\") pod \"093c52b3-4878-49e1-8e02-f3c4021e9789\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") "
Jul 07 16:16:58.239464 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.239368    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m7xl\" (UniqueName: \"kubernetes.io/projected/093c52b3-4878-49e1-8e02-f3c4021e9789-kube-api-access-5m7xl\") pod \"093c52b3-4878-49e1-8e02-f3c4021e9789\" (UID: \"093c52b3-4878-49e1-8e02-f3c4021e9789\") "
Jul 07 16:16:58.239661 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.239636    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093c52b3-4878-49e1-8e02-f3c4021e9789-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "093c52b3-4878-49e1-8e02-f3c4021e9789" (UID: "093c52b3-4878-49e1-8e02-f3c4021e9789"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:16:58.241426 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.241399    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093c52b3-4878-49e1-8e02-f3c4021e9789-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "093c52b3-4878-49e1-8e02-f3c4021e9789" (UID: "093c52b3-4878-49e1-8e02-f3c4021e9789"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:16:58.241573 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.241551    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093c52b3-4878-49e1-8e02-f3c4021e9789-kube-api-access-5m7xl" (OuterVolumeSpecName: "kube-api-access-5m7xl") pod "093c52b3-4878-49e1-8e02-f3c4021e9789" (UID: "093c52b3-4878-49e1-8e02-f3c4021e9789"). InnerVolumeSpecName "kube-api-access-5m7xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:16:58.339921 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.339872    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093c52b3-4878-49e1-8e02-f3c4021e9789-maas-api-tls\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:16:58.339921 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.339916    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m7xl\" (UniqueName: \"kubernetes.io/projected/093c52b3-4878-49e1-8e02-f3c4021e9789-kube-api-access-5m7xl\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:16:58.339921 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.339926    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093c52b3-4878-49e1-8e02-f3c4021e9789-openshift-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:16:58.708926 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.708884    2570 generic.go:356] "Generic (PLEG): container finished" podID="093c52b3-4878-49e1-8e02-f3c4021e9789" containerID="45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580" exitCode=0
Jul 07 16:16:58.708926 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.708918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5" event={"ID":"093c52b3-4878-49e1-8e02-f3c4021e9789","Type":"ContainerDied","Data":"45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580"}
Jul 07 16:16:58.709193 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.708984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5" event={"ID":"093c52b3-4878-49e1-8e02-f3c4021e9789","Type":"ContainerDied","Data":"74ca614c7c4112009b709c1bc5a9e61ad0f2f2bc3445a35b80decfde024a893e"}
Jul 07 16:16:58.709193 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.708932    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"
Jul 07 16:16:58.709193 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.709015    2570 scope.go:117] "RemoveContainer" containerID="45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580"
Jul 07 16:16:58.717689 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.717674    2570 scope.go:117] "RemoveContainer" containerID="45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580"
Jul 07 16:16:58.717928 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:16:58.717910    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580\": container with ID starting with 45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580 not found: ID does not exist" containerID="45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580"
Jul 07 16:16:58.717974 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.717953    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580"} err="failed to get container status \"45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580\": rpc error: code = NotFound desc = could not find container \"45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580\": container with ID starting with 45c8f847b2c032816114fe3f2cdb08d4a34492a7f253f8f0f7dbdccfeeda8580 not found: ID does not exist"
Jul 07 16:16:58.736335 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.736308    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"]
Jul 07 16:16:58.749885 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:16:58.749851    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-78b5af-6947f95c87-wkrg5"]
Jul 07 16:17:00.456137 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:00.456101    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093c52b3-4878-49e1-8e02-f3c4021e9789" path="/var/lib/kubelet/pods/093c52b3-4878-49e1-8e02-f3c4021e9789/volumes"
Jul 07 16:17:02.610258 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:02.610202    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:17:06.541919 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.541881    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"]
Jul 07 16:17:06.542376 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.542127    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" podUID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" containerName="maas-api" containerID="cri-o://0da4a9a7e20a974a3f9f5f62e8be550772435a7d419ff4ee5372cb4de2b2ac8b" gracePeriod=30
Jul 07 16:17:06.645913 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.645851    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" podUID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.45:8443/health\": dial tcp 10.132.0.45:8443: connect: connection refused"
Jul 07 16:17:06.758717 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.758683    2570 generic.go:356] "Generic (PLEG): container finished" podID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" containerID="0da4a9a7e20a974a3f9f5f62e8be550772435a7d419ff4ee5372cb4de2b2ac8b" exitCode=0
Jul 07 16:17:06.758908 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.758766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" event={"ID":"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2","Type":"ContainerDied","Data":"0da4a9a7e20a974a3f9f5f62e8be550772435a7d419ff4ee5372cb4de2b2ac8b"}
Jul 07 16:17:06.794014 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.793947    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:17:06.912963 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.912924    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-maas-api-tls\") pod \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") "
Jul 07 16:17:06.913182 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.912995    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xz57\" (UniqueName: \"kubernetes.io/projected/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-kube-api-access-7xz57\") pod \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") "
Jul 07 16:17:06.913182 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.913017    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-openshift-service-ca\") pod \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\" (UID: \"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2\") "
Jul 07 16:17:06.913457 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.913428    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" (UID: "fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:17:06.915226 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.915189    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-kube-api-access-7xz57" (OuterVolumeSpecName: "kube-api-access-7xz57") pod "fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" (UID: "fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2"). InnerVolumeSpecName "kube-api-access-7xz57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:17:06.915226 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:06.915198    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" (UID: "fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:17:07.014401 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.014366    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-maas-api-tls\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:17:07.014401 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.014396    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xz57\" (UniqueName: \"kubernetes.io/projected/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-kube-api-access-7xz57\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:17:07.014401 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.014406    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2-openshift-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:17:07.765569 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.765536    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"
Jul 07 16:17:07.766011 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.765567    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn" event={"ID":"fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2","Type":"ContainerDied","Data":"ea291e196eab25f40b45841c78ccc80efa2913cf2f0d6bafe6fbd038655495f1"}
Jul 07 16:17:07.766011 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.765629    2570 scope.go:117] "RemoveContainer" containerID="0da4a9a7e20a974a3f9f5f62e8be550772435a7d419ff4ee5372cb4de2b2ac8b"
Jul 07 16:17:07.797666 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.797633    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"]
Jul 07 16:17:07.805882 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:07.805852    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-b728d9-95cd74ccf-xrlhn"]
Jul 07 16:17:08.455840 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:08.455805    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" path="/var/lib/kubelet/pods/fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2/volumes"
Jul 07 16:17:14.462958 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:14.462921    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:17:17.384881 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.384845    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"]
Jul 07 16:17:17.385361 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.385341    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" containerName="maas-api"
Jul 07 16:17:17.385361 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.385362    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" containerName="maas-api"
Jul 07 16:17:17.385488 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.385388    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093c52b3-4878-49e1-8e02-f3c4021e9789" containerName="maas-api"
Jul 07 16:17:17.385488 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.385399    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="093c52b3-4878-49e1-8e02-f3c4021e9789" containerName="maas-api"
Jul 07 16:17:17.385592 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.385505    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="093c52b3-4878-49e1-8e02-f3c4021e9789" containerName="maas-api"
Jul 07 16:17:17.385592 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.385518    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5020e7-ba1a-4525-a3e2-3cb4538fa3e2" containerName="maas-api"
Jul 07 16:17:17.389947 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.389924    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.394135 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.394107    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-382396-serving-cert\""
Jul 07 16:17:17.394307 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.394153    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bqq6\""
Jul 07 16:17:17.403795 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.403771    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"]
Jul 07 16:17:17.507424 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.507380    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.507632 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.507487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shw9j\" (UniqueName: \"kubernetes.io/projected/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-kube-api-access-shw9j\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.507632 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.507598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-openshift-service-ca\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.609072 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.609027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.609072 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.609075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shw9j\" (UniqueName: \"kubernetes.io/projected/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-kube-api-access-shw9j\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.609407 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.609114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-openshift-service-ca\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.609407 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:17:17.609196    2570 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-382396-serving-cert: secret "maas-api-e2e-shared-a-382396-serving-cert" not found
Jul 07 16:17:17.609407 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:17:17.609309    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls podName:2e15c0a4-0454-44f3-8f9f-9ad8abe99526 nodeName:}" failed. No retries permitted until 2026-07-07 16:17:18.109286252 +0000 UTC m=+2178.244712106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls") pod "maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" (UID: "2e15c0a4-0454-44f3-8f9f-9ad8abe99526") : secret "maas-api-e2e-shared-a-382396-serving-cert" not found
Jul 07 16:17:17.609842 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.609824    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-openshift-service-ca\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:17.621943 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:17.621910    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shw9j\" (UniqueName: \"kubernetes.io/projected/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-kube-api-access-shw9j\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:18.113256 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:18.113185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:18.115741 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:18.115713    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls\") pod \"maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") " pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:18.300589 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:18.300543    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:18.446929 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:18.446905    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"]
Jul 07 16:17:18.448744 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:17:18.448712    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e15c0a4_0454_44f3_8f9f_9ad8abe99526.slice/crio-92788c7244e9967bd70cb557e463b2ee831bbae45123e16f387ce7282da5298d WatchSource:0}: Error finding container 92788c7244e9967bd70cb557e463b2ee831bbae45123e16f387ce7282da5298d: Status 404 returned error can't find the container with id 92788c7244e9967bd70cb557e463b2ee831bbae45123e16f387ce7282da5298d
Jul 07 16:17:18.822630 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:18.822603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" event={"ID":"2e15c0a4-0454-44f3-8f9f-9ad8abe99526","Type":"ContainerStarted","Data":"92788c7244e9967bd70cb557e463b2ee831bbae45123e16f387ce7282da5298d"}
Jul 07 16:17:19.829672 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:19.829626    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" event={"ID":"2e15c0a4-0454-44f3-8f9f-9ad8abe99526","Type":"ContainerStarted","Data":"96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba"}
Jul 07 16:17:19.830167 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:19.829696    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:19.859372 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:19.859320    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" podStartSLOduration=2.5456827239999997 podStartE2EDuration="2.859303971s" totalImagesPullingTime="313.621247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:17:19.857706945 +0000 UTC m=+2179.993132808" watchObservedRunningTime="2026-07-07 16:17:19.859303971 +0000 UTC m=+2179.994729831"
Jul 07 16:17:21.988477 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:21.988438    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:17:25.341993 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.341958    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"]
Jul 07 16:17:25.345173 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.345150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.348637 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.348608    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-17e556-serving-cert\""
Jul 07 16:17:25.361049 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.361021    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"]
Jul 07 16:17:25.477060 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.477021    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-758jt\" (UniqueName: \"kubernetes.io/projected/d90409b6-af04-4b3b-a56b-8575f9010a0e-kube-api-access-758jt\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.477286 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.477063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.477286 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.477096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90409b6-af04-4b3b-a56b-8575f9010a0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.577732 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.577688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-758jt\" (UniqueName: \"kubernetes.io/projected/d90409b6-af04-4b3b-a56b-8575f9010a0e-kube-api-access-758jt\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.577947 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.577761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.577947 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.577810    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90409b6-af04-4b3b-a56b-8575f9010a0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.578105 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:17:25.577972    2570 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-17e556-serving-cert: secret "maas-api-e2e-shared-b-17e556-serving-cert" not found
Jul 07 16:17:25.578105 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:17:25.578049    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls podName:d90409b6-af04-4b3b-a56b-8575f9010a0e nodeName:}" failed. No retries permitted until 2026-07-07 16:17:26.078029101 +0000 UTC m=+2186.213454947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls") pod "maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" (UID: "d90409b6-af04-4b3b-a56b-8575f9010a0e") : secret "maas-api-e2e-shared-b-17e556-serving-cert" not found
Jul 07 16:17:25.578538 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.578514    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90409b6-af04-4b3b-a56b-8575f9010a0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.589523 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.589494    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-758jt\" (UniqueName: \"kubernetes.io/projected/d90409b6-af04-4b3b-a56b-8575f9010a0e-kube-api-access-758jt\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:25.841881 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:25.841851    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:17:26.082221 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:26.082180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:26.084660 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:26.084628    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") " pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:26.255637 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:26.255538    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:26.409637 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:26.409608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"]
Jul 07 16:17:26.410768 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:17:26.410741    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90409b6_af04_4b3b_a56b_8575f9010a0e.slice/crio-621ad75ec38a562853e901538d0b93293ef035f0f080f308ff3ed5fc6546b03d WatchSource:0}: Error finding container 621ad75ec38a562853e901538d0b93293ef035f0f080f308ff3ed5fc6546b03d: Status 404 returned error can't find the container with id 621ad75ec38a562853e901538d0b93293ef035f0f080f308ff3ed5fc6546b03d
Jul 07 16:17:26.870387 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:26.870361    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" event={"ID":"d90409b6-af04-4b3b-a56b-8575f9010a0e","Type":"ContainerStarted","Data":"621ad75ec38a562853e901538d0b93293ef035f0f080f308ff3ed5fc6546b03d"}
Jul 07 16:17:27.878152 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:27.878115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" event={"ID":"d90409b6-af04-4b3b-a56b-8575f9010a0e","Type":"ContainerStarted","Data":"2d45f793bfe67765536dd25ecac83d07afa28a7d261673afd5434082e730b006"}
Jul 07 16:17:27.878622 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:27.878257    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:27.904138 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:27.904087    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" podStartSLOduration=2.495956207 podStartE2EDuration="2.904069647s" totalImagesPullingTime="408.11344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:17:27.901542217 +0000 UTC m=+2188.036968080" watchObservedRunningTime="2026-07-07 16:17:27.904069647 +0000 UTC m=+2188.039495511"
Jul 07 16:17:32.571752 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:32.571712    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:17:33.889259 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:33.889209    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:17:49.550003 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:17:49.549961    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:18:29.151216 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:18:29.151117    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:18:53.547520 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:18:53.547480    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:19:08.743994 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:19:08.743957    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:19:21.956021 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:19:21.955977    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:19:35.787904 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:19:35.787865    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:19:50.442947 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:19:50.442909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:20:07.353767 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:20:07.353682    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:20:24.648400 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:20:24.648362    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:20:41.450582 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:20:41.450536    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:21:05.361391 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:05.361345    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:21:23.956280 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:23.956163    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:21:42.049445 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:42.049392    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:21:53.735021 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.734970    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"]
Jul 07 16:21:53.738364 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.738348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.741948 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.741918    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-382396\"/\"default-dockercfg-5rwxp\""
Jul 07 16:21:53.742077 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.741948    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-382396\"/\"openshift-service-ca.crt\""
Jul 07 16:21:53.742077 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.742039    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-382396\"/\"rate-test-model-382396-kserve-self-signed-certs\""
Jul 07 16:21:53.742156 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.742145    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-382396\"/\"kube-root-ca.crt\""
Jul 07 16:21:53.745906 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.745881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tls-certs\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.746012 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.745922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-home\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.746012 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.745993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-model-cache\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.746085 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.746037    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47jtl\" (UniqueName: \"kubernetes.io/projected/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-kube-api-access-47jtl\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.746085 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.746057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tmp-dir\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.746085 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.746081    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-dshm\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.749143 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.749120    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"]
Jul 07 16:21:53.846635 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.846599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-home\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.846635 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.846649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-model-cache\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.846871 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.846836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47jtl\" (UniqueName: \"kubernetes.io/projected/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-kube-api-access-47jtl\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.846911 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.846874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tmp-dir\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.846911 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.846900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-dshm\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.846984 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.846968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tls-certs\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.847053 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.847033    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-model-cache\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.847113 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.847065    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-home\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.847297 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.847278    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tmp-dir\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.849228 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.849200    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-dshm\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.849456 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.849440    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tls-certs\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:53.858014 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:53.857988    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47jtl\" (UniqueName: \"kubernetes.io/projected/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-kube-api-access-47jtl\") pod \"rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") " pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:54.048119 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:54.048024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:21:54.191155 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:54.191128    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"]
Jul 07 16:21:54.192446 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:21:54.192419    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd9d3098_7e5a_4f1d_84d2_8cb5b190981e.slice/crio-beea90d3a680742686a26d88e80ab3c96067cb571d18623b17d3fae743263d8b WatchSource:0}: Error finding container beea90d3a680742686a26d88e80ab3c96067cb571d18623b17d3fae743263d8b: Status 404 returned error can't find the container with id beea90d3a680742686a26d88e80ab3c96067cb571d18623b17d3fae743263d8b
Jul 07 16:21:54.238167 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:54.238140    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl" event={"ID":"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e","Type":"ContainerStarted","Data":"beea90d3a680742686a26d88e80ab3c96067cb571d18623b17d3fae743263d8b"}
Jul 07 16:21:55.245702 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:55.245666    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl" event={"ID":"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e","Type":"ContainerStarted","Data":"3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23"}
Jul 07 16:21:55.265590 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:55.265532    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl" podStartSLOduration=2.265511452 podStartE2EDuration="2.265511452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:21:55.264341374 +0000 UTC m=+2455.399767289" watchObservedRunningTime="2026-07-07 16:21:55.265511452 +0000 UTC m=+2455.400937315"
Jul 07 16:21:59.155837 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:21:59.155793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:22:00.612668 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:00.612637    2570 scope.go:117] "RemoveContainer" containerID="3d3669b2bda45c290ccb0c3bc4f5a37b07c6da7a4ed76824a91bb2ed2cdad34b"
Jul 07 16:22:00.621394 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:00.621338    2570 scope.go:117] "RemoveContainer" containerID="7e736d580c512591980ae6cdffea6d5b8dcc3c8d8a789e311fe849f6bf67f3c0"
Jul 07 16:22:04.048759 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:04.048725    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:22:04.051075 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:04.048801    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:22:04.061459 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:04.061439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:22:04.302468 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:04.302389    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:22:20.180071 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:20.180029    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:22:53.443855 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:22:53.443765    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:23:06.055467 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:06.055432    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:23:18.866613 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:18.866571    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:23:22.928965 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:22.928933    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"]
Jul 07 16:23:25.637414 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:25.637377    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"]
Jul 07 16:23:25.637875 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:25.637607    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" podUID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" containerName="maas-api" containerID="cri-o://96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba" gracePeriod=30
Jul 07 16:23:25.884769 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:25.884743    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:23:26.045906 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.045806    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-openshift-service-ca\") pod \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") "
Jul 07 16:23:26.045906 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.045863    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls\") pod \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") "
Jul 07 16:23:26.046158 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.045948    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shw9j\" (UniqueName: \"kubernetes.io/projected/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-kube-api-access-shw9j\") pod \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\" (UID: \"2e15c0a4-0454-44f3-8f9f-9ad8abe99526\") "
Jul 07 16:23:26.046219 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.046197    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e15c0a4-0454-44f3-8f9f-9ad8abe99526" (UID: "2e15c0a4-0454-44f3-8f9f-9ad8abe99526"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:23:26.048226 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.048197    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-kube-api-access-shw9j" (OuterVolumeSpecName: "kube-api-access-shw9j") pod "2e15c0a4-0454-44f3-8f9f-9ad8abe99526" (UID: "2e15c0a4-0454-44f3-8f9f-9ad8abe99526"). InnerVolumeSpecName "kube-api-access-shw9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:23:26.048226 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.048205    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e15c0a4-0454-44f3-8f9f-9ad8abe99526" (UID: "2e15c0a4-0454-44f3-8f9f-9ad8abe99526"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:23:26.147478 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.147435    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-openshift-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:26.147478 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.147469    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-maas-api-tls\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:26.147478 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.147479    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shw9j\" (UniqueName: \"kubernetes.io/projected/2e15c0a4-0454-44f3-8f9f-9ad8abe99526-kube-api-access-shw9j\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:26.708354 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.708322    2570 generic.go:356] "Generic (PLEG): container finished" podID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" containerID="96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba" exitCode=0
Jul 07 16:23:26.708867 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.708380    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"
Jul 07 16:23:26.708867 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.708411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" event={"ID":"2e15c0a4-0454-44f3-8f9f-9ad8abe99526","Type":"ContainerDied","Data":"96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba"}
Jul 07 16:23:26.708867 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.708463    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" event={"ID":"2e15c0a4-0454-44f3-8f9f-9ad8abe99526","Type":"ContainerDied","Data":"92788c7244e9967bd70cb557e463b2ee831bbae45123e16f387ce7282da5298d"}
Jul 07 16:23:26.708867 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.708484    2570 scope.go:117] "RemoveContainer" containerID="96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba"
Jul 07 16:23:26.718550 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.718522    2570 scope.go:117] "RemoveContainer" containerID="96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba"
Jul 07 16:23:26.718794 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:23:26.718776    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba\": container with ID starting with 96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba not found: ID does not exist" containerID="96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba"
Jul 07 16:23:26.718863 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.718801    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba"} err="failed to get container status \"96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba\": rpc error: code = NotFound desc = could not find container \"96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba\": container with ID starting with 96df123e81a9e1556afbe356083e3ffdad1ed4047967290290be193dc242d0ba not found: ID does not exist"
Jul 07 16:23:26.730315 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.730286    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"]
Jul 07 16:23:26.735144 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:26.735120    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz"]
Jul 07 16:23:28.456113 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:28.456073    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" path="/var/lib/kubelet/pods/2e15c0a4-0454-44f3-8f9f-9ad8abe99526/volumes"
Jul 07 16:23:28.836655 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:28.836605    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-a-382396-5dc7c8d4b-j2brz" podUID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.46:8443/health\": context deadline exceeded"
Jul 07 16:23:33.566803 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:33.566754    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:23:37.948991 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:37.948946    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl" podUID="bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" containerName="main" containerID="cri-o://3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23" gracePeriod=45
Jul 07 16:23:38.203915 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.203855    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:23:38.249823 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.249788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47jtl\" (UniqueName: \"kubernetes.io/projected/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-kube-api-access-47jtl\") pod \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") "
Jul 07 16:23:38.249823 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.249823    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tls-certs\") pod \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") "
Jul 07 16:23:38.250064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.249847    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-dshm\") pod \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") "
Jul 07 16:23:38.250064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.249873    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-home\") pod \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") "
Jul 07 16:23:38.250064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.249945    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-model-cache\") pod \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") "
Jul 07 16:23:38.250064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.250012    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tmp-dir\") pod \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\" (UID: \"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e\") "
Jul 07 16:23:38.250302 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.250218    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-home" (OuterVolumeSpecName: "home") pod "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" (UID: "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:23:38.250302 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.250282    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" (UID: "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:23:38.250407 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.250370    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" (UID: "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:23:38.252196 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.252172    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-dshm" (OuterVolumeSpecName: "dshm") pod "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" (UID: "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:23:38.252196 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.252179    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" (UID: "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:23:38.252361 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.252226    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-kube-api-access-47jtl" (OuterVolumeSpecName: "kube-api-access-47jtl") pod "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" (UID: "bd9d3098-7e5a-4f1d-84d2-8cb5b190981e"). InnerVolumeSpecName "kube-api-access-47jtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:23:38.351415 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.351380    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-model-cache\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:38.351415 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.351409    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tmp-dir\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:38.351415 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.351420    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47jtl\" (UniqueName: \"kubernetes.io/projected/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-kube-api-access-47jtl\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:38.351655 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.351428    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-tls-certs\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:38.351655 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.351438    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-dshm\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:38.351655 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.351445    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e-home\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:23:38.769064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.768971    2570 generic.go:356] "Generic (PLEG): container finished" podID="bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" containerID="3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23" exitCode=0
Jul 07 16:23:38.769064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.769034    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"
Jul 07 16:23:38.769064 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.769051    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl" event={"ID":"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e","Type":"ContainerDied","Data":"3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23"}
Jul 07 16:23:38.769379 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.769101    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl" event={"ID":"bd9d3098-7e5a-4f1d-84d2-8cb5b190981e","Type":"ContainerDied","Data":"beea90d3a680742686a26d88e80ab3c96067cb571d18623b17d3fae743263d8b"}
Jul 07 16:23:38.769379 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.769120    2570 scope.go:117] "RemoveContainer" containerID="3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23"
Jul 07 16:23:38.777912 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.777889    2570 scope.go:117] "RemoveContainer" containerID="3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23"
Jul 07 16:23:38.778182 ip-10-0-141-63 kubenswrapper[2570]: E0707 16:23:38.778161    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23\": container with ID starting with 3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23 not found: ID does not exist" containerID="3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23"
Jul 07 16:23:38.778344 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.778193    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23"} err="failed to get container status \"3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23\": rpc error: code = NotFound desc = could not find container \"3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23\": container with ID starting with 3f74adb98f12953645ef8220b06f8dcaab69b95cd71c676bb9007aedf3ce0b23 not found: ID does not exist"
Jul 07 16:23:38.789695 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.789669    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"]
Jul 07 16:23:38.794312 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:38.794289    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-382396/rate-test-model-382396-kserve-5bb5f4d5c5-8vlhl"]
Jul 07 16:23:40.455615 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:23:40.455585    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" path="/var/lib/kubelet/pods/bd9d3098-7e5a-4f1d-84d2-8cb5b190981e/volumes"
Jul 07 16:24:09.727520 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:09.727479    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"]
Jul 07 16:24:09.728038 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:09.727745    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" podUID="d90409b6-af04-4b3b-a56b-8575f9010a0e" containerName="maas-api" containerID="cri-o://2d45f793bfe67765536dd25ecac83d07afa28a7d261673afd5434082e730b006" gracePeriod=30
Jul 07 16:24:09.932599 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:09.932557    2570 generic.go:356] "Generic (PLEG): container finished" podID="d90409b6-af04-4b3b-a56b-8575f9010a0e" containerID="2d45f793bfe67765536dd25ecac83d07afa28a7d261673afd5434082e730b006" exitCode=0
Jul 07 16:24:09.932772 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:09.932626    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" event={"ID":"d90409b6-af04-4b3b-a56b-8575f9010a0e","Type":"ContainerDied","Data":"2d45f793bfe67765536dd25ecac83d07afa28a7d261673afd5434082e730b006"}
Jul 07 16:24:09.977063 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:09.977036    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:24:10.125558 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.125519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-758jt\" (UniqueName: \"kubernetes.io/projected/d90409b6-af04-4b3b-a56b-8575f9010a0e-kube-api-access-758jt\") pod \"d90409b6-af04-4b3b-a56b-8575f9010a0e\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") "
Jul 07 16:24:10.125558 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.125567    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90409b6-af04-4b3b-a56b-8575f9010a0e-openshift-service-ca\") pod \"d90409b6-af04-4b3b-a56b-8575f9010a0e\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") "
Jul 07 16:24:10.125834 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.125626    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls\") pod \"d90409b6-af04-4b3b-a56b-8575f9010a0e\" (UID: \"d90409b6-af04-4b3b-a56b-8575f9010a0e\") "
Jul 07 16:24:10.126008 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.125980    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d90409b6-af04-4b3b-a56b-8575f9010a0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d90409b6-af04-4b3b-a56b-8575f9010a0e" (UID: "d90409b6-af04-4b3b-a56b-8575f9010a0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:24:10.127706 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.127682    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d90409b6-af04-4b3b-a56b-8575f9010a0e" (UID: "d90409b6-af04-4b3b-a56b-8575f9010a0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:24:10.127850 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.127829    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90409b6-af04-4b3b-a56b-8575f9010a0e-kube-api-access-758jt" (OuterVolumeSpecName: "kube-api-access-758jt") pod "d90409b6-af04-4b3b-a56b-8575f9010a0e" (UID: "d90409b6-af04-4b3b-a56b-8575f9010a0e"). InnerVolumeSpecName "kube-api-access-758jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:24:10.226316 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.226272    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-758jt\" (UniqueName: \"kubernetes.io/projected/d90409b6-af04-4b3b-a56b-8575f9010a0e-kube-api-access-758jt\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:24:10.226316 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.226308    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90409b6-af04-4b3b-a56b-8575f9010a0e-openshift-service-ca\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:24:10.226316 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.226322    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90409b6-af04-4b3b-a56b-8575f9010a0e-maas-api-tls\") on node \"ip-10-0-141-63.ec2.internal\" DevicePath \"\""
Jul 07 16:24:10.938313 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.938275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp" event={"ID":"d90409b6-af04-4b3b-a56b-8575f9010a0e","Type":"ContainerDied","Data":"621ad75ec38a562853e901538d0b93293ef035f0f080f308ff3ed5fc6546b03d"}
Jul 07 16:24:10.938761 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.938335    2570 scope.go:117] "RemoveContainer" containerID="2d45f793bfe67765536dd25ecac83d07afa28a7d261673afd5434082e730b006"
Jul 07 16:24:10.938761 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.938289    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"
Jul 07 16:24:10.959399 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.959364    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"]
Jul 07 16:24:10.961317 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:10.961296    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-17e556-d44bcc869-l2vgp"]
Jul 07 16:24:12.447509 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:12.447466    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2hfrk"]
Jul 07 16:24:12.455399 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:12.455366    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90409b6-af04-4b3b-a56b-8575f9010a0e" path="/var/lib/kubelet/pods/d90409b6-af04-4b3b-a56b-8575f9010a0e/volumes"
Jul 07 16:24:22.057448 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:22.057408    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724015-p6wvk_e7804dd5-73e8-4e15-ba85-2d0d8784a93e/cleanup/0.log"
Jul 07 16:24:22.553636 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:22.553557    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-685dff6fcf-cmjjp_827b5763-2dde-46db-baae-4382121b0e2f/copy-manifests/0.log"
Jul 07 16:24:22.562360 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:22.562330    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-685dff6fcf-cmjjp_827b5763-2dde-46db-baae-4382121b0e2f/manager/0.log"
Jul 07 16:24:23.738900 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:23.738866    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l_6bb2d778-9316-4cc7-824a-98d580b26955/util/0.log"
Jul 07 16:24:23.746056 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:23.746034    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l_6bb2d778-9316-4cc7-824a-98d580b26955/pull/0.log"
Jul 07 16:24:23.753767 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:23.753734    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l_6bb2d778-9316-4cc7-824a-98d580b26955/extract/0.log"
Jul 07 16:24:23.871859 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:23.871832    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm_c083d2ed-f96f-459c-b6ed-c847e729eb21/util/0.log"
Jul 07 16:24:23.880562 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:23.880539    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm_c083d2ed-f96f-459c-b6ed-c847e729eb21/pull/0.log"
Jul 07 16:24:23.888747 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:23.888729    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm_c083d2ed-f96f-459c-b6ed-c847e729eb21/extract/0.log"
Jul 07 16:24:24.000208 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:24.000124    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g_ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b/util/0.log"
Jul 07 16:24:24.007958 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:24.007938    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g_ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b/pull/0.log"
Jul 07 16:24:24.016109 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:24.016089    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g_ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b/extract/0.log"
Jul 07 16:24:24.141677 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:24.141645    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz_c69ac680-c66a-440a-a0eb-0be9500df0e7/util/0.log"
Jul 07 16:24:24.149570 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:24.149539    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz_c69ac680-c66a-440a-a0eb-0be9500df0e7/pull/0.log"
Jul 07 16:24:24.156913 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:24.156886    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz_c69ac680-c66a-440a-a0eb-0be9500df0e7/extract/0.log"
Jul 07 16:24:25.017330 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:25.017297    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2hfrk_f0f2bf66-3706-4633-818d-6f07e3757d1f/limitador/0.log"
Jul 07 16:24:25.627942 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:25.627908    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzwjn_18c8cee2-a293-4582-bad1-8cb352594b7f/discovery/0.log"
Jul 07 16:24:26.825047 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:26.825018    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cwrxh_a53c32dc-337d-4b91-bff7-bd22e89d3b43/main/0.log"
Jul 07 16:24:27.179675 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:27.179645    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hc2km_37708914-3521-4e44-9027-a6af73abdedf/main/0.log"
Jul 07 16:24:34.856133 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:34.856103    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-swpt5_0524fef0-1941-4668-a60a-168f43fd6802/global-pull-secret-syncer/0.log"
Jul 07 16:24:34.951799 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:34.951770    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-php6p_c3078b8c-641a-4fe7-a940-22ed21b23009/konnectivity-agent/0.log"
Jul 07 16:24:35.065308 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:35.065275    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-63.ec2.internal_375c4f29254a72a0dd1dd44cec3d3aa3/haproxy/0.log"
Jul 07 16:24:38.979944 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:38.979913    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l_6bb2d778-9316-4cc7-824a-98d580b26955/extract/0.log"
Jul 07 16:24:39.041801 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.041774    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l_6bb2d778-9316-4cc7-824a-98d580b26955/util/0.log"
Jul 07 16:24:39.103070 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.102984    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fm64l_6bb2d778-9316-4cc7-824a-98d580b26955/pull/0.log"
Jul 07 16:24:39.151759 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.151730    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm_c083d2ed-f96f-459c-b6ed-c847e729eb21/extract/0.log"
Jul 07 16:24:39.197606 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.197577    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm_c083d2ed-f96f-459c-b6ed-c847e729eb21/util/0.log"
Jul 07 16:24:39.248926 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.248896    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x68vm_c083d2ed-f96f-459c-b6ed-c847e729eb21/pull/0.log"
Jul 07 16:24:39.337047 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.337018    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g_ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b/extract/0.log"
Jul 07 16:24:39.372748 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.372673    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g_ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b/util/0.log"
Jul 07 16:24:39.422004 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.421978    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734bt9g_ee3e5971-b3f3-49a9-a3dc-39829fcb1e5b/pull/0.log"
Jul 07 16:24:39.495031 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.495002    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz_c69ac680-c66a-440a-a0eb-0be9500df0e7/extract/0.log"
Jul 07 16:24:39.548920 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.548889    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz_c69ac680-c66a-440a-a0eb-0be9500df0e7/util/0.log"
Jul 07 16:24:39.601907 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:39.601884    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7ncz_c69ac680-c66a-440a-a0eb-0be9500df0e7/pull/0.log"
Jul 07 16:24:40.413318 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:40.413286    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2hfrk_f0f2bf66-3706-4633-818d-6f07e3757d1f/limitador/0.log"
Jul 07 16:24:42.405949 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:42.405870    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-q7s74_501c8998-d6be-4933-93cd-191bdb0bdc73/cluster-monitoring-operator/0.log"
Jul 07 16:24:42.713123 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:42.713044    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9sp5x_95108425-433d-4a5f-a9b9-e3337023b185/node-exporter/0.log"
Jul 07 16:24:42.734330 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:42.734301    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9sp5x_95108425-433d-4a5f-a9b9-e3337023b185/kube-rbac-proxy/0.log"
Jul 07 16:24:42.762906 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:42.762885    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9sp5x_95108425-433d-4a5f-a9b9-e3337023b185/init-textfile/0.log"
Jul 07 16:24:43.260971 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:43.260943    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-986lp_e5e7aa84-da4f-495d-bd50-8d60f27ce157/prometheus-operator-admission-webhook/0.log"
Jul 07 16:24:44.681014 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.680966    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"]
Jul 07 16:24:44.681447 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681389    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90409b6-af04-4b3b-a56b-8575f9010a0e" containerName="maas-api"
Jul 07 16:24:44.681447 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681404    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90409b6-af04-4b3b-a56b-8575f9010a0e" containerName="maas-api"
Jul 07 16:24:44.681447 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681415    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" containerName="maas-api"
Jul 07 16:24:44.681447 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681421    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" containerName="maas-api"
Jul 07 16:24:44.681447 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681434    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" containerName="main"
Jul 07 16:24:44.681447 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681443    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" containerName="main"
Jul 07 16:24:44.681726 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681502    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d90409b6-af04-4b3b-a56b-8575f9010a0e" containerName="maas-api"
Jul 07 16:24:44.681726 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681510    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd9d3098-7e5a-4f1d-84d2-8cb5b190981e" containerName="main"
Jul 07 16:24:44.681726 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.681521    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e15c0a4-0454-44f3-8f9f-9ad8abe99526" containerName="maas-api"
Jul 07 16:24:44.684612 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.684594    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.687494 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.687474    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kfm9g\"/\"kube-root-ca.crt\""
Jul 07 16:24:44.687494 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.687487    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kfm9g\"/\"openshift-service-ca.crt\""
Jul 07 16:24:44.687669 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.687510    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kfm9g\"/\"default-dockercfg-pc4lw\""
Jul 07 16:24:44.696889 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.696863    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"]
Jul 07 16:24:44.718419 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.718387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-podres\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.718556 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.718442    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-lib-modules\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.718556 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.718468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-proc\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.718556 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.718492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nv8f\" (UniqueName: \"kubernetes.io/projected/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-kube-api-access-5nv8f\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.718556 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.718512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-sys\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819154 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-podres\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819344 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-lib-modules\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819344 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819304    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-lib-modules\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819344 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819313    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-podres\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819465 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-proc\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819465 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nv8f\" (UniqueName: \"kubernetes.io/projected/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-kube-api-access-5nv8f\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819465 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819392    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-proc\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819465 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-sys\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.819596 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.819489    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-sys\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.830133 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.830107    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nv8f\" (UniqueName: \"kubernetes.io/projected/fe217343-7b6e-45a5-9aa0-f8fe02f75b50-kube-api-access-5nv8f\") pod \"perf-node-gather-daemonset-q8bxm\" (UID: \"fe217343-7b6e-45a5-9aa0-f8fe02f75b50\") " pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:44.994398 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:44.994287    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:45.134091 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:45.134063    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"]
Jul 07 16:24:45.135911 ip-10-0-141-63 kubenswrapper[2570]: W0707 16:24:45.135881    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfe217343_7b6e_45a5_9aa0_f8fe02f75b50.slice/crio-65c87d7b844c60e2a587b4d726b865d6df834b31f7ab8e93ca102ced0ab77481 WatchSource:0}: Error finding container 65c87d7b844c60e2a587b4d726b865d6df834b31f7ab8e93ca102ced0ab77481: Status 404 returned error can't find the container with id 65c87d7b844c60e2a587b4d726b865d6df834b31f7ab8e93ca102ced0ab77481
Jul 07 16:24:46.012493 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:46.012461    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dqh92_52a12c3a-9620-4341-a854-f40856dfb048/download-server/0.log"
Jul 07 16:24:46.113372 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:46.113337    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm" event={"ID":"fe217343-7b6e-45a5-9aa0-f8fe02f75b50","Type":"ContainerStarted","Data":"3476e780d9e06f0757c87a2085993d4aa25e2bd8492c2b23fe5e7d80bf8fcd92"}
Jul 07 16:24:46.113570 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:46.113395    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm" event={"ID":"fe217343-7b6e-45a5-9aa0-f8fe02f75b50","Type":"ContainerStarted","Data":"65c87d7b844c60e2a587b4d726b865d6df834b31f7ab8e93ca102ced0ab77481"}
Jul 07 16:24:46.113570 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:46.113463    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:46.133819 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:46.133768    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm" podStartSLOduration=2.133750084 podStartE2EDuration="2.133750084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:46.132382679 +0000 UTC m=+2626.267808556" watchObservedRunningTime="2026-07-07 16:24:46.133750084 +0000 UTC m=+2626.269175948"
Jul 07 16:24:46.645307 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:46.645278    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-tlddv_6b067879-6093-44c7-a149-d7e81fb97482/volume-data-source-validator/0.log"
Jul 07 16:24:47.823073 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:47.823038    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fl9q7_b4b3b134-c678-4bce-84ba-07631be5f5b4/dns/0.log"
Jul 07 16:24:47.852876 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:47.852846    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fl9q7_b4b3b134-c678-4bce-84ba-07631be5f5b4/kube-rbac-proxy/0.log"
Jul 07 16:24:48.010059 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:48.010031    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcxcp_215b79d3-981f-428a-b75b-eb8cf9b21111/dns-node-resolver/0.log"
Jul 07 16:24:48.721967 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:48.721938    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q2x98_3a0277e1-1f50-4b00-9d93-8e9465792701/node-ca/0.log"
Jul 07 16:24:49.906316 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:49.906286    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzwjn_18c8cee2-a293-4582-bad1-8cb352594b7f/discovery/0.log"
Jul 07 16:24:50.937358 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:50.937328    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-md92w_ac675709-090a-4b96-b262-f35e168df417/serve-healthcheck-canary/0.log"
Jul 07 16:24:51.512678 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:51.512630    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45qcb_3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb/kube-rbac-proxy/0.log"
Jul 07 16:24:51.538398 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:51.538377    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45qcb_3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb/exporter/0.log"
Jul 07 16:24:51.563646 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:51.563621    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45qcb_3b8bbe9a-dde5-44e2-a42d-beb5d623a1cb/extractor/0.log"
Jul 07 16:24:52.127743 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:52.127713    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kfm9g/perf-node-gather-daemonset-q8bxm"
Jul 07 16:24:54.617581 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:54.617544    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724015-p6wvk_e7804dd5-73e8-4e15-ba85-2d0d8784a93e/cleanup/0.log"
Jul 07 16:24:54.934693 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:54.934659    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-685dff6fcf-cmjjp_827b5763-2dde-46db-baae-4382121b0e2f/manager/0.log"
Jul 07 16:24:54.962946 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:54.962921    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-685dff6fcf-cmjjp_827b5763-2dde-46db-baae-4382121b0e2f/copy-manifests/0.log"
Jul 07 16:24:55.415461 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:55.415417    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzwjn_18c8cee2-a293-4582-bad1-8cb352594b7f/discovery/0.log"
Jul 07 16:24:56.732961 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:56.732929    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7444699877-czv55_b7b73d3b-b1c4-4136-9100-1eb80cae737f/manager/0.log"
Jul 07 16:24:56.809130 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:56.809101    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vp88r_52226476-bb38-4544-9c4f-8917ad03e786/openshift-lws-operator/0.log"
Jul 07 16:24:56.923004 ip-10-0-141-63 kubenswrapper[2570]: I0707 16:24:56.922973    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzwjn_18c8cee2-a293-4582-bad1-8cb352594b7f/discovery/0.log"