Jul 07 02:09:29.569829 ip-10-0-129-246 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 02:09:30.019532 ip-10-0-129-246 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:09:30.019532 ip-10-0-129-246 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 02:09:30.019532 ip-10-0-129-246 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:09:30.019532 ip-10-0-129-246 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 02:09:30.019532 ip-10-0-129-246 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:09:30.021204 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.021115    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 02:09:30.027779 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027757    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:09:30.027779 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027776    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:09:30.027779 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027779    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:09:30.027779 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027783    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:09:30.027779 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027786    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027789    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027792    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027794    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027797    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027801    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027803    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027806    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027808    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027811    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027813    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027816    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027818    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027821    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027824    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027826    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027837    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027840    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027842    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027845    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:09:30.027975 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027848    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027850    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027853    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027855    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027858    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027860    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027863    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027865    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027868    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027870    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027873    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027875    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027878    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027880    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027883    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027885    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027888    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027891    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027893    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027896    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:09:30.028452 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027899    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027901    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027904    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027906    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027909    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027911    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027914    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027916    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027919    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027923    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027926    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027928    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027931    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027933    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027936    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027939    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027943    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027946    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027949    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027952    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:09:30.028985 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027954    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027957    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027959    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027962    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027964    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027967    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027970    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027973    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027975    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027978    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027980    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027983    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027985    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027988    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027992    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027996    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.027999    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028002    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028005    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:09:30.029457 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028009    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028012    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028015    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028017    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028020    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028023    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028026    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028028    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028032    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028036    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028038    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028040    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028043    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028046    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028048    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.028050    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029614    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029622    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029627    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:09:30.029931 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029631    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029634    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029637    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029640    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029642    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029645    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029647    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029650    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029652    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029655    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029657    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029660    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029662    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029665    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029668    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029671    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029673    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029676    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029679    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:09:30.030388 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029682    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029684    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029687    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029689    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029692    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029694    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029696    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029699    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029701    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029704    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029706    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029711    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029715    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029717    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029720    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029723    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029725    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029727    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029730    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:09:30.030865 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029732    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029735    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029737    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029739    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029742    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029744    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029747    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029749    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029752    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029755    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029758    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029761    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029764    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029766    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029768    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029771    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029773    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029776    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029778    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029780    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:09:30.031355 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029783    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029785    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029788    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029790    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029792    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029795    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029797    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029800    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029802    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029804    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029807    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029809    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029811    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029814    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029816    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029818    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029821    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029824    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029827    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029829    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:09:30.031870 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029832    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029834    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029837    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029840    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029843    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029846    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029850    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029853    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029856    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029858    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029861    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029864    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029866    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029869    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029871    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029874    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029876    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.029878    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030265    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:09:30.032390 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030269    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030272    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030275    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030277    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030280    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030283    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030286    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030288    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030291    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030293    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030296    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030299    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030301    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030304    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030307    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030311    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030314    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030318    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030321    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:09:30.032966 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030323    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030326    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030328    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030331    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030333    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030336    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030338    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030341    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030343    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030346    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030348    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030351    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030353    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030355    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030358    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030360    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030362    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030365    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030367    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030369    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:09:30.033429 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030372    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030382    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030384    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030387    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030389    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030392    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030395    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030397    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030401    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030404    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030406    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030409    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030412    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030416    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030419    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030422    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030425    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030427    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030430    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:09:30.033925 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030433    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030435    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030438    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030440    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030443    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030445    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030448    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030450    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030453    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030456    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030458    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030460    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030463    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030465    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030467    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030470    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030473    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030477    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030479    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030482    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:09:30.034384 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030484    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030487    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030489    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030492    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030495    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030497    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030500    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030502    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030504    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030506    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030508    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030511    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030513    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030515    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030518    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030520    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030523    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030525    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030529    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.030531    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:09:30.034873 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030621    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030629    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030635    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030640    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030644    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030647    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030651    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030655    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030658    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030661    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030665    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030668    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030671    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030674    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030677    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030680    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030683    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030686    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030691    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030693    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030696    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030699    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030702    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030706    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 02:09:30.035356 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030709    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030712    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030715    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030718    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030721    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030723    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030726    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030729    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030733    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030736    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030739    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030742    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030745    2562 flags.go:64] FLAG: --enable-server="true"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030747    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030751    2562 flags.go:64] FLAG: --event-burst="100"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030754    2562 flags.go:64] FLAG: --event-qps="50"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030757    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030759    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030762    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030766    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030769    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030772    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030775    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030777    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030780    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 02:09:30.035945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030784    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030786    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030789    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030792    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030794    2562 flags.go:64] FLAG: --feature-gates=""
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030797    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030800    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030803    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030806    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030809    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030812    2562 flags.go:64] FLAG: --help="false"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030814    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030817    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030820    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030823    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030826    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030829    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030833    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030836    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030839    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030842    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030844    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030847    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030850    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 07 02:09:30.036651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030852    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030855    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030858    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030861    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030863    2562 flags.go:64] FLAG: --lock-file=""
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030866    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030869    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030872    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030877    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030880    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030883    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030886    2562 flags.go:64] FLAG: --logging-format="text"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030889    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030894    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030897    2562 flags.go:64] FLAG: --manifest-url=""
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030899    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030903    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030906    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030910    2562 flags.go:64] FLAG: --max-pods="110"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030913    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030916    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030918    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030921    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030924    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030927    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 02:09:30.037237 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030929    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030937    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030941    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030943    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030946    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030949    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030954    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030956    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030959    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030962    2562 flags.go:64] FLAG: --port="10250"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030965    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030967    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca1ee6cd666e1cd8"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030970    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030973    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030976    2562 flags.go:64] FLAG: --register-node="true"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030978    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030982    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030985    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030987    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030990    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030995    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.030998    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031001    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031003    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031006    2562 flags.go:64] FLAG: --runonce="false"
Jul 07 02:09:30.037855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031009    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031011    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031014    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031017    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031020    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031022    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031025    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031028    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031031    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031034    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031036    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031039    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031042    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031044    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031047    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031052    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031054    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031057    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031062    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031064    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031067    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031069    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031072    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031075    2562 flags.go:64] FLAG: --v="2"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031079    2562 flags.go:64] FLAG: --version="false"
Jul 07 02:09:30.038461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031083    2562 flags.go:64] FLAG: --vmodule=""
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031087    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031091    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031202    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031206    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031208    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031211    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031214    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031216    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031219    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031221    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031225    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031229    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031232    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031234    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031239    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031242    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031245    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031247    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:09:30.039081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031249    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031252    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031254    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031257    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031259    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031261    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031264    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031266    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031269    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031271    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031273    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031276    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031278    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031281    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031284    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031287    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031291    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031293    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031295    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031298    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:09:30.039571 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031300    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031303    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031306    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031308    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031311    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031313    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031315    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031318    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031322    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031324    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031326    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031329    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031331    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031334    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031336    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031339    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031341    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031344    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031346    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031349    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:09:30.040066 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031351    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031354    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031356    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031359    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031361    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031364    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031366    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031371    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031374    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031376    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031378    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031381    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031384    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031386    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031389    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031391    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031394    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031396    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031399    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031401    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:09:30.040682 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031405    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031407    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031410    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031413    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031417    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031419    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031422    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031424    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031428    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031431    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031434    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031436    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031439    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031442    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031444    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031447    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031449    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031452    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031455    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:09:30.041166 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031459    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031462    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031465    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.031467    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.031476    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.038751    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.038767    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.038786    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.038801    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038855    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038860    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038863    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038867    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038870    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038872    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:09:30.041633 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038875    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038878    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038880    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038883    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038885    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038887    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038890    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038892    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038895    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038898    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038900    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038903    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038905    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038907    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038910    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038912    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038915    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038917    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038920    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038922    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:09:30.042022 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038924    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038927    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038930    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038933    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038936    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038941    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038944    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038948    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038951    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038953    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038956    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038958    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038960    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038963    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038965    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038968    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038970    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038973    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038975    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:09:30.042507 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038977    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038980    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038982    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038985    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038987    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038990    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038992    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038994    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038997    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.038999    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039002    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039004    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039007    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039009    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039013    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039015    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039018    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039021    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039024    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039026    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:09:30.042986 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039029    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039032    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039035    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039038    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039040    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039042    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039045    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039047    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039050    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039052    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039055    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039057    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039059    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039062    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039064    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039067    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039069    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039071    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039074    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:09:30.043471 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039076    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039079    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039081    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039084    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039086    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039089    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039092    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039095    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039098    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039101    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039103    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039106    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039108    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039111    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039113    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:09:30.043945 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.039118    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039229    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039234    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039236    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039239    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039242    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039245    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039249    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039253    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039256    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039259    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039262    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039264    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039267    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039270    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039273    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039275    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039278    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039281    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039283    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:09:30.044316 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039286    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039288    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039291    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039294    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039296    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039299    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039303    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039305    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039308    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039310    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039313    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039315    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039317    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039320    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039322    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039325    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039327    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039330    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039332    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039334    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:09:30.044805 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039336    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039339    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039341    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039343    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039346    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039348    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039350    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039353    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039355    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039358    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039360    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039362    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039365    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039367    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039370    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039372    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039374    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039377    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039380    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039382    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:09:30.045296 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039384    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039387    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039391    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039394    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039396    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039398    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039401    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039403    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039405    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039408    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039410    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039412    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039414    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039417    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039419    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039421    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039424    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039426    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039428    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039431    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:09:30.045792 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039433    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039435    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039438    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039440    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039443    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039445    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039447    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039451    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039454    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039457    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039460    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039464    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039467    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039470    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039473    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039476    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039478    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039481    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039484    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:09:30.046271 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:30.039486    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:09:30.046755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.039491    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:09:30.046755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.039622    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 02:09:30.046755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.042742    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 02:09:30.046755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.044159    2562 server.go:1019] "Starting client certificate rotation"
Jul 07 02:09:30.046755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.044256    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 02:09:30.046755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.044296    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 02:09:30.046929 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.046810    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 02:09:30.050473 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.050455    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 02:09:30.061766 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.061745    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 07 02:09:30.065219 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.065197    2562 log.go:25] "Validated CRI v1 image API"
Jul 07 02:09:30.066070 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.066052    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 02:09:30.070130 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.070107    2562 fs.go:135] Filesystem UUIDs: map[053b0aa3-d097-4997-9ae8-48edc052d031:/dev/nvme0n1p3 5dfbf5e5-71e1-4f3f-9019-55e230d47540:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 07 02:09:30.070203 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.070128    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 02:09:30.074640 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.074623    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 02:09:30.075490 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.075388    2562 manager.go:216] Machine: {Timestamp:2026-07-07 02:09:30.073974516 +0000 UTC m=+0.373037119 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099586 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c19e877098e0a3929028e30941407 SystemUUID:ec2c19e8-7709-8e0a-3929-028e30941407 BootID:3e3aaa5f-699e-4833-8051-994c81304313 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:73:3c:d6:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:73:3c:d6:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:99:01:86:e7:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 02:09:30.075490 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.075485    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 02:09:30.075614 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.075583    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 02:09:30.079173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.079150    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 02:09:30.079305 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.079176    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 02:09:30.080186 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.080175    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 02:09:30.080216 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.080189    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 02:09:30.080216 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.080196    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 02:09:30.081094 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.081083    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 02:09:30.083048 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.083038    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 02:09:30.087135 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087123    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 02:09:30.087412 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087402    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 02:09:30.087444 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087434    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 02:09:30.087470 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087445    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 02:09:30.087470 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087456    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 02:09:30.087470 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087467    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 07 02:09:30.087573 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087476    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 02:09:30.087938 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087919    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 02:09:30.088059 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.087944    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 02:09:30.090429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.090410    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 02:09:30.092508 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.092493    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 02:09:30.092586 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.092524    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 02:09:30.093828 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093818    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093834    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093841    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093846    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093855    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093860    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093871    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 02:09:30.093882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093879    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 02:09:30.094053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093886    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 02:09:30.094053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093891    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 02:09:30.094053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093900    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 02:09:30.094053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.093905    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 02:09:30.094787 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.094776    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 02:09:30.094787 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.094787    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 02:09:30.097307 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.097287    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 02:09:30.097307 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.097294    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 02:09:30.097403 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.097333    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 02:09:30.098527 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.098513    2562 server.go:1268] "Started kubelet"
Jul 07 02:09:30.098656 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.098630    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 02:09:30.098818 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.098763    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 02:09:30.098882 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.098844    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 02:09:30.099270 ip-10-0-129-246 systemd[1]: Started Kubernetes Kubelet.
Jul 07 02:09:30.100843 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.100823    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 02:09:30.101046 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.101033    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 02:09:30.104632 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.103629    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-246.ec2.internal.18bfdfe930a4c5b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-246.ec2.internal,UID:ip-10-0-129-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-246.ec2.internal,},FirstTimestamp:2026-07-07 02:09:30.098484661 +0000 UTC m=+0.397547317,LastTimestamp:2026-07-07 02:09:30.098484661 +0000 UTC m=+0.397547317,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-246.ec2.internal,}"
Jul 07 02:09:30.105282 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.105264    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 02:09:30.108349 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.108328    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 02:09:30.108349 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.108340    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 02:09:30.108481 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.108406    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.109673 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.109659    2562 factory.go:55] Registering systemd factory
Jul 07 02:09:30.109821 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.109811    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 07 02:09:30.110187 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110089    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 02:09:30.110187 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110125    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 02:09:30.110312 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110190    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 02:09:30.110312 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110232    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 02:09:30.110312 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110240    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 02:09:30.110714 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110694    2562 factory.go:153] Registering CRI-O factory
Jul 07 02:09:30.110792 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110717    2562 factory.go:223] Registration of the crio container factory successfully
Jul 07 02:09:30.110792 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110784    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 02:09:30.110880 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110815    2562 factory.go:103] Registering Raw factory
Jul 07 02:09:30.110880 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.110832    2562 manager.go:1196] Started watching for new ooms in manager
Jul 07 02:09:30.111227 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.111211    2562 manager.go:349] Starting recovery of all containers
Jul 07 02:09:30.119570 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.119387    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 02:09:30.119570 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.119454    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 02:09:30.123056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.123038    2562 manager.go:354] Recovery completed
Jul 07 02:09:30.125697 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.125678    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mt772"
Jul 07 02:09:30.127208 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.127196    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.129457 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.129439    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.129530 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.129471    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.129530 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.129485    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.130053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130037    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 02:09:30.130053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130051    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 02:09:30.130170 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130055    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.130170 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130065    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 02:09:30.130713 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130695    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.130776 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130724    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.130776 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.130733    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.131699 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.131685    2562 policy_none.go:49] "None policy: Start"
Jul 07 02:09:30.131747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.131707    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 02:09:30.131747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.131722    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 02:09:30.133039 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.133024    2562 policy_none.go:47] "Start"
Jul 07 02:09:30.133682 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.133667    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mt772"
Jul 07 02:09:30.171117 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171100    2562 manager.go:337] "Starting Device Plugin manager"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.171131    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171141    2562 server.go:87] "Starting device plugin registration server"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171370    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171380    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171463    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171563    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.171572    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.172076    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 02:09:30.186616 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.172222    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.244810 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.244765    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 02:09:30.246277 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.246258    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 02:09:30.246372 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.246307    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 02:09:30.246372 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.246332    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 02:09:30.246470 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.246371    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 02:09:30.248961 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.248938    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:09:30.272187 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.272127    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.273103 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.273086    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.273162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.273117    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.273162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.273127    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.273162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.273151    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.282627 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.282609    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.282668 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.282633    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-246.ec2.internal\": node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.303832 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.303810    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.346485 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.346462    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"]
Jul 07 02:09:30.346565 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.346519    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.347375 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.347362    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.347433 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.347390    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.347433 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.347399    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.349048 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349036    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.349168 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349142    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.349263 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349176    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.349748 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349731    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.349748 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349742    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.349897 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349761    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.349897 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349775    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.349897 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349764    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.349897 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.349843    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.351490 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.351476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.351532 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.351501    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:09:30.352149 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.352137    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:09:30.352199 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.352161    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:09:30.352199 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.352176    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:09:30.374199 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.374177    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-246.ec2.internal\" not found" node="ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.378500 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.378483    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-246.ec2.internal\" not found" node="ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.404538 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.404519    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.411540 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.411522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f7c227f086314e8b066b539e30b1918-config\") pod \"kube-apiserver-proxy-ip-10-0-129-246.ec2.internal\" (UID: \"3f7c227f086314e8b066b539e30b1918\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.411615 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.411560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43d2a0f9bfe83ce86ae7ab2e144d312a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"43d2a0f9bfe83ce86ae7ab2e144d312a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.411615 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.411580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d2a0f9bfe83ce86ae7ab2e144d312a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"43d2a0f9bfe83ce86ae7ab2e144d312a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.505580 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.505519    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.511947 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.511924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f7c227f086314e8b066b539e30b1918-config\") pod \"kube-apiserver-proxy-ip-10-0-129-246.ec2.internal\" (UID: \"3f7c227f086314e8b066b539e30b1918\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.512012 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.511955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43d2a0f9bfe83ce86ae7ab2e144d312a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"43d2a0f9bfe83ce86ae7ab2e144d312a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.512012 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.511974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d2a0f9bfe83ce86ae7ab2e144d312a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"43d2a0f9bfe83ce86ae7ab2e144d312a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.512111 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.512012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d2a0f9bfe83ce86ae7ab2e144d312a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"43d2a0f9bfe83ce86ae7ab2e144d312a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.512111 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.512024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f7c227f086314e8b066b539e30b1918-config\") pod \"kube-apiserver-proxy-ip-10-0-129-246.ec2.internal\" (UID: \"3f7c227f086314e8b066b539e30b1918\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.512111 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.512076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43d2a0f9bfe83ce86ae7ab2e144d312a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal\" (UID: \"43d2a0f9bfe83ce86ae7ab2e144d312a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.606394 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.606322    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.677881 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.677840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.683460 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:30.683442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:30.706962 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.706941    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.807424 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.807385    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:30.908008 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:30.907944    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:31.008568 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.008524    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-246.ec2.internal\" not found"
Jul 07 02:09:31.043996 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.043965    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 02:09:31.044614 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.044098    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 02:09:31.071956 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.071934    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:09:31.088678 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.088645    2562 apiserver.go:52] "Watching apiserver"
Jul 07 02:09:31.097392 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.097370    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 02:09:31.099649 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.099631    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d2mxb","kube-system/konnectivity-agent-8j42g","openshift-dns/node-resolver-sfqbq","openshift-image-registry/node-ca-sq475","openshift-multus/network-metrics-daemon-cv6l6","openshift-network-operator/iptables-alerter-h7jxp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp","openshift-cluster-node-tuning-operator/tuned-dpmvz","openshift-multus/multus-6nzvk","openshift-multus/multus-additional-cni-plugins-rx725","openshift-network-diagnostics/network-check-target-7ljb4","openshift-ovn-kubernetes/ovnkube-node-5fddr"]
Jul 07 02:09:31.101600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.101585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.101662 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.101645    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:31.103125 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.103106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.105256 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.105236    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 02:09:31.105339 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.105287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.105416 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.105395    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 02:09:31.105486 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.105396    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tl5d4\""
Jul 07 02:09:31.106608 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.106593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.106934 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.106919    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.107208 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.107197    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.107294 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.107281    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cj662\""
Jul 07 02:09:31.108177 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:31.108282 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.108246    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:31.108327 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.108415 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108401    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 02:09:31.108596 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108583    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:31.108651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108596    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tw4wg\""
Jul 07 02:09:31.108651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108615    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 02:09:31.108651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.108630    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.109844 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.109830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.111692 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.111677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.111774 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.111697    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.112049 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.112029    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f5j5d\""
Jul 07 02:09:31.112134 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.112038    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.112134 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.112036    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 02:09:31.113516 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.113501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.113727 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.113700    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 02:09:31.113829 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.113727    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.113829 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.113779    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kkhjl\""
Jul 07 02:09:31.113946 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.113933    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.115203 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-host\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.115245 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-serviceca\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.115245 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqkvv\" (UniqueName: \"kubernetes.io/projected/44f34d15-5852-416f-a7f9-5a0d8ff24990-kube-api-access-sqkvv\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.115331 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3483671b-37a1-486b-b6c1-a4783d063235-kubelet-config\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.115331 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3483671b-37a1-486b-b6c1-a4783d063235-dbus\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.115331 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115308    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.115423 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.115423 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-registration-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.115423 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0406dd5f-b302-46b9-82b7-5c31d0854612-hosts-file\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.115578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0406dd5f-b302-46b9-82b7-5c31d0854612-tmp-dir\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.115578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27gwr\" (UniqueName: \"kubernetes.io/projected/0406dd5f-b302-46b9-82b7-5c31d0854612-kube-api-access-27gwr\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.115578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115471    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.115578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qstt\" (UniqueName: \"kubernetes.io/projected/74996c74-f396-44e7-9ae9-5084d8175756-kube-api-access-2qstt\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:31.115578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.115578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44f34d15-5852-416f-a7f9-5a0d8ff24990-iptables-alerter-script\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-sys-fs\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/994816f2-6fef-4ed9-acfd-f129b249e094-agent-certs\") pod \"konnectivity-agent-8j42g\" (UID: \"994816f2-6fef-4ed9-acfd-f129b249e094\") " pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/994816f2-6fef-4ed9-acfd-f129b249e094-konnectivity-ca\") pod \"konnectivity-agent-8j42g\" (UID: \"994816f2-6fef-4ed9-acfd-f129b249e094\") " pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvgh\" (UniqueName: \"kubernetes.io/projected/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-kube-api-access-slvgh\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44f34d15-5852-416f-a7f9-5a0d8ff24990-host-slash\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-socket-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.115837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115836    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tn7hn\""
Jul 07 02:09:31.116179 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-device-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.116179 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.115900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqg6t\" (UniqueName: \"kubernetes.io/projected/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-kube-api-access-nqg6t\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.116179 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.116152    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.117412 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117395    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 02:09:31.117511 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117495    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.117591 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117405    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-phwsk\""
Jul 07 02:09:31.117591 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117480    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 02:09:31.117672 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117662    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.117774 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.117980 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.117960    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 02:09:31.119344 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.119328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:31.119422 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.119398    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:31.120271 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.120081    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 02:09:31.120271 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.120171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-76nzr\""
Jul 07 02:09:31.122674 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.121935    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 02:09:31.122674 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.122044    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"
Jul 07 02:09:31.122674 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.122052    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 02:09:31.123974 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.123958    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.124708 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.124691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal"]
Jul 07 02:09:31.127191 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 02:09:31.127191 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127176    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 02:09:31.127339 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 02:09:31.127339 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127204    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v2zzd\""
Jul 07 02:09:31.127339 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127281    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 02:09:31.127590 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127578    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 02:09:31.127633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.127620    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 02:09:31.131180 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.131166    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal"]
Jul 07 02:09:31.131317 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.131304    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 02:09:31.135889 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.135848    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 02:04:31 +0000 UTC" deadline="2028-04-12 07:51:01.649679414 +0000 UTC"
Jul 07 02:09:31.135941 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.135892    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15485h41m30.513790899s"
Jul 07 02:09:31.149326 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.149311    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnmph"
Jul 07 02:09:31.174217 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.174193    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnmph"
Jul 07 02:09:31.211101 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.211075    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 02:09:31.216780 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.216894 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-tmp\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.216894 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.216894 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.216894 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-device-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-etc-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysconfig\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216970    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-device-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216982    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.216991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-tuned\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3483671b-37a1-486b-b6c1-a4783d063235-dbus\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-hostroot\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-cni-bin\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-cni-netd\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-multus-certs\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3483671b-37a1-486b-b6c1-a4783d063235-dbus\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.217075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-systemd\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr7kl\" (UniqueName: \"kubernetes.io/projected/a33e5efb-95d3-4dca-b90d-e6d8f072085c-kube-api-access-tr7kl\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-sys-fs\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/994816f2-6fef-4ed9-acfd-f129b249e094-konnectivity-ca\") pod \"konnectivity-agent-8j42g\" (UID: \"994816f2-6fef-4ed9-acfd-f129b249e094\") " pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44f34d15-5852-416f-a7f9-5a0d8ff24990-host-slash\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-socket-dir-parent\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-sys-fs\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-conf-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-run\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217322    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44f34d15-5852-416f-a7f9-5a0d8ff24990-host-slash\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-serviceca\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2678f7b0-5d56-4982-b6a9-42cbf9d53425-cni-binary-copy\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-cni-bin\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-env-overrides\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovnkube-script-lib\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-registration-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.217906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-registration-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-cni-multus\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-daemon-config\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-modprobe-d\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysctl-d\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-lib-modules\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cnibin\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217781    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-serviceca\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvgh\" (UniqueName: \"kubernetes.io/projected/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-kube-api-access-slvgh\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/994816f2-6fef-4ed9-acfd-f129b249e094-konnectivity-ca\") pod \"konnectivity-agent-8j42g\" (UID: \"994816f2-6fef-4ed9-acfd-f129b249e094\") " pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-etc-kubernetes\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-ovn\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-socket-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqkvv\" (UniqueName: \"kubernetes.io/projected/44f34d15-5852-416f-a7f9-5a0d8ff24990-kube-api-access-sqkvv\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.217923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-netns\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-run-netns\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.218719 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovnkube-config\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-socket-dir\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovn-node-metrics-cert\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3483671b-37a1-486b-b6c1-a4783d063235-kubelet-config\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0406dd5f-b302-46b9-82b7-5c31d0854612-tmp-dir\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218331    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3483671b-37a1-486b-b6c1-a4783d063235-kubelet-config\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-os-release\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-kubelet\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.218401    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-systemd-units\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxzgl\" (UniqueName: \"kubernetes.io/projected/0a02b7cc-884e-4087-9222-5a1876bca3d3-kube-api-access-kxzgl\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.218471    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:31.718442835 +0000 UTC m=+2.017505431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-system-cni-dir\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.219643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44f34d15-5852-416f-a7f9-5a0d8ff24990-iptables-alerter-script\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-systemd\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-var-lib-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-node-log\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218676    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-kube-api-access-g78vk\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-os-release\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218730    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-kubelet\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-kubernetes\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.218896    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqg6t\" (UniqueName: \"kubernetes.io/projected/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-kube-api-access-nqg6t\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.218944    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:31.718927317 +0000 UTC m=+2.017989908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.218984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-host\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-cni-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.220625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0406dd5f-b302-46b9-82b7-5c31d0854612-hosts-file\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27gwr\" (UniqueName: \"kubernetes.io/projected/0406dd5f-b302-46b9-82b7-5c31d0854612-kube-api-access-27gwr\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-host\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-sys\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qstt\" (UniqueName: \"kubernetes.io/projected/74996c74-f396-44e7-9ae9-5084d8175756-kube-api-access-2qstt\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0406dd5f-b302-46b9-82b7-5c31d0854612-hosts-file\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-system-cni-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-cnibin\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vwl\" (UniqueName: \"kubernetes.io/projected/2678f7b0-5d56-4982-b6a9-42cbf9d53425-kube-api-access-84vwl\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-log-socket\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysctl-conf\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-var-lib-kubelet\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-host\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44f34d15-5852-416f-a7f9-5a0d8ff24990-iptables-alerter-script\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/994816f2-6fef-4ed9-acfd-f129b249e094-agent-certs\") pod \"konnectivity-agent-8j42g\" (UID: \"994816f2-6fef-4ed9-acfd-f129b249e094\") " pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-k8s-cni-cncf-io\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219418    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0406dd5f-b302-46b9-82b7-5c31d0854612-tmp-dir\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-slash\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.221494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.219713    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 02:09:31.223293 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.223268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/994816f2-6fef-4ed9-acfd-f129b249e094-agent-certs\") pod \"konnectivity-agent-8j42g\" (UID: \"994816f2-6fef-4ed9-acfd-f129b249e094\") " pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:31.229939 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.229913    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvgh\" (UniqueName: \"kubernetes.io/projected/443ab38e-9d9d-4ff0-b3b8-f9eaa5796010-kube-api-access-slvgh\") pod \"node-ca-sq475\" (UID: \"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010\") " pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:31.230037 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.229950    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqg6t\" (UniqueName: \"kubernetes.io/projected/e2456f04-823a-47d9-aacf-e8dc3c2ed0f1-kube-api-access-nqg6t\") pod \"aws-ebs-csi-driver-node-mr5rp\" (UID: \"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:31.230037 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.229918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqkvv\" (UniqueName: \"kubernetes.io/projected/44f34d15-5852-416f-a7f9-5a0d8ff24990-kube-api-access-sqkvv\") pod \"iptables-alerter-h7jxp\" (UID: \"44f34d15-5852-416f-a7f9-5a0d8ff24990\") " pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:31.230213 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.230183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qstt\" (UniqueName: \"kubernetes.io/projected/74996c74-f396-44e7-9ae9-5084d8175756-kube-api-access-2qstt\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:31.230382 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.230367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27gwr\" (UniqueName: \"kubernetes.io/projected/0406dd5f-b302-46b9-82b7-5c31d0854612-kube-api-access-27gwr\") pod \"node-resolver-sfqbq\" (UID: \"0406dd5f-b302-46b9-82b7-5c31d0854612\") " pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:31.294725 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.294698    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:09:31.320290 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovnkube-config\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320349    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovn-node-metrics-cert\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-os-release\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-kubelet\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-systemd-units\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320488    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-systemd-units\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxzgl\" (UniqueName: \"kubernetes.io/projected/0a02b7cc-884e-4087-9222-5a1876bca3d3-kube-api-access-kxzgl\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320513    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-kubelet\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320506    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-os-release\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-system-cni-dir\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-systemd\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-system-cni-dir\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-var-lib-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-systemd\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-node-log\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-kube-api-access-g78vk\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-node-log\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-os-release\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320733    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-var-lib-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-kubelet\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.320796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-kubernetes\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-os-release\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320875    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-kubernetes\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320887    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-cni-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-cni-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-sys\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-system-cni-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-cnibin\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321042    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-sys\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovnkube-config\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vwl\" (UniqueName: \"kubernetes.io/projected/2678f7b0-5d56-4982-b6a9-42cbf9d53425-kube-api-access-84vwl\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-log-socket\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysctl-conf\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-var-lib-kubelet\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321160    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-cnibin\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-host\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-k8s-cni-cncf-io\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.321668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-host\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-slash\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321257    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-system-cni-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321284    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-k8s-cni-cncf-io\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.320937    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-kubelet\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-tmp\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321416    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-log-socket\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321424    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysctl-conf\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-etc-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-var-lib-kubelet\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321462    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-slash\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysconfig\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321484    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-etc-openvswitch\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.322501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-tuned\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321563    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysconfig\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-hostroot\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-cni-bin\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321624    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-cni-netd\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-multus-certs\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-hostroot\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-systemd\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr7kl\" (UniqueName: \"kubernetes.io/projected/a33e5efb-95d3-4dca-b90d-e6d8f072085c-kube-api-access-tr7kl\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-socket-dir-parent\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-conf-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-run\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2678f7b0-5d56-4982-b6a9-42cbf9d53425-cni-binary-copy\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-cni-bin\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:31.323352 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-env-overrides\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovnkube-script-lib\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-cni-multus\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-daemon-config\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.321999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-modprobe-d\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysctl-d\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-lib-modules\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322094    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cnibin\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-etc-kubernetes\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-sysctl-d\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-ovn\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-run-ovn\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-netns\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322270    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a33e5efb-95d3-4dca-b90d-e6d8f072085c-cnibin\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.323952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322284    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-lib-modules\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-run-netns\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-etc-kubernetes\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322371    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-cni-netd\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322386    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-cni-bin\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322405    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-multus-certs\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-cni-multus\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-socket-dir-parent\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322836    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2678f7b0-5d56-4982-b6a9-42cbf9d53425-cni-binary-copy\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-conf-dir\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322932    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-run\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.322941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2678f7b0-5d56-4982-b6a9-42cbf9d53425-multus-daemon-config\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323162    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovnkube-script-lib\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323258    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-var-lib-cni-bin\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2678f7b0-5d56-4982-b6a9-42cbf9d53425-host-run-netns\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0a02b7cc-884e-4087-9222-5a1876bca3d3-env-overrides\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-modprobe-d\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323395    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a02b7cc-884e-4087-9222-5a1876bca3d3-host-run-netns\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-systemd\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.324989 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.323458    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a02b7cc-884e-4087-9222-5a1876bca3d3-ovn-node-metrics-cert\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.324989 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.324084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-tmp\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.324989 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.324137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-etc-tuned\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.327899 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.327878    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:09:31.327899 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.327903    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:09:31.328071 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.327916    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:31.328071 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:31.328014    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:31.827995171 +0000 UTC m=+2.127057784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:31.328531 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.328498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc-kube-api-access-g78vk\") pod \"tuned-dpmvz\" (UID: \"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc\") " pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:31.328852 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.328828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxzgl\" (UniqueName: \"kubernetes.io/projected/0a02b7cc-884e-4087-9222-5a1876bca3d3-kube-api-access-kxzgl\") pod \"ovnkube-node-5fddr\" (UID: \"0a02b7cc-884e-4087-9222-5a1876bca3d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:31.329067 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.329048    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vwl\" (UniqueName: \"kubernetes.io/projected/2678f7b0-5d56-4982-b6a9-42cbf9d53425-kube-api-access-84vwl\") pod \"multus-6nzvk\" (UID: \"2678f7b0-5d56-4982-b6a9-42cbf9d53425\") " pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:31.329803 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.329787    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr7kl\" (UniqueName: \"kubernetes.io/projected/a33e5efb-95d3-4dca-b90d-e6d8f072085c-kube-api-access-tr7kl\") pod \"multus-additional-cni-plugins-rx725\" (UID: \"a33e5efb-95d3-4dca-b90d-e6d8f072085c\") " pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:31.339890 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:31.339856    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7c227f086314e8b066b539e30b1918.slice/crio-bfb6b346f52b073489a5bd1d187a831cef4f5da43d1775ec76b8d7f8f39c0e55 WatchSource:0}: Error finding container bfb6b346f52b073489a5bd1d187a831cef4f5da43d1775ec76b8d7f8f39c0e55: Status 404 returned error can't find the container with id bfb6b346f52b073489a5bd1d187a831cef4f5da43d1775ec76b8d7f8f39c0e55
Jul 07 02:09:31.342094 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:31.342071    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d2a0f9bfe83ce86ae7ab2e144d312a.slice/crio-311e599121ee833bfd76e41739733895974b3014377dc6d9491c870483139dba WatchSource:0}: Error finding container 311e599121ee833bfd76e41739733895974b3014377dc6d9491c870483139dba: Status 404 returned error can't find the container with id 311e599121ee833bfd76e41739733895974b3014377dc6d9491c870483139dba
Jul 07 02:09:31.345688 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:31.345672    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:09:32.718637 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.718616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:32.724466 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.724448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sfqbq"
Jul 07 02:09:32.728081 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.728062    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994816f2_6fef_4ed9_acfd_f129b249e094.slice/crio-fcb62a0cd4ea1699d0a649d97b0adf50e76d9f9870bf0c7210b7048b21d9eb94 WatchSource:0}: Error finding container fcb62a0cd4ea1699d0a649d97b0adf50e76d9f9870bf0c7210b7048b21d9eb94: Status 404 returned error can't find the container with id fcb62a0cd4ea1699d0a649d97b0adf50e76d9f9870bf0c7210b7048b21d9eb94
Jul 07 02:09:32.732788 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.732759    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0406dd5f_b302_46b9_82b7_5c31d0854612.slice/crio-4930a2ae3b148888b96d3d315c40ac9899b3c6f58d7ae3d5e7fb11872d6376b8 WatchSource:0}: Error finding container 4930a2ae3b148888b96d3d315c40ac9899b3c6f58d7ae3d5e7fb11872d6376b8: Status 404 returned error can't find the container with id 4930a2ae3b148888b96d3d315c40ac9899b3c6f58d7ae3d5e7fb11872d6376b8
Jul 07 02:09:32.753126 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.753108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sq475"
Jul 07 02:09:32.761034 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.761001    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443ab38e_9d9d_4ff0_b3b8_f9eaa5796010.slice/crio-18dc859471f5c9e91244d2d29bdfccb038e4de1d16da9e22624c58ba78c78a7a WatchSource:0}: Error finding container 18dc859471f5c9e91244d2d29bdfccb038e4de1d16da9e22624c58ba78c78a7a: Status 404 returned error can't find the container with id 18dc859471f5c9e91244d2d29bdfccb038e4de1d16da9e22624c58ba78c78a7a
Jul 07 02:09:32.765561 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.765543    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:09:32.767411 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.767394    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h7jxp"
Jul 07 02:09:32.774574 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.774551    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f34d15_5852_416f_a7f9_5a0d8ff24990.slice/crio-507884828b7548a0c03a3eb9f1b21358ed41e91d9c3bc4e5ee5c032f108a4f8c WatchSource:0}: Error finding container 507884828b7548a0c03a3eb9f1b21358ed41e91d9c3bc4e5ee5c032f108a4f8c: Status 404 returned error can't find the container with id 507884828b7548a0c03a3eb9f1b21358ed41e91d9c3bc4e5ee5c032f108a4f8c
Jul 07 02:09:32.795409 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.795391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp"
Jul 07 02:09:32.802773 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.802755    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2456f04_823a_47d9_aacf_e8dc3c2ed0f1.slice/crio-b7136b9c8a3c6714fb82e4dca4ffbaf6cf80ad0af4e5619b2b83750e242e8775 WatchSource:0}: Error finding container b7136b9c8a3c6714fb82e4dca4ffbaf6cf80ad0af4e5619b2b83750e242e8775: Status 404 returned error can't find the container with id b7136b9c8a3c6714fb82e4dca4ffbaf6cf80ad0af4e5619b2b83750e242e8775
Jul 07 02:09:32.804151 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.804136    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpmvz"
Jul 07 02:09:32.811332 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.811312    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbfda2f_7fe6_4e17_8fd6_4ebd831616dc.slice/crio-b8f5e8524f16302bd10626a455ec453db0c73351963c3ef6769c63a28aa430bb WatchSource:0}: Error finding container b8f5e8524f16302bd10626a455ec453db0c73351963c3ef6769c63a28aa430bb: Status 404 returned error can't find the container with id b8f5e8524f16302bd10626a455ec453db0c73351963c3ef6769c63a28aa430bb
Jul 07 02:09:32.844965 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.844937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6nzvk"
Jul 07 02:09:32.852783 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.852760    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2678f7b0_5d56_4982_b6a9_42cbf9d53425.slice/crio-f3ed394d64f6177846f7a94f6dcd04561148d84835893c4308cad196a1029c76 WatchSource:0}: Error finding container f3ed394d64f6177846f7a94f6dcd04561148d84835893c4308cad196a1029c76: Status 404 returned error can't find the container with id f3ed394d64f6177846f7a94f6dcd04561148d84835893c4308cad196a1029c76
Jul 07 02:09:32.862128 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.862110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rx725"
Jul 07 02:09:32.866472 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:32.866450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:32.869990 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.869969    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33e5efb_95d3_4dca_b90d_e6d8f072085c.slice/crio-ced8d0e44aef1288545d31dbd61a4903369dfc8195d515bb1874c40ea2b63b1b WatchSource:0}: Error finding container ced8d0e44aef1288545d31dbd61a4903369dfc8195d515bb1874c40ea2b63b1b: Status 404 returned error can't find the container with id ced8d0e44aef1288545d31dbd61a4903369dfc8195d515bb1874c40ea2b63b1b
Jul 07 02:09:32.875650 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:09:32.875629    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a02b7cc_884e_4087_9222_5a1876bca3d3.slice/crio-c9ab7330447eeabb17a731b9e24f316e002e88a2211464c816e95679972dee5b WatchSource:0}: Error finding container c9ab7330447eeabb17a731b9e24f316e002e88a2211464c816e95679972dee5b: Status 404 returned error can't find the container with id c9ab7330447eeabb17a731b9e24f316e002e88a2211464c816e95679972dee5b
Jul 07 02:09:33.006133 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.006048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:33.006133 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.006096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:33.006311 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.006194    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:33.006311 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.006196    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:33.006311 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.006260    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:34.006244255 +0000 UTC m=+3.024959197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:33.006311 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.006299    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:34.006271492 +0000 UTC m=+3.024986425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:33.207586 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.207539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:33.207770 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.207724    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:09:33.207770 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.207753    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:09:33.207770 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.207765    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:33.207949 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.207831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:34.207811851 +0000 UTC m=+3.226526785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:33.456880 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.456778    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:04:32 +0000 UTC" deadline="2028-01-18 17:41:34.64294136 +0000 UTC"
Jul 07 02:09:33.456880 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.456831    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13455h32m1.186115339s"
Jul 07 02:09:33.527929 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.527798    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:33.528102 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.527943    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:33.528479 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.528443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:33.528585 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:33.528548    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:33.554509 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.554447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"c9ab7330447eeabb17a731b9e24f316e002e88a2211464c816e95679972dee5b"}
Jul 07 02:09:33.577755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.577720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerStarted","Data":"ced8d0e44aef1288545d31dbd61a4903369dfc8195d515bb1874c40ea2b63b1b"}
Jul 07 02:09:33.592941 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.592883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6nzvk" event={"ID":"2678f7b0-5d56-4982-b6a9-42cbf9d53425","Type":"ContainerStarted","Data":"f3ed394d64f6177846f7a94f6dcd04561148d84835893c4308cad196a1029c76"}
Jul 07 02:09:33.617442 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.617409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpmvz" event={"ID":"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc","Type":"ContainerStarted","Data":"b8f5e8524f16302bd10626a455ec453db0c73351963c3ef6769c63a28aa430bb"}
Jul 07 02:09:33.632600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.632577    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:09:33.640312 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.640283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h7jxp" event={"ID":"44f34d15-5852-416f-a7f9-5a0d8ff24990","Type":"ContainerStarted","Data":"507884828b7548a0c03a3eb9f1b21358ed41e91d9c3bc4e5ee5c032f108a4f8c"}
Jul 07 02:09:33.656284 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.656241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sq475" event={"ID":"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010","Type":"ContainerStarted","Data":"18dc859471f5c9e91244d2d29bdfccb038e4de1d16da9e22624c58ba78c78a7a"}
Jul 07 02:09:33.680590 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.680563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sfqbq" event={"ID":"0406dd5f-b302-46b9-82b7-5c31d0854612","Type":"ContainerStarted","Data":"4930a2ae3b148888b96d3d315c40ac9899b3c6f58d7ae3d5e7fb11872d6376b8"}
Jul 07 02:09:33.692019 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.691987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8j42g" event={"ID":"994816f2-6fef-4ed9-acfd-f129b249e094","Type":"ContainerStarted","Data":"fcb62a0cd4ea1699d0a649d97b0adf50e76d9f9870bf0c7210b7048b21d9eb94"}
Jul 07 02:09:33.713002 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.712851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp" event={"ID":"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1","Type":"ContainerStarted","Data":"b7136b9c8a3c6714fb82e4dca4ffbaf6cf80ad0af4e5619b2b83750e242e8775"}
Jul 07 02:09:33.716965 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.716867    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" event={"ID":"43d2a0f9bfe83ce86ae7ab2e144d312a","Type":"ContainerStarted","Data":"311e599121ee833bfd76e41739733895974b3014377dc6d9491c870483139dba"}
Jul 07 02:09:33.728426 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:33.728210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal" event={"ID":"3f7c227f086314e8b066b539e30b1918","Type":"ContainerStarted","Data":"bfb6b346f52b073489a5bd1d187a831cef4f5da43d1775ec76b8d7f8f39c0e55"}
Jul 07 02:09:34.015205 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:34.015124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:34.015205 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:34.015179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:34.015442 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.015331    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:34.015442 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.015395    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:36.015376627 +0000 UTC m=+5.034091563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:34.015763 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.015745    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:34.015839 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.015810    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:36.015794743 +0000 UTC m=+5.034509677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:34.216797 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:34.216525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:34.217010 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.216987    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:09:34.217010 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.217008    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:09:34.217130 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.217020    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:34.217130 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.217081    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:36.217062491 +0000 UTC m=+5.235777424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:34.457944 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:34.457866    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:04:32 +0000 UTC" deadline="2028-01-11 09:48:10.898192062 +0000 UTC"
Jul 07 02:09:34.457944 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:34.457943    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13279h38m36.440253137s"
Jul 07 02:09:34.527456 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:34.526972    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:34.527456 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:34.527113    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:35.528782 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:35.528016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:35.528782 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:35.528151    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:35.529663 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:35.529444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:35.529663 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:35.529548    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:36.031920 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:36.031863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:36.032096 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:36.031932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:36.032096 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.032052    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:36.032235 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.032112    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:40.032092433 +0000 UTC m=+9.050807368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:36.032966 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.032411    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:36.032966 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.032472    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:40.032454755 +0000 UTC m=+9.051169702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:36.234706 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:36.234142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:36.234706 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.234281    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:09:36.234706 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.234298    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:09:36.234706 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.234308    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:36.234706 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.234366    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:40.234348216 +0000 UTC m=+9.253063149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:36.527190 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:36.527152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:36.527382 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:36.527307    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:37.529523 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:37.529486    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:37.530012 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:37.529621    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:37.530012 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:37.529986    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:37.530137 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:37.530070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:38.527528 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:38.527490    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:38.527712 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:38.527638    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:39.529269 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:39.529235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:39.529714 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:39.529361    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:39.529791 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:39.529763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:39.529946 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:39.529857    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:40.068737 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:40.068695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:40.068952 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:40.068759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:40.068952 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.068860    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:40.068952 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.068877    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:40.068952 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.068951    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:48.068930341 +0000 UTC m=+17.087645271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:40.069178 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.068966    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:48.068959691 +0000 UTC m=+17.087674621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:40.271409 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:40.271365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:40.271595 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.271543    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:09:40.271595 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.271562    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:09:40.271595 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.271576    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:40.271715 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.271633    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:09:48.271616179 +0000 UTC m=+17.290331113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:40.527741 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:40.527662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:40.527876 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:40.527792    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:41.530667 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:41.530100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:41.530667 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:41.530185    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:41.530667 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:41.530464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:41.530667 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:41.530547    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:42.527604 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:42.527505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:42.527843 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:42.527646    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:43.527134 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:43.527093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:43.527578 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:43.527233    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:43.527578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:43.527275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:43.527578 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:43.527390    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:44.527123 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:44.527088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:44.527292 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:44.527252    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:45.527628 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:45.527593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:45.528085 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:45.527731    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:45.528085 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:45.527788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:45.528085 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:45.527882    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:46.527223 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:46.527190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:46.527396 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:46.527329    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:47.527449 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:47.527414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:47.527951 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:47.527554    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:47.527951 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:47.527608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:47.527951 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:47.527697    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:48.132328 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:48.132289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:48.132512 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:48.132381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:48.132512 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.132465    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:48.132627 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.132533    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:04.132518015 +0000 UTC m=+33.151232945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:09:48.132627 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.132471    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:48.132627 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.132622    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:04.132600166 +0000 UTC m=+33.151315096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:09:48.334214 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:48.334178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:48.334418 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.334345    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:09:48.334418 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.334366    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:09:48.334418 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.334376    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:48.334581 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.334448    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:04.334433829 +0000 UTC m=+33.353148771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:09:48.527247 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:48.527213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:48.527381 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:48.527329    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:49.527031 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:49.526995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:49.527508 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:49.527121    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:49.527508 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:49.527438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:49.527611 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:49.527513    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:50.527847 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:50.527802    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:50.528297 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:50.527959    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:51.528514 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:51.528483    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:51.529036 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:51.528585    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:51.529036 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:51.528646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:51.529036 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:51.528709    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:52.526888 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:52.526857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:52.527072 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:52.526995    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:53.528080 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.527796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:53.528509 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.527847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:53.528509 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:53.528201    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:53.528509 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:53.528265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:53.787922 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.787868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal" event={"ID":"3f7c227f086314e8b066b539e30b1918","Type":"ContainerStarted","Data":"e5b7eac810e56afb5ad38abf5bb7171b00d38a052ce6fcdc5e784c8b6040edc1"}
Jul 07 02:09:53.789773 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.789746    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:09:53.790106 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.790085    2562 generic.go:356] "Generic (PLEG): container finished" podID="0a02b7cc-884e-4087-9222-5a1876bca3d3" containerID="bbf3368bce5bb685e300eb8c9acff9f47c3437721f5eed8a54d85467a1a3b22b" exitCode=1
Jul 07 02:09:53.790179 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.790149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"b41b366169d18040f374718077694c9387fff220c0a62a75bf59201ce1b0ef80"}
Jul 07 02:09:53.790233 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.790221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerDied","Data":"bbf3368bce5bb685e300eb8c9acff9f47c3437721f5eed8a54d85467a1a3b22b"}
Jul 07 02:09:53.790280 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.790268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"165521251f1f7a191b123fdddd5ba311a9792c57382e7a0cfec87d3771988b40"}
Jul 07 02:09:53.791862 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.791832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6nzvk" event={"ID":"2678f7b0-5d56-4982-b6a9-42cbf9d53425","Type":"ContainerStarted","Data":"06af1f9c8335cf3dd4f42a45bb7ed1aeec2f2c99eb6ff9cab3f0017e01cca636"}
Jul 07 02:09:53.797090 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.797068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpmvz" event={"ID":"fbbfda2f-7fe6-4e17-8fd6-4ebd831616dc","Type":"ContainerStarted","Data":"12c859708a0b18bcf174d30187eeda7c8717486679f89328426568c5a2341534"}
Jul 07 02:09:53.812585 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.812544    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6nzvk" podStartSLOduration=2.7638253170000002 podStartE2EDuration="22.812531431s" totalImagesPullingTime="20.048706114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:53.812153702 +0000 UTC m=+22.830868657" watchObservedRunningTime="2026-07-07 02:09:53.812531431 +0000 UTC m=+22.831246383"
Jul 07 02:09:53.825499 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.825459    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-246.ec2.internal" podStartSLOduration=21.825445102 podStartE2EDuration="21.825445102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:53.824977035 +0000 UTC m=+22.843691987" watchObservedRunningTime="2026-07-07 02:09:53.825445102 +0000 UTC m=+22.844160054"
Jul 07 02:09:53.839522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:53.839480    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dpmvz" podStartSLOduration=2.782189326 podStartE2EDuration="22.83946466s" totalImagesPullingTime="20.057275334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:53.839247101 +0000 UTC m=+22.857962054" watchObservedRunningTime="2026-07-07 02:09:53.83946466 +0000 UTC m=+22.858179611"
Jul 07 02:09:54.527628 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.527416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:54.527837 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:54.527720    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:54.800459 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.800372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8j42g" event={"ID":"994816f2-6fef-4ed9-acfd-f129b249e094","Type":"ContainerStarted","Data":"fc7186483abb2026d7ad469643ee29fd917b5a89d48d2a1648856b212df75ea3"}
Jul 07 02:09:54.801818 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.801793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp" event={"ID":"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1","Type":"ContainerStarted","Data":"41a4c44170461e5868ce6dc65a91d50df7f379eee0c677c5a6d2a892c5eea85c"}
Jul 07 02:09:54.803283 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.803259    2562 generic.go:356] "Generic (PLEG): container finished" podID="43d2a0f9bfe83ce86ae7ab2e144d312a" containerID="532dc5ac8baa59be356cf96319db504e059b6c8efc8c2d24bb200baf0a26ac7c" exitCode=0
Jul 07 02:09:54.803368 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.803337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" event={"ID":"43d2a0f9bfe83ce86ae7ab2e144d312a","Type":"ContainerDied","Data":"532dc5ac8baa59be356cf96319db504e059b6c8efc8c2d24bb200baf0a26ac7c"}
Jul 07 02:09:54.806201 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.806185    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:09:54.806538 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.806520    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"216b572a7685cdffb4d1b81c521b1bf795a4aded2c7a7b2fe7f37a63b2be2d8e"}
Jul 07 02:09:54.806612 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.806571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"5b09e92bd9259116db6b868bd499ffdd093ddbb381e477f2d5535dd28ce14b3b"}
Jul 07 02:09:54.806612 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.806604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"42bca4f3f93b7a414d6fe07f84899904ec1161b530f5eadda8d197dc84eea537"}
Jul 07 02:09:54.807953 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.807932    2562 generic.go:356] "Generic (PLEG): container finished" podID="a33e5efb-95d3-4dca-b90d-e6d8f072085c" containerID="f45fec88379c4333065a704c3379e95dd903a86965873c4abf74f3a6a52ffdc9" exitCode=0
Jul 07 02:09:54.808049 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.808010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerDied","Data":"f45fec88379c4333065a704c3379e95dd903a86965873c4abf74f3a6a52ffdc9"}
Jul 07 02:09:54.809472 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.809453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h7jxp" event={"ID":"44f34d15-5852-416f-a7f9-5a0d8ff24990","Type":"ContainerStarted","Data":"90271253bb0900d6be81185d429f2970dd1af3aa2e366cc11ac837c705ca9938"}
Jul 07 02:09:54.810786 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.810767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sq475" event={"ID":"443ab38e-9d9d-4ff0-b3b8-f9eaa5796010","Type":"ContainerStarted","Data":"40dc786c14f978e54f73c47f6eb65cbb36565742328bd7c0a372319b67bda31e"}
Jul 07 02:09:54.812106 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.812086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sfqbq" event={"ID":"0406dd5f-b302-46b9-82b7-5c31d0854612","Type":"ContainerStarted","Data":"cedb4622d552e6462ed1d9fb5dc6bfffd2bddb30c23679379210427c06455cb2"}
Jul 07 02:09:54.813714 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.813677    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8j42g" podStartSLOduration=3.676379084 podStartE2EDuration="23.813664852s" totalImagesPullingTime="20.137285768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:54.813597032 +0000 UTC m=+23.832311984" watchObservedRunningTime="2026-07-07 02:09:54.813664852 +0000 UTC m=+23.832379803"
Jul 07 02:09:54.829587 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.829543    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sfqbq" podStartSLOduration=3.697053803 podStartE2EDuration="23.829530895s" totalImagesPullingTime="20.132477092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:54.828988687 +0000 UTC m=+23.847703650" watchObservedRunningTime="2026-07-07 02:09:54.829530895 +0000 UTC m=+23.848245847"
Jul 07 02:09:54.841214 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.841178    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sq475" podStartSLOduration=3.746593762 podStartE2EDuration="23.841166779s" totalImagesPullingTime="20.094573017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:54.840976114 +0000 UTC m=+23.859691066" watchObservedRunningTime="2026-07-07 02:09:54.841166779 +0000 UTC m=+23.859881732"
Jul 07 02:09:54.895510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:54.895455    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h7jxp" podStartSLOduration=8.336490074 podStartE2EDuration="23.895435747s" totalImagesPullingTime="15.558945673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:54.895082741 +0000 UTC m=+23.913797694" watchObservedRunningTime="2026-07-07 02:09:54.895435747 +0000 UTC m=+23.914150702"
Jul 07 02:09:55.527686 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:55.527659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:55.527843 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:55.527761    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:55.527843 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:55.527791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:55.527843 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:55.527834    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:55.569993 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:55.569966    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 02:09:55.816768 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:55.816685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp" event={"ID":"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1","Type":"ContainerStarted","Data":"af5bb682eb0c48e528fd17a7828688c850b690c71115d7662dd21561edb73553"}
Jul 07 02:09:55.818813 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:55.818781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" event={"ID":"43d2a0f9bfe83ce86ae7ab2e144d312a","Type":"ContainerStarted","Data":"de66400db8313e7ad91bbe9e02556252d0e2392a2525b4fb2040fa100c2f3593"}
Jul 07 02:09:55.832885 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:55.832837    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-246.ec2.internal" podStartSLOduration=23.832823564999998 podStartE2EDuration="23.832823565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:55.832665352 +0000 UTC m=+24.851380303" watchObservedRunningTime="2026-07-07 02:09:55.832823565 +0000 UTC m=+24.851538516"
Jul 07 02:09:56.469759 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.469581    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T02:09:55.56998726Z","UUID":"2aa2648b-603e-4c96-9b8d-fafdddf003ec","Handler":null,"Name":"","Endpoint":""}
Jul 07 02:09:56.471281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.471262    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 02:09:56.471417 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.471300    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 02:09:56.527417 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.527378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:56.527591 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:56.527524    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:56.825556 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.825448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:09:56.826078 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.826059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"6c292fe4fbef5556cb3fb2812ad26d8e6b5674938ce59ab3b62e289408314a5a"}
Jul 07 02:09:56.923346 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.923307    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:56.923946 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:56.923926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:57.526969 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:57.526936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:57.527145 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:57.526940    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:57.527145 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:57.527064    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:57.527145 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:57.527133    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:57.830038 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:57.830001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp" event={"ID":"e2456f04-823a-47d9-aacf-e8dc3c2ed0f1","Type":"ContainerStarted","Data":"cd497944ecd469b3483fa1f7ef3d0ebf13a4a89e523cf7bc371276c1e72e7f58"}
Jul 07 02:09:57.830537 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:57.830236    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:57.830673 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:57.830657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8j42g"
Jul 07 02:09:57.846196 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:57.846150    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mr5rp" podStartSLOduration=3.842407454 podStartE2EDuration="26.846132295s" totalImagesPullingTime="23.003724841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:57.845863315 +0000 UTC m=+26.864578258" watchObservedRunningTime="2026-07-07 02:09:57.846132295 +0000 UTC m=+26.864847248"
Jul 07 02:09:58.527179 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:58.526947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:09:58.527314 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:58.527242    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:09:58.836857 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:58.836778    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:09:58.837645 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:58.837280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"fc389fc748956efe8cadb1821e59838820046d4a7c273bb243a71189fe35732e"}
Jul 07 02:09:58.837920 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:58.837881    2562 scope.go:117] "RemoveContainer" containerID="bbf3368bce5bb685e300eb8c9acff9f47c3437721f5eed8a54d85467a1a3b22b"
Jul 07 02:09:59.527166 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.527122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:09:59.527350 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.527178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:09:59.527350 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:59.527266    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:09:59.527465 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:09:59.527408    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:09:59.844243 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.844170    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:09:59.844675 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.844646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" event={"ID":"0a02b7cc-884e-4087-9222-5a1876bca3d3","Type":"ContainerStarted","Data":"295b0d756be78b9008d9422afcef7130a1dd486ee49f87f40e18ccde32d0de30"}
Jul 07 02:09:59.844823 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.844805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:59.845042 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.845018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:59.845154 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.845120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:59.863494 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.863464    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:59.866123 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.866095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:09:59.871999 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:09:59.871956    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr" podStartSLOduration=8.337249009 podStartE2EDuration="28.871941483s" totalImagesPullingTime="20.534692474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:09:59.87135672 +0000 UTC m=+28.890071671" watchObservedRunningTime="2026-07-07 02:09:59.871941483 +0000 UTC m=+28.890656434"
Jul 07 02:10:00.526983 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.526942    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:00.527193 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:00.527110    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:10:00.622099 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.622066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2mxb"]
Jul 07 02:10:00.622257 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.622168    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:00.622336 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:00.622270    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:10:00.625358 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.625336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7ljb4"]
Jul 07 02:10:00.625443 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.625424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:00.625550 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:00.625513    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:10:00.628496 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.628473    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cv6l6"]
Jul 07 02:10:00.847252 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:00.847184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:00.847625 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:00.847306    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:10:01.850668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:01.850634    2562 generic.go:356] "Generic (PLEG): container finished" podID="a33e5efb-95d3-4dca-b90d-e6d8f072085c" containerID="4ba81a3e61c6be1926bd3e54a616a7731bea7d3aae929b1487cb6d0285941849" exitCode=0
Jul 07 02:10:01.851038 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:01.850726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerDied","Data":"4ba81a3e61c6be1926bd3e54a616a7731bea7d3aae929b1487cb6d0285941849"}
Jul 07 02:10:02.527209 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:02.527172    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:02.527209 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:02.527198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:02.527414 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:02.527199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:02.527414 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:02.527283    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:10:02.527414 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:02.527353    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:10:02.527519 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:02.527423    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:10:03.859443 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:03.859407    2562 generic.go:356] "Generic (PLEG): container finished" podID="a33e5efb-95d3-4dca-b90d-e6d8f072085c" containerID="7f70f25129ddcc44fc36226f5f58238b4aa3c7cbf6c97bbc7dc66556a9ab63d3" exitCode=0
Jul 07 02:10:03.859443 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:03.859445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerDied","Data":"7f70f25129ddcc44fc36226f5f58238b4aa3c7cbf6c97bbc7dc66556a9ab63d3"}
Jul 07 02:10:04.157542 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.157455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:04.157542 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.157497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:04.157737 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.157595    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:10:04.157737 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.157596    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:10:04.157737 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.157656    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:36.157640561 +0000 UTC m=+65.176355495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:10:04.157737 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.157672    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret podName:3483671b-37a1-486b-b6c1-a4783d063235 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:36.157665436 +0000 UTC m=+65.176380366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret") pod "global-pull-secret-syncer-d2mxb" (UID: "3483671b-37a1-486b-b6c1-a4783d063235") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:10:04.359109 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.359079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:04.359270 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.359225    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:10:04.359270 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.359240    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:10:04.359270 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.359249    2562 projected.go:196] Error preparing data for projected volume kube-api-access-h6xpr for pod openshift-network-diagnostics/network-check-target-7ljb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:10:04.359376 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.359318    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr podName:1ee99d53-d729-4bda-b553-943935a60179 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:36.359301355 +0000 UTC m=+65.378016287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xpr" (UniqueName: "kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr") pod "network-check-target-7ljb4" (UID: "1ee99d53-d729-4bda-b553-943935a60179") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:10:04.527405 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.527368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:04.527405 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.527388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:04.527586 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.527483    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:10:04.527586 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.527542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:04.527661 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.527642    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:10:04.527743 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:04.527725    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:10:04.864040 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.863948    2562 generic.go:356] "Generic (PLEG): container finished" podID="a33e5efb-95d3-4dca-b90d-e6d8f072085c" containerID="e5e677b64d7f8d8d2e6a5bf8cc82a490775b00eb01e88033bd1787584db8b86d" exitCode=0
Jul 07 02:10:04.864040 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:04.863997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerDied","Data":"e5e677b64d7f8d8d2e6a5bf8cc82a490775b00eb01e88033bd1787584db8b86d"}
Jul 07 02:10:06.527347 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:06.527310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:06.527967 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:06.527362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:06.527967 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:06.527422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:06.527967 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:06.527442    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ljb4" podUID="1ee99d53-d729-4bda-b553-943935a60179"
Jul 07 02:10:06.527967 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:06.527516    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:10:06.527967 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:06.527590    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2mxb" podUID="3483671b-37a1-486b-b6c1-a4783d063235"
Jul 07 02:10:07.251549 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.251524    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-246.ec2.internal" event="NodeReady"
Jul 07 02:10:07.251770 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.251641    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 02:10:07.284593 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.284562    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77854d5d67-c8prz"]
Jul 07 02:10:07.286731 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.286706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.288449 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.288422    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"]
Jul 07 02:10:07.289346 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.289326    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 02:10:07.289346 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.289336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 02:10:07.290716 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.290673    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"]
Jul 07 02:10:07.290918 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.290874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.292175 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.292155    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 02:10:07.292276 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.292252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2bvdv\""
Jul 07 02:10:07.292648 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.292631    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"]
Jul 07 02:10:07.292770 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.292752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.293534 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.293212    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 02:10:07.293534 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.293331    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 02:10:07.293534 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.293435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 02:10:07.294132 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.294084    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 02:10:07.295747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.294867    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"]
Jul 07 02:10:07.295747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.294995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.295747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.295353    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 02:10:07.296795 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.296776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.297484 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.297465    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 02:10:07.297665 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.297562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 02:10:07.297665 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.297585    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 02:10:07.298495 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.298473    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zfkd5\""
Jul 07 02:10:07.298593 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.298522    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 02:10:07.299162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.298993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 02:10:07.299162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.299062    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 02:10:07.299162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.299087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 02:10:07.299162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.299110    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w67b5\""
Jul 07 02:10:07.308545 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.308439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"]
Jul 07 02:10:07.311690 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.309750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77854d5d67-c8prz"]
Jul 07 02:10:07.311690 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.310715    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"]
Jul 07 02:10:07.312372 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.312353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"]
Jul 07 02:10:07.313082 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.313062    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9f8vz"]
Jul 07 02:10:07.316210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.316190    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"]
Jul 07 02:10:07.316306 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.316229    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ntczb"]
Jul 07 02:10:07.316306 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.316292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.318585 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.318569    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 02:10:07.318681 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.318575    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 02:10:07.319001 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.318981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.319600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.318991    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv6md\""
Jul 07 02:10:07.321687 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.321668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 02:10:07.321786 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.321701    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 02:10:07.321836 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.321787    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 02:10:07.321836 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.321826    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gjz6q\""
Jul 07 02:10:07.326123 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.326103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9f8vz"]
Jul 07 02:10:07.345002 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.344977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ntczb"]
Jul 07 02:10:07.382744 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/329590a6-f9d3-443a-9d8e-6a509bb3aebf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77fb96f88-5zg79\" (UID: \"329590a6-f9d3-443a-9d8e-6a509bb3aebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.382937 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shtcs\" (UniqueName: \"kubernetes.io/projected/329590a6-f9d3-443a-9d8e-6a509bb3aebf-kube-api-access-shtcs\") pod \"managed-serviceaccount-addon-agent-77fb96f88-5zg79\" (UID: \"329590a6-f9d3-443a-9d8e-6a509bb3aebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.382937 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzb8d\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-kube-api-access-zzb8d\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.382937 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e9f3285-fe3f-4770-b71c-fe423920ddc9-tmp\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.382937 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e9f3285-fe3f-4770-b71c-fe423920ddc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.382937 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-ca\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.382937 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22740f-437d-4783-8fff-b67175ef448c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdb5\" (UniqueName: \"kubernetes.io/projected/fb22740f-437d-4783-8fff-b67175ef448c-kube-api-access-7kdb5\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-bound-sa-token\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.382992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-image-registry-private-configuration\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d82621aa-007a-40e9-9dc1-e34b83329a8e-ca-trust-extracted\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-trusted-ca\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-certificates\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.383401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.383401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtn26\" (UniqueName: \"kubernetes.io/projected/3e9f3285-fe3f-4770-b71c-fe423920ddc9-kube-api-access-vtn26\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.383401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-hub\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.383401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-installation-pull-secrets\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.383401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.383261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/983b7a5b-2217-4214-8cd5-9a55c15aad11-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.464768 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.464708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8j42g_994816f2-6fef-4ed9-acfd-f129b249e094/konnectivity-agent/0.log" limit=1024
Jul 07 02:10:07.484337 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-hub\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-installation-pull-secrets\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhz9v\" (UniqueName: \"kubernetes.io/projected/736403bf-f977-403e-b3c0-3193dcf541ed-kube-api-access-nhz9v\") pod \"ingress-canary-ntczb\" (UID: \"736403bf-f977-403e-b3c0-3193dcf541ed\") " pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shtcs\" (UniqueName: \"kubernetes.io/projected/329590a6-f9d3-443a-9d8e-6a509bb3aebf-kube-api-access-shtcs\") pod \"managed-serviceaccount-addon-agent-77fb96f88-5zg79\" (UID: \"329590a6-f9d3-443a-9d8e-6a509bb3aebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzb8d\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-kube-api-access-zzb8d\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.484511    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:07.484522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736403bf-f977-403e-b3c0-3193dcf541ed-cert\") pod \"ingress-canary-ntczb\" (UID: \"736403bf-f977-403e-b3c0-3193dcf541ed\") " pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.484533    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a6ea09-b08a-4157-8a97-fbe49f24585e-config-volume\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22740f-437d-4783-8fff-b67175ef448c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.484620    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:07.984590518 +0000 UTC m=+37.003305448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-image-registry-private-configuration\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-trusted-ca\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e9f3285-fe3f-4770-b71c-fe423920ddc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-ca\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-bound-sa-token\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.484837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/983b7a5b-2217-4214-8cd5-9a55c15aad11-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/329590a6-f9d3-443a-9d8e-6a509bb3aebf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77fb96f88-5zg79\" (UID: \"329590a6-f9d3-443a-9d8e-6a509bb3aebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e9f3285-fe3f-4770-b71c-fe423920ddc9-tmp\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdb5\" (UniqueName: \"kubernetes.io/projected/fb22740f-437d-4783-8fff-b67175ef448c-kube-api-access-7kdb5\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.484975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrhl\" (UniqueName: \"kubernetes.io/projected/f2a6ea09-b08a-4157-8a97-fbe49f24585e-kube-api-access-mzrhl\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d82621aa-007a-40e9-9dc1-e34b83329a8e-ca-trust-extracted\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-certificates\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.485253 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb22740f-437d-4783-8fff-b67175ef448c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.485527 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485411    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d82621aa-007a-40e9-9dc1-e34b83329a8e-ca-trust-extracted\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.485745 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.485710    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-trusted-ca\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.486493 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.486466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e9f3285-fe3f-4770-b71c-fe423920ddc9-tmp\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.486493 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.486471    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/983b7a5b-2217-4214-8cd5-9a55c15aad11-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.486814 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.486537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.486814 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.486575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.486814 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.486602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a6ea09-b08a-4157-8a97-fbe49f24585e-tmp-dir\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.486814 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.486739    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:07.486814 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.486802    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:07.986785295 +0000 UTC m=+37.005500228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:07.487231 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.487206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtn26\" (UniqueName: \"kubernetes.io/projected/3e9f3285-fe3f-4770-b71c-fe423920ddc9-kube-api-access-vtn26\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.487465 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.487442    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-certificates\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.489794 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.489748    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-installation-pull-secrets\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.489923 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.489873    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-hub\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.490225 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.490191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-ca\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.490561 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.490541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.490692 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.490674    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/329590a6-f9d3-443a-9d8e-6a509bb3aebf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77fb96f88-5zg79\" (UID: \"329590a6-f9d3-443a-9d8e-6a509bb3aebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.490745 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.490733    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb22740f-437d-4783-8fff-b67175ef448c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.492202 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.492176    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-image-registry-private-configuration\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.492542 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.492521    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3e9f3285-fe3f-4770-b71c-fe423920ddc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.495088 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.495040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-bound-sa-token\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.495215 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.495201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdb5\" (UniqueName: \"kubernetes.io/projected/fb22740f-437d-4783-8fff-b67175ef448c-kube-api-access-7kdb5\") pod \"cluster-proxy-proxy-agent-58589f844f-q92j9\" (UID: \"fb22740f-437d-4783-8fff-b67175ef448c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.495973 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.495875    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shtcs\" (UniqueName: \"kubernetes.io/projected/329590a6-f9d3-443a-9d8e-6a509bb3aebf-kube-api-access-shtcs\") pod \"managed-serviceaccount-addon-agent-77fb96f88-5zg79\" (UID: \"329590a6-f9d3-443a-9d8e-6a509bb3aebf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.496060 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.495953    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtn26\" (UniqueName: \"kubernetes.io/projected/3e9f3285-fe3f-4770-b71c-fe423920ddc9-kube-api-access-vtn26\") pod \"klusterlet-addon-workmgr-684d5df997-4nfxs\" (UID: \"3e9f3285-fe3f-4770-b71c-fe423920ddc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.496288 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.496271    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzb8d\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-kube-api-access-zzb8d\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.562186 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.562099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8j42g_994816f2-6fef-4ed9-acfd-f129b249e094/konnectivity-agent/0.log" limit=1024
Jul 07 02:10:07.587805 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.587772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a6ea09-b08a-4157-8a97-fbe49f24585e-config-volume\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.587995 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.587844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.587995 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.587875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrhl\" (UniqueName: \"kubernetes.io/projected/f2a6ea09-b08a-4157-8a97-fbe49f24585e-kube-api-access-mzrhl\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.587995 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.587940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a6ea09-b08a-4157-8a97-fbe49f24585e-tmp-dir\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.588160 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.588033    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:07.588160 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.588103    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:08.088080266 +0000 UTC m=+37.106795230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:07.588160 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.588144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhz9v\" (UniqueName: \"kubernetes.io/projected/736403bf-f977-403e-b3c0-3193dcf541ed-kube-api-access-nhz9v\") pod \"ingress-canary-ntczb\" (UID: \"736403bf-f977-403e-b3c0-3193dcf541ed\") " pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.588499 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.588191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736403bf-f977-403e-b3c0-3193dcf541ed-cert\") pod \"ingress-canary-ntczb\" (UID: \"736403bf-f977-403e-b3c0-3193dcf541ed\") " pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.588499 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.588251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a6ea09-b08a-4157-8a97-fbe49f24585e-tmp-dir\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.588499 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.588457    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a6ea09-b08a-4157-8a97-fbe49f24585e-config-volume\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.590664 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.590643    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736403bf-f977-403e-b3c0-3193dcf541ed-cert\") pod \"ingress-canary-ntczb\" (UID: \"736403bf-f977-403e-b3c0-3193dcf541ed\") " pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.596550 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.596530    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhz9v\" (UniqueName: \"kubernetes.io/projected/736403bf-f977-403e-b3c0-3193dcf541ed-kube-api-access-nhz9v\") pod \"ingress-canary-ntczb\" (UID: \"736403bf-f977-403e-b3c0-3193dcf541ed\") " pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.596757 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.596735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrhl\" (UniqueName: \"kubernetes.io/projected/f2a6ea09-b08a-4157-8a97-fbe49f24585e-kube-api-access-mzrhl\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:07.606951 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.606930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:07.638683 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.638651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:10:07.659701 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.659585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:10:07.670210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.669997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ntczb"
Jul 07 02:10:07.786476 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.786251    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"]
Jul 07 02:10:07.810759 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.810736    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"]
Jul 07 02:10:07.814273 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:10:07.814175    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb22740f_437d_4783_8fff_b67175ef448c.slice/crio-2330b603efc6f825feed5f24c7a0f1511afa2cc655bec49c48a67d11ed4fca1b WatchSource:0}: Error finding container 2330b603efc6f825feed5f24c7a0f1511afa2cc655bec49c48a67d11ed4fca1b: Status 404 returned error can't find the container with id 2330b603efc6f825feed5f24c7a0f1511afa2cc655bec49c48a67d11ed4fca1b
Jul 07 02:10:07.820834 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.820811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"]
Jul 07 02:10:07.824787 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:10:07.824764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod329590a6_f9d3_443a_9d8e_6a509bb3aebf.slice/crio-e616d0b62ff744b055d807f1251a7e04f59f08122b1c1128fe5d8b385749775f WatchSource:0}: Error finding container e616d0b62ff744b055d807f1251a7e04f59f08122b1c1128fe5d8b385749775f: Status 404 returned error can't find the container with id e616d0b62ff744b055d807f1251a7e04f59f08122b1c1128fe5d8b385749775f
Jul 07 02:10:07.841134 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.841094    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ntczb"]
Jul 07 02:10:07.844652 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:10:07.844629    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736403bf_f977_403e_b3c0_3193dcf541ed.slice/crio-b21cd2f5df66a279703e879099059fd3143ce98d65a881a31fb69279d881c479 WatchSource:0}: Error finding container b21cd2f5df66a279703e879099059fd3143ce98d65a881a31fb69279d881c479: Status 404 returned error can't find the container with id b21cd2f5df66a279703e879099059fd3143ce98d65a881a31fb69279d881c479
Jul 07 02:10:07.873020 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.872984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ntczb" event={"ID":"736403bf-f977-403e-b3c0-3193dcf541ed","Type":"ContainerStarted","Data":"b21cd2f5df66a279703e879099059fd3143ce98d65a881a31fb69279d881c479"}
Jul 07 02:10:07.874260 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.874230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" event={"ID":"fb22740f-437d-4783-8fff-b67175ef448c","Type":"ContainerStarted","Data":"2330b603efc6f825feed5f24c7a0f1511afa2cc655bec49c48a67d11ed4fca1b"}
Jul 07 02:10:07.875529 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.875502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" event={"ID":"3e9f3285-fe3f-4770-b71c-fe423920ddc9","Type":"ContainerStarted","Data":"b79902ac98a05d004cd5135a47a5dd40a07b7a75627f9fc58e1853194ee263f1"}
Jul 07 02:10:07.876744 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.876725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" event={"ID":"329590a6-f9d3-443a-9d8e-6a509bb3aebf","Type":"ContainerStarted","Data":"e616d0b62ff744b055d807f1251a7e04f59f08122b1c1128fe5d8b385749775f"}
Jul 07 02:10:07.993099 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.993055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:07.993267 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:07.993119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:07.993267 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.993187    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:07.993267 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.993246    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:07.993267 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.993260    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:07.993476 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.993271    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:08.993249812 +0000 UTC m=+38.011964746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:07.993476 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:07.993315    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:08.993298842 +0000 UTC m=+38.012013792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:08.094281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.094194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:08.094424 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:08.094342    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:08.094424 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:08.094408    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:09.094391056 +0000 UTC m=+38.113105987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:08.527013 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.526974    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:08.527202 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.526995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:08.527202 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.527142    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:08.531147 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.531120    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 02:10:08.531278 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.531157    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 02:10:08.531278 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.531129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 02:10:08.531381 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.531366    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 02:10:08.531465 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.531440    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g22vd\""
Jul 07 02:10:08.531912 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:08.531877    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q64zw\""
Jul 07 02:10:09.002464 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:09.002416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:09.002865 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:09.002473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:09.002865 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.002700    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:09.002865 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.002716    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:09.002865 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.002773    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:11.002754883 +0000 UTC m=+40.021469826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:09.003293 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.003275    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:09.003359 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.003332    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:11.003316981 +0000 UTC m=+40.022031925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:09.103397 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:09.103348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:09.103575 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.103557    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:09.103645 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:09.103624    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:11.103604199 +0000 UTC m=+40.122319133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:11.022081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:11.022138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.022342    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.022357    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.022417    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:15.022396436 +0000 UTC m=+44.041111370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.022823    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:11.022922 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.022870    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:15.022856055 +0000 UTC m=+44.041570993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:11.123643 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:11.123456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:11.123823 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.123648    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:11.123823 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:11.123728    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:15.123707449 +0000 UTC m=+44.142422402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:11.573400 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:11.573361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8j42g_994816f2-6fef-4ed9-acfd-f129b249e094/konnectivity-agent/0.log" limit=1024
Jul 07 02:10:11.630281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:11.630244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8j42g_994816f2-6fef-4ed9-acfd-f129b249e094/konnectivity-agent/0.log" limit=1024
Jul 07 02:10:15.058109 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:15.058055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:15.058109 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:15.058114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:15.058637 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.058230    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:15.058637 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.058271    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:15.058637 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.058283    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:15.058637 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.058291    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:23.058275656 +0000 UTC m=+52.076990587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:15.058637 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.058321    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:23.05831046 +0000 UTC m=+52.077025410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:15.159615 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:15.159573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:15.160078 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.159787    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:15.160331 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:15.160309    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:23.160273945 +0000 UTC m=+52.178988886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:16.905629 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:16.905218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" event={"ID":"329590a6-f9d3-443a-9d8e-6a509bb3aebf","Type":"ContainerStarted","Data":"ba52e5636547453a37cc05b7c34c3879f05756a72acc5a50ce8e69e8311ce75a"}
Jul 07 02:10:16.908511 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:16.908476    2562 generic.go:356] "Generic (PLEG): container finished" podID="a33e5efb-95d3-4dca-b90d-e6d8f072085c" containerID="d3699bc34ee91280d910172ea0f3dac4ddd95d9d5eeff62d4ec9f7964e9a225e" exitCode=0
Jul 07 02:10:16.908656 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:16.908581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerDied","Data":"d3699bc34ee91280d910172ea0f3dac4ddd95d9d5eeff62d4ec9f7964e9a225e"}
Jul 07 02:10:16.910224 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:16.910201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ntczb" event={"ID":"736403bf-f977-403e-b3c0-3193dcf541ed","Type":"ContainerStarted","Data":"6e1d42fbd7cd58f228765afc0e17385c17aa555a997309e41a83423e2b9b7381"}
Jul 07 02:10:16.920964 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:16.920918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" podStartSLOduration=21.862816268 podStartE2EDuration="29.920882575s" totalImagesPullingTime="8.058066307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:16.92053833 +0000 UTC m=+45.939253284" watchObservedRunningTime="2026-07-07 02:10:16.920882575 +0000 UTC m=+45.939597521"
Jul 07 02:10:16.936059 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:16.936005    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ntczb" podStartSLOduration=1.897281362 podStartE2EDuration="9.935986227s" totalImagesPullingTime="8.038704865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:16.934015283 +0000 UTC m=+45.952730237" watchObservedRunningTime="2026-07-07 02:10:16.935986227 +0000 UTC m=+45.954701180"
Jul 07 02:10:17.913521 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:17.913490    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" event={"ID":"fb22740f-437d-4783-8fff-b67175ef448c","Type":"ContainerStarted","Data":"498af7781e6b5359d5cc801447f8896c7e09f4c222472d6dd0b61bd7ff1704ac"}
Jul 07 02:10:17.916090 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:17.916064    2562 generic.go:356] "Generic (PLEG): container finished" podID="a33e5efb-95d3-4dca-b90d-e6d8f072085c" containerID="f596edfcb813bc234de2ff6cdbb5f20ff8350552123a4662f20617ea4119879c" exitCode=0
Jul 07 02:10:17.916181 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:17.916120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerDied","Data":"f596edfcb813bc234de2ff6cdbb5f20ff8350552123a4662f20617ea4119879c"}
Jul 07 02:10:18.923112 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.923073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rx725" event={"ID":"a33e5efb-95d3-4dca-b90d-e6d8f072085c","Type":"ContainerStarted","Data":"f1241e025244f58ebd237de54f7d95cffdf1557aa2da25a18b67d54a4640071c"}
Jul 07 02:10:18.925092 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.925066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" event={"ID":"fb22740f-437d-4783-8fff-b67175ef448c","Type":"ContainerStarted","Data":"e878e85ceb002b6d725201d538b728540a1f07a287ebc2dd00f584c3be316be7"}
Jul 07 02:10:18.925206 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.925106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" event={"ID":"fb22740f-437d-4783-8fff-b67175ef448c","Type":"ContainerStarted","Data":"9b081931dda24e0aa83e06f9521bb3c6e8d0e8d574c7866b6cab063b84add247"}
Jul 07 02:10:18.926358 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.926331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" event={"ID":"3e9f3285-fe3f-4770-b71c-fe423920ddc9","Type":"ContainerStarted","Data":"96a094d13d01ab6d97e4a9073cdb1a35c81a4cc036ea82e2abd5c8086a2f2aad"}
Jul 07 02:10:18.926622 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.926609    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:18.928361 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.928343    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:10:18.948435 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.948390    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rx725" podStartSLOduration=8.736051451 podStartE2EDuration="47.948378602s" totalImagesPullingTime="39.212327151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:18.947069658 +0000 UTC m=+47.965784609" watchObservedRunningTime="2026-07-07 02:10:18.948378602 +0000 UTC m=+47.967093554"
Jul 07 02:10:18.964944 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.964881    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" podStartSLOduration=22.189113458 podStartE2EDuration="31.964869659s" totalImagesPullingTime="9.775756201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:18.964489344 +0000 UTC m=+47.983204295" watchObservedRunningTime="2026-07-07 02:10:18.964869659 +0000 UTC m=+47.983584608"
Jul 07 02:10:18.979024 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:18.978976    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" podStartSLOduration=21.8666828 podStartE2EDuration="31.978960547s" totalImagesPullingTime="10.112277747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:18.978857506 +0000 UTC m=+47.997572464" watchObservedRunningTime="2026-07-07 02:10:18.978960547 +0000 UTC m=+47.997675500"
Jul 07 02:10:23.122555 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:23.122526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:23.122973 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:23.122562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:23.122973 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.122681    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:23.122973 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.122694    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:23.122973 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.122704    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:23.122973 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.122740    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:39.122727088 +0000 UTC m=+68.141442031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:23.122973 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.122752    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:10:39.12274597 +0000 UTC m=+68.141460900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:23.223506 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:23.223471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:23.223707 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.223648    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:23.223773 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:23.223745    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:10:39.223723576 +0000 UTC m=+68.242438528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:31.870374 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:31.870344    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fddr"
Jul 07 02:10:36.231098 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.231047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:36.231098 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.231101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:10:36.233580 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.233559    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 02:10:36.233713 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.233698    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 02:10:36.241287 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:36.241268    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:10:36.241364 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:36.241355    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:11:40.241339389 +0000 UTC m=+129.260054319 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : secret "metrics-daemon-secret" not found
Jul 07 02:10:36.244609 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.244591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3483671b-37a1-486b-b6c1-a4783d063235-original-pull-secret\") pod \"global-pull-secret-syncer-d2mxb\" (UID: \"3483671b-37a1-486b-b6c1-a4783d063235\") " pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:36.433143 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.433101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:36.435614 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.435596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 02:10:36.445824 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.445805    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 02:10:36.456270 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.456242    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xpr\" (UniqueName: \"kubernetes.io/projected/1ee99d53-d729-4bda-b553-943935a60179-kube-api-access-h6xpr\") pod \"network-check-target-7ljb4\" (UID: \"1ee99d53-d729-4bda-b553-943935a60179\") " pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:36.459875 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.459841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2mxb"
Jul 07 02:10:36.580809 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.578818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2mxb"]
Jul 07 02:10:36.584421 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:10:36.584397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3483671b_37a1_486b_b6c1_a4783d063235.slice/crio-40aeaea7fed89adbc7716ede6bef41dc0a9e6271d4444661da39d9646b98e01b WatchSource:0}: Error finding container 40aeaea7fed89adbc7716ede6bef41dc0a9e6271d4444661da39d9646b98e01b: Status 404 returned error can't find the container with id 40aeaea7fed89adbc7716ede6bef41dc0a9e6271d4444661da39d9646b98e01b
Jul 07 02:10:36.754651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.754624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g22vd\""
Jul 07 02:10:36.763379 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.763321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:36.884486 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.884457    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7ljb4"]
Jul 07 02:10:36.888409 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:10:36.888386    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee99d53_d729_4bda_b553_943935a60179.slice/crio-323fcfac1be092d0f8e3c56500f60b46459515bfb71df1532f9622048796faed WatchSource:0}: Error finding container 323fcfac1be092d0f8e3c56500f60b46459515bfb71df1532f9622048796faed: Status 404 returned error can't find the container with id 323fcfac1be092d0f8e3c56500f60b46459515bfb71df1532f9622048796faed
Jul 07 02:10:36.981489 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.981452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7ljb4" event={"ID":"1ee99d53-d729-4bda-b553-943935a60179","Type":"ContainerStarted","Data":"323fcfac1be092d0f8e3c56500f60b46459515bfb71df1532f9622048796faed"}
Jul 07 02:10:36.982540 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:36.982511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2mxb" event={"ID":"3483671b-37a1-486b-b6c1-a4783d063235","Type":"ContainerStarted","Data":"40aeaea7fed89adbc7716ede6bef41dc0a9e6271d4444661da39d9646b98e01b"}
Jul 07 02:10:39.155942 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:39.155907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:10:39.155942 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:39.155946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:10:39.156444 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.156087    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:10:39.156444 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.156087    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:10:39.156444 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.156171    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:11:11.156148905 +0000 UTC m=+100.174863841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:10:39.156444 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.156102    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:10:39.156444 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.156225    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:11:11.156213499 +0000 UTC m=+100.174928428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:10:39.256691 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:39.256627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:10:39.256874 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.256794    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:10:39.256874 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:10:39.256859    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:11:11.256844532 +0000 UTC m=+100.275559467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:10:43.002159 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:43.002118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7ljb4" event={"ID":"1ee99d53-d729-4bda-b553-943935a60179","Type":"ContainerStarted","Data":"edb86ede2562d274ad1ac014e57d429522c3b3026c340e9079b48c400dd4b5ee"}
Jul 07 02:10:43.002644 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:43.002210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:10:43.003530 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:43.003498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2mxb" event={"ID":"3483671b-37a1-486b-b6c1-a4783d063235","Type":"ContainerStarted","Data":"2886cc6f5b34914bca70ad53a7d894e03cc5c1ce3ebc2e00d871e615379c56ed"}
Jul 07 02:10:43.017310 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:43.017259    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7ljb4" podStartSLOduration=66.706554728 podStartE2EDuration="1m12.017241433s" totalImagesPullingTime="5.310686705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:43.01639323 +0000 UTC m=+72.035108181" watchObservedRunningTime="2026-07-07 02:10:43.017241433 +0000 UTC m=+72.035956386"
Jul 07 02:10:43.029200 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:10:43.029145    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d2mxb" podStartSLOduration=66.410207909 podStartE2EDuration="1m12.029129952s" totalImagesPullingTime="5.618922043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:10:43.029034711 +0000 UTC m=+72.047749663" watchObservedRunningTime="2026-07-07 02:10:43.029129952 +0000 UTC m=+72.047844904"
Jul 07 02:11:11.203339 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:11:11.203286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:11:11.203339 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:11:11.203339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:11:11.203815 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.203434    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:11:11.203815 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.203448    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:11:11.203815 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.203460    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:11:11.203815 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.203502    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:12:15.203485704 +0000 UTC m=+164.222200634 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:11:11.203815 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.203517    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:12:15.203509582 +0000 UTC m=+164.222224512 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:11:11.304388 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:11:11.304353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:11:11.304542 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.304511    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:11:11.304589 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:11.304578    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:12:15.304554806 +0000 UTC m=+164.323269736 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:11:14.009914 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:11:14.009868    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7ljb4"
Jul 07 02:11:40.322063 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:11:40.319883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:11:40.322063 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:40.320082    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:11:40.322063 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:11:40.320164    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:13:42.320142493 +0000 UTC m=+251.338857423 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : secret "metrics-daemon-secret" not found
Jul 07 02:12:10.300164 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:10.300113    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e"
Jul 07 02:12:10.315267 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:10.315233    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h" podUID="983b7a5b-2217-4214-8cd5-9a55c15aad11"
Jul 07 02:12:10.364461 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:10.364420    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9f8vz" podUID="f2a6ea09-b08a-4157-8a97-fbe49f24585e"
Jul 07 02:12:11.255327 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:11.255293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:12:11.255327 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:11.255293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:12:11.255529 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:11.255307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:12:11.542649 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:11.542568    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:12:15.298070 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:15.298034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:12:15.298070 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:15.298072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:12:15.298488 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.298185    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:12:15.298488 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.298244    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert podName:983b7a5b-2217-4214-8cd5-9a55c15aad11 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:17.29822891 +0000 UTC m=+286.316943840 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5md4h" (UID: "983b7a5b-2217-4214-8cd5-9a55c15aad11") : secret "networking-console-plugin-cert" not found
Jul 07 02:12:15.298488 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.298189    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:12:15.298488 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.298281    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77854d5d67-c8prz: secret "image-registry-tls" not found
Jul 07 02:12:15.298488 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.298322    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls podName:d82621aa-007a-40e9-9dc1-e34b83329a8e nodeName:}" failed. No retries permitted until 2026-07-07 02:14:17.298309551 +0000 UTC m=+286.317024494 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls") pod "image-registry-77854d5d67-c8prz" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e") : secret "image-registry-tls" not found
Jul 07 02:12:15.399192 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:15.399149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:12:15.399428 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.399411    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:12:15.402412 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:12:15.402377    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls podName:f2a6ea09-b08a-4157-8a97-fbe49f24585e nodeName:}" failed. No retries permitted until 2026-07-07 02:14:17.402316855 +0000 UTC m=+286.421031785 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls") pod "dns-default-9f8vz" (UID: "f2a6ea09-b08a-4157-8a97-fbe49f24585e") : secret "dns-default-metrics-tls" not found
Jul 07 02:12:16.272313 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:16.272277    2562 generic.go:356] "Generic (PLEG): container finished" podID="329590a6-f9d3-443a-9d8e-6a509bb3aebf" containerID="ba52e5636547453a37cc05b7c34c3879f05756a72acc5a50ce8e69e8311ce75a" exitCode=255
Jul 07 02:12:16.272475 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:16.272354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" event={"ID":"329590a6-f9d3-443a-9d8e-6a509bb3aebf","Type":"ContainerDied","Data":"ba52e5636547453a37cc05b7c34c3879f05756a72acc5a50ce8e69e8311ce75a"}
Jul 07 02:12:16.272646 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:16.272633    2562 scope.go:117] "RemoveContainer" containerID="ba52e5636547453a37cc05b7c34c3879f05756a72acc5a50ce8e69e8311ce75a"
Jul 07 02:12:17.277301 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:17.277257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" event={"ID":"329590a6-f9d3-443a-9d8e-6a509bb3aebf","Type":"ContainerStarted","Data":"73e66f84177b127570a282978fdf0321466e4d7671d928555eb5b135371a6f40"}
Jul 07 02:12:18.281673 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:18.281639    2562 generic.go:356] "Generic (PLEG): container finished" podID="3e9f3285-fe3f-4770-b71c-fe423920ddc9" containerID="96a094d13d01ab6d97e4a9073cdb1a35c81a4cc036ea82e2abd5c8086a2f2aad" exitCode=1
Jul 07 02:12:18.282053 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:18.281717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" event={"ID":"3e9f3285-fe3f-4770-b71c-fe423920ddc9","Type":"ContainerDied","Data":"96a094d13d01ab6d97e4a9073cdb1a35c81a4cc036ea82e2abd5c8086a2f2aad"}
Jul 07 02:12:18.282113 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:18.282096    2562 scope.go:117] "RemoveContainer" containerID="96a094d13d01ab6d97e4a9073cdb1a35c81a4cc036ea82e2abd5c8086a2f2aad"
Jul 07 02:12:18.927397 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:18.927353    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:12:19.286014 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:19.285975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" event={"ID":"3e9f3285-fe3f-4770-b71c-fe423920ddc9","Type":"ContainerStarted","Data":"6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b"}
Jul 07 02:12:19.286438 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:19.286234    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:12:19.286748 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:19.286733    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:12:24.527459 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:12:24.527384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:13:42.344064 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:13:42.344028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:13:42.344533 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:13:42.344155    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:13:42.344533 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:13:42.344212    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs podName:74996c74-f396-44e7-9ae9-5084d8175756 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:44.344199172 +0000 UTC m=+373.362914102 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs") pod "network-metrics-daemon-cv6l6" (UID: "74996c74-f396-44e7-9ae9-5084d8175756") : secret "metrics-daemon-secret" not found
Jul 07 02:14:03.272140 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.272068    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sskpx"]
Jul 07 02:14:03.274431 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.274410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.276721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.276691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 02:14:03.277086 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.277072    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 02:14:03.277545 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.277529    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cczp7\""
Jul 07 02:14:03.277580 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.277541    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 02:14:03.277580 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.277546    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 02:14:03.285681 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.285660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sskpx"]
Jul 07 02:14:03.392461 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.392430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.392600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.392464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77ltx\" (UniqueName: \"kubernetes.io/projected/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-api-access-77ltx\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.392600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.392498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.392600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.392573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f410f1-ddac-49a4-af52-9ecbc3176a5b-crio-socket\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.392600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.392596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f410f1-ddac-49a4-af52-9ecbc3176a5b-data-volume\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.492961 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.492921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.493124 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.493006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f410f1-ddac-49a4-af52-9ecbc3176a5b-crio-socket\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.493124 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.493026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f410f1-ddac-49a4-af52-9ecbc3176a5b-data-volume\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.493124 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.493055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.493124 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.493078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77ltx\" (UniqueName: \"kubernetes.io/projected/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-api-access-77ltx\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.493124 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.493091    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:03.493338 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.493138    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f410f1-ddac-49a4-af52-9ecbc3176a5b-crio-socket\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.493338 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.493150    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:14:03.493338 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.493178    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:03.993155866 +0000 UTC m=+273.011870809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:03.493338 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.493249    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:03.993232084 +0000 UTC m=+273.011947040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : configmap "kube-rbac-proxy" not found
Jul 07 02:14:03.493560 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.493381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f410f1-ddac-49a4-af52-9ecbc3176a5b-data-volume\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.503089 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.503061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77ltx\" (UniqueName: \"kubernetes.io/projected/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-api-access-77ltx\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.996285 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.996247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.996453 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:03.996312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:03.996453 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.996374    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:14:03.996453 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.996429    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:03.996548 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.996454    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:04.996433095 +0000 UTC m=+274.015148025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : configmap "kube-rbac-proxy" not found
Jul 07 02:14:03.996548 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:03.996473    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:04.996461055 +0000 UTC m=+274.015176008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:05.004477 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:05.004424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:05.004876 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:05.004514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:05.004876 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:05.004554    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:14:05.004876 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:05.004623    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:07.004606259 +0000 UTC m=+276.023321193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : configmap "kube-rbac-proxy" not found
Jul 07 02:14:05.004876 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:05.004655    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:05.004876 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:05.004717    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:07.00469824 +0000 UTC m=+276.023413170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:06.273761 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:06.273738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfqbq_0406dd5f-b302-46b9-82b7-5c31d0854612/dns-node-resolver/0.log"
Jul 07 02:14:07.022524 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:07.022480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:07.022727 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:07.022550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:07.022727 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:07.022608    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:14:07.022727 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:07.022670    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:11.022654616 +0000 UTC m=+280.041369546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : configmap "kube-rbac-proxy" not found
Jul 07 02:14:07.022727 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:07.022677    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:07.022727 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:07.022727    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:11.022711227 +0000 UTC m=+280.041426181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:07.273741 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:07.273665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sq475_443ab38e-9d9d-4ff0-b3b8-f9eaa5796010/node-ca/0.log"
Jul 07 02:14:07.873282 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:07.873254    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntczb_736403bf-f977-403e-b3c0-3193dcf541ed/serve-healthcheck-canary/0.log"
Jul 07 02:14:11.056670 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:11.056631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:11.057095 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:11.056729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:11.057095 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:11.056802    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:14:11.057095 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:11.056801    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:11.057095 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:11.056867    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:19.056852978 +0000 UTC m=+288.075567908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : configmap "kube-rbac-proxy" not found
Jul 07 02:14:11.057095 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:11.056880    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls podName:93f410f1-ddac-49a4-af52-9ecbc3176a5b nodeName:}" failed. No retries permitted until 2026-07-07 02:14:19.056874676 +0000 UTC m=+288.075589605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sskpx" (UID: "93f410f1-ddac-49a4-af52-9ecbc3176a5b") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:14:14.256002 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:14.255957    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9f8vz" podUID="f2a6ea09-b08a-4157-8a97-fbe49f24585e"
Jul 07 02:14:14.256002 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:14.255965    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h" podUID="983b7a5b-2217-4214-8cd5-9a55c15aad11"
Jul 07 02:14:14.256002 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:14.255978    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e"
Jul 07 02:14:14.614578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:14.614502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:14:14.614727 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:14.614509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:14:14.614727 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:14.614509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:14:16.622282 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:16.622250    2562 generic.go:356] "Generic (PLEG): container finished" podID="329590a6-f9d3-443a-9d8e-6a509bb3aebf" containerID="73e66f84177b127570a282978fdf0321466e4d7671d928555eb5b135371a6f40" exitCode=255
Jul 07 02:14:16.622659 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:16.622308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" event={"ID":"329590a6-f9d3-443a-9d8e-6a509bb3aebf","Type":"ContainerDied","Data":"73e66f84177b127570a282978fdf0321466e4d7671d928555eb5b135371a6f40"}
Jul 07 02:14:16.622659 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:16.622353    2562 scope.go:117] "RemoveContainer" containerID="ba52e5636547453a37cc05b7c34c3879f05756a72acc5a50ce8e69e8311ce75a"
Jul 07 02:14:16.622659 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:16.622624    2562 scope.go:117] "RemoveContainer" containerID="73e66f84177b127570a282978fdf0321466e4d7671d928555eb5b135371a6f40"
Jul 07 02:14:16.622807 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:16.622788    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-77fb96f88-5zg79_open-cluster-management-agent-addon(329590a6-f9d3-443a-9d8e-6a509bb3aebf)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" podUID="329590a6-f9d3-443a-9d8e-6a509bb3aebf"
Jul 07 02:14:17.305225 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.305177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:14:17.305225 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.305229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:14:17.307800 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.307772    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/983b7a5b-2217-4214-8cd5-9a55c15aad11-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5md4h\" (UID: \"983b7a5b-2217-4214-8cd5-9a55c15aad11\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:14:17.307929 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.307834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"image-registry-77854d5d67-c8prz\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") " pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:14:17.317708 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.317687    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2bvdv\""
Jul 07 02:14:17.317810 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.317721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zfkd5\""
Jul 07 02:14:17.326358 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.326338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"
Jul 07 02:14:17.326428 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.326364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:14:17.406075 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.406043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:14:17.408281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.408257    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2a6ea09-b08a-4157-8a97-fbe49f24585e-metrics-tls\") pod \"dns-default-9f8vz\" (UID: \"f2a6ea09-b08a-4157-8a97-fbe49f24585e\") " pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:14:17.466217 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.466188    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77854d5d67-c8prz"]
Jul 07 02:14:17.470130 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:14:17.470104    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82621aa_007a_40e9_9dc1_e34b83329a8e.slice/crio-350849485eb2dfc5c0e336d0f6965318d103d36b7e1d26f1e98e91265851783d WatchSource:0}: Error finding container 350849485eb2dfc5c0e336d0f6965318d103d36b7e1d26f1e98e91265851783d: Status 404 returned error can't find the container with id 350849485eb2dfc5c0e336d0f6965318d103d36b7e1d26f1e98e91265851783d
Jul 07 02:14:17.477510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.477484    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5md4h"]
Jul 07 02:14:17.480445 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:14:17.480424    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983b7a5b_2217_4214_8cd5_9a55c15aad11.slice/crio-0133c99805d372c09d39ff1f194e7f85b12ffd25ee6aeb40597fd951d8bcca92 WatchSource:0}: Error finding container 0133c99805d372c09d39ff1f194e7f85b12ffd25ee6aeb40597fd951d8bcca92: Status 404 returned error can't find the container with id 0133c99805d372c09d39ff1f194e7f85b12ffd25ee6aeb40597fd951d8bcca92
Jul 07 02:14:17.617351 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.617277    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tv6md\""
Jul 07 02:14:17.625467 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.625436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:14:17.628743 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.628690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" event={"ID":"d82621aa-007a-40e9-9dc1-e34b83329a8e","Type":"ContainerStarted","Data":"0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd"}
Jul 07 02:14:17.628851 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.628760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" event={"ID":"d82621aa-007a-40e9-9dc1-e34b83329a8e","Type":"ContainerStarted","Data":"350849485eb2dfc5c0e336d0f6965318d103d36b7e1d26f1e98e91265851783d"}
Jul 07 02:14:17.628851 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.628786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:14:17.630275 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.630248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h" event={"ID":"983b7a5b-2217-4214-8cd5-9a55c15aad11","Type":"ContainerStarted","Data":"0133c99805d372c09d39ff1f194e7f85b12ffd25ee6aeb40597fd951d8bcca92"}
Jul 07 02:14:17.650262 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.650207    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" podStartSLOduration=286.650180294 podStartE2EDuration="4m46.650180294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:17.649139841 +0000 UTC m=+286.667854794" watchObservedRunningTime="2026-07-07 02:14:17.650180294 +0000 UTC m=+286.668895247"
Jul 07 02:14:17.660175 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.660146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79"
Jul 07 02:14:17.660496 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.660481    2562 scope.go:117] "RemoveContainer" containerID="73e66f84177b127570a282978fdf0321466e4d7671d928555eb5b135371a6f40"
Jul 07 02:14:17.660651 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:17.660631    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-77fb96f88-5zg79_open-cluster-management-agent-addon(329590a6-f9d3-443a-9d8e-6a509bb3aebf)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" podUID="329590a6-f9d3-443a-9d8e-6a509bb3aebf"
Jul 07 02:14:17.752948 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:17.752917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9f8vz"]
Jul 07 02:14:17.756002 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:14:17.755974    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a6ea09_b08a_4157_8a97_fbe49f24585e.slice/crio-66ac7706276ef27358dedff6f9cf1c3b57b72027e95ed2693c322d28564862e7 WatchSource:0}: Error finding container 66ac7706276ef27358dedff6f9cf1c3b57b72027e95ed2693c322d28564862e7: Status 404 returned error can't find the container with id 66ac7706276ef27358dedff6f9cf1c3b57b72027e95ed2693c322d28564862e7
Jul 07 02:14:18.637674 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:18.637590    2562 generic.go:356] "Generic (PLEG): container finished" podID="3e9f3285-fe3f-4770-b71c-fe423920ddc9" containerID="6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b" exitCode=1
Jul 07 02:14:18.637674 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:18.637612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" event={"ID":"3e9f3285-fe3f-4770-b71c-fe423920ddc9","Type":"ContainerDied","Data":"6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b"}
Jul 07 02:14:18.638185 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:18.637686    2562 scope.go:117] "RemoveContainer" containerID="96a094d13d01ab6d97e4a9073cdb1a35c81a4cc036ea82e2abd5c8086a2f2aad"
Jul 07 02:14:18.638185 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:18.638071    2562 scope.go:117] "RemoveContainer" containerID="6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b"
Jul 07 02:14:18.638305 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:18.638279    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-684d5df997-4nfxs_open-cluster-management-agent-addon(3e9f3285-fe3f-4770-b71c-fe423920ddc9)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" podUID="3e9f3285-fe3f-4770-b71c-fe423920ddc9"
Jul 07 02:14:18.639244 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:18.639127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9f8vz" event={"ID":"f2a6ea09-b08a-4157-8a97-fbe49f24585e","Type":"ContainerStarted","Data":"66ac7706276ef27358dedff6f9cf1c3b57b72027e95ed2693c322d28564862e7"}
Jul 07 02:14:19.119242 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.119207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:19.119430 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.119259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:19.119761 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.119739    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f410f1-ddac-49a4-af52-9ecbc3176a5b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:19.121684 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.121667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f410f1-ddac-49a4-af52-9ecbc3176a5b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sskpx\" (UID: \"93f410f1-ddac-49a4-af52-9ecbc3176a5b\") " pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:19.183496 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.183403    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sskpx"
Jul 07 02:14:19.286428 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.286389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:14:19.311911 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.311866    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sskpx"]
Jul 07 02:14:19.314554 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:14:19.314528    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f410f1_ddac_49a4_af52_9ecbc3176a5b.slice/crio-a8aaeb6f003b8fd1ac0947d65896efa2bd1e216d58194898aca460f73af38561 WatchSource:0}: Error finding container a8aaeb6f003b8fd1ac0947d65896efa2bd1e216d58194898aca460f73af38561: Status 404 returned error can't find the container with id a8aaeb6f003b8fd1ac0947d65896efa2bd1e216d58194898aca460f73af38561
Jul 07 02:14:19.645118 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.645072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sskpx" event={"ID":"93f410f1-ddac-49a4-af52-9ecbc3176a5b","Type":"ContainerStarted","Data":"a8aaeb6f003b8fd1ac0947d65896efa2bd1e216d58194898aca460f73af38561"}
Jul 07 02:14:19.647080 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.647043    2562 scope.go:117] "RemoveContainer" containerID="6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b"
Jul 07 02:14:19.647295 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:19.647268    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-684d5df997-4nfxs_open-cluster-management-agent-addon(3e9f3285-fe3f-4770-b71c-fe423920ddc9)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" podUID="3e9f3285-fe3f-4770-b71c-fe423920ddc9"
Jul 07 02:14:19.648464 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.648439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h" event={"ID":"983b7a5b-2217-4214-8cd5-9a55c15aad11","Type":"ContainerStarted","Data":"5746e19fd8bbe0e94839fcf44c0023cc1a5e05b1d3e3bfe0169596c74fc76b0e"}
Jul 07 02:14:19.679149 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:19.679052    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5md4h" podStartSLOduration=272.279706764 podStartE2EDuration="4m33.679032412s" totalImagesPullingTime="1.399325648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:19.678796798 +0000 UTC m=+288.697511750" watchObservedRunningTime="2026-07-07 02:14:19.679032412 +0000 UTC m=+288.697747368"
Jul 07 02:14:20.654153 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:20.654110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9f8vz" event={"ID":"f2a6ea09-b08a-4157-8a97-fbe49f24585e","Type":"ContainerStarted","Data":"366d8759729c5afbd8f75791888dea598e9864fda78bac1067ee157f830970d3"}
Jul 07 02:14:20.654553 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:20.654213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9f8vz" event={"ID":"f2a6ea09-b08a-4157-8a97-fbe49f24585e","Type":"ContainerStarted","Data":"1fdaae6fcf123cb1b762f325cf64a93f1a97943e369f8b340c5590f248ad712f"}
Jul 07 02:14:20.672000 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:20.671938    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9f8vz" podStartSLOduration=251.578519812 podStartE2EDuration="4m13.671921879s" totalImagesPullingTime="2.093402067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:20.669848102 +0000 UTC m=+289.688563054" watchObservedRunningTime="2026-07-07 02:14:20.671921879 +0000 UTC m=+289.690637087"
Jul 07 02:14:21.658842 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:21.658809    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:14:23.665748 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:23.665712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sskpx" event={"ID":"93f410f1-ddac-49a4-af52-9ecbc3176a5b","Type":"ContainerStarted","Data":"10f1e1520974f0b4e70d27305ee9563e4614a476e61e371e087bd96601419775"}
Jul 07 02:14:24.671957 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:24.671917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sskpx" event={"ID":"93f410f1-ddac-49a4-af52-9ecbc3176a5b","Type":"ContainerStarted","Data":"b3fd135a299760a47c81460a91a4f51d315673582417604afa03f2166eeed923"}
Jul 07 02:14:26.680347 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:26.680318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sskpx" event={"ID":"93f410f1-ddac-49a4-af52-9ecbc3176a5b","Type":"ContainerStarted","Data":"0702a22e51fb931c46a05e91ee4101cad3df065e1cea233db983942760746993"}
Jul 07 02:14:26.700683 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:26.700644    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sskpx" podStartSLOduration=16.537544079 podStartE2EDuration="23.700631453s" totalImagesPullingTime="7.163087374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:26.699753876 +0000 UTC m=+295.718468827" watchObservedRunningTime="2026-07-07 02:14:26.700631453 +0000 UTC m=+295.719346405"
Jul 07 02:14:27.528256 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:27.528205    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cv6l6" podUID="74996c74-f396-44e7-9ae9-5084d8175756"
Jul 07 02:14:27.607308 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:27.607273    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:14:27.607616 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:27.607603    2562 scope.go:117] "RemoveContainer" containerID="6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b"
Jul 07 02:14:27.607760 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:14:27.607743    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-684d5df997-4nfxs_open-cluster-management-agent-addon(3e9f3285-fe3f-4770-b71c-fe423920ddc9)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" podUID="3e9f3285-fe3f-4770-b71c-fe423920ddc9"
Jul 07 02:14:29.527473 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:29.527440    2562 scope.go:117] "RemoveContainer" containerID="73e66f84177b127570a282978fdf0321466e4d7671d928555eb5b135371a6f40"
Jul 07 02:14:29.691622 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:29.691587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fb96f88-5zg79" event={"ID":"329590a6-f9d3-443a-9d8e-6a509bb3aebf","Type":"ContainerStarted","Data":"68b0b85b0a0c554272eb9baa79f9a3e2e892c7de45dac67d3df6b1b8c156228b"}
Jul 07 02:14:31.401007 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:31.400977    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:14:31.402041 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:31.402021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:14:31.407347 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:31.407327    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 02:14:31.663570 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:31.663492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9f8vz"
Jul 07 02:14:37.330451 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:37.330416    2562 patch_prober.go:28] interesting pod/image-registry-77854d5d67-c8prz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 02:14:37.330830 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:37.330470    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:14:37.640311 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:37.640232    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" podUID="fb22740f-437d-4783-8fff-b67175ef448c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 02:14:38.643435 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:38.643403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:14:39.527235 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:39.527198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:14:41.528585 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.528550    2562 scope.go:117] "RemoveContainer" containerID="6474dc9a5c8db91de62d4a5352c0d54caae2b0522aea4ed42c2b32405467b68b"
Jul 07 02:14:41.598209 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.598183    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9k78d"]
Jul 07 02:14:41.600321 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.600306    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.602793 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.602772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 02:14:41.602910 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.602874    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 02:14:41.603000 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.602943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m6bjf\""
Jul 07 02:14:41.603000 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.602953    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 02:14:41.603520 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.603501    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 02:14:41.603691 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.603521    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 02:14:41.603691 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.603521    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 02:14:41.731971 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.731935    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs" event={"ID":"3e9f3285-fe3f-4770-b71c-fe423920ddc9","Type":"ContainerStarted","Data":"fddd08e564eea1df692d3f06a139f0d843c355ad20a83794c8e3cf224713ef40"}
Jul 07 02:14:41.732209 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.732180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:14:41.733872 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.733853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684d5df997-4nfxs"
Jul 07 02:14:41.797495 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-wtmp\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797495 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797495 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-textfile\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797739 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-root\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797739 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaf9a7-7315-48cc-a276-32bde04af219-metrics-client-ca\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797739 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797889 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz6n6\" (UniqueName: \"kubernetes.io/projected/0aaaf9a7-7315-48cc-a276-32bde04af219-kube-api-access-rz6n6\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797889 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-sys\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.797889 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.797829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-tls\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898111 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-wtmp\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-textfile\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-root\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaf9a7-7315-48cc-a276-32bde04af219-metrics-client-ca\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898263    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-wtmp\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898281 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6n6\" (UniqueName: \"kubernetes.io/projected/0aaaf9a7-7315-48cc-a276-32bde04af219-kube-api-access-rz6n6\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-sys\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-tls\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-sys\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0aaaf9a7-7315-48cc-a276-32bde04af219-root\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.898721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.898545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-textfile\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.899115 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.899069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aaaf9a7-7315-48cc-a276-32bde04af219-metrics-client-ca\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.899304 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.899160    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.901596 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.901575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-tls\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.901680 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.901572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aaaf9a7-7315-48cc-a276-32bde04af219-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.906363 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.906336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6n6\" (UniqueName: \"kubernetes.io/projected/0aaaf9a7-7315-48cc-a276-32bde04af219-kube-api-access-rz6n6\") pod \"node-exporter-9k78d\" (UID: \"0aaaf9a7-7315-48cc-a276-32bde04af219\") " pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.909165 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.909146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k78d"
Jul 07 02:14:41.919710 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:14:41.919685    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aaaf9a7_7315_48cc_a276_32bde04af219.slice/crio-6ad70384b9938cd99cbe9aba924bf4e1c7c13b1215258c976f9f9b867e9e57d4 WatchSource:0}: Error finding container 6ad70384b9938cd99cbe9aba924bf4e1c7c13b1215258c976f9f9b867e9e57d4: Status 404 returned error can't find the container with id 6ad70384b9938cd99cbe9aba924bf4e1c7c13b1215258c976f9f9b867e9e57d4
Jul 07 02:14:41.921586 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:41.921567    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:14:42.737839 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:42.737801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k78d" event={"ID":"0aaaf9a7-7315-48cc-a276-32bde04af219","Type":"ContainerStarted","Data":"6ad70384b9938cd99cbe9aba924bf4e1c7c13b1215258c976f9f9b867e9e57d4"}
Jul 07 02:14:43.742916 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:43.742851    2562 generic.go:356] "Generic (PLEG): container finished" podID="0aaaf9a7-7315-48cc-a276-32bde04af219" containerID="2667fc1086234d2cbb42a08fc254074d8a4f5bd6befb391cda9fdc23a2504713" exitCode=0
Jul 07 02:14:43.743416 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:43.742946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k78d" event={"ID":"0aaaf9a7-7315-48cc-a276-32bde04af219","Type":"ContainerDied","Data":"2667fc1086234d2cbb42a08fc254074d8a4f5bd6befb391cda9fdc23a2504713"}
Jul 07 02:14:44.747944 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:44.747883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k78d" event={"ID":"0aaaf9a7-7315-48cc-a276-32bde04af219","Type":"ContainerStarted","Data":"78598e2db90322954826e0918b4ceaea289d2cb96322b288402a881b4fc916bb"}
Jul 07 02:14:44.748328 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:44.747967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k78d" event={"ID":"0aaaf9a7-7315-48cc-a276-32bde04af219","Type":"ContainerStarted","Data":"e66268144dfe90668878686c88cf8defd93e51bcab0f0d2c2479d2da3d403d13"}
Jul 07 02:14:44.769023 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:44.768975    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9k78d" podStartSLOduration=2.6399540950000002 podStartE2EDuration="3.768960159s" totalImagesPullingTime="1.056950822s" totalInitContainerRuntime="72.055242ms" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:14:44.768306768 +0000 UTC m=+313.787021719" watchObservedRunningTime="2026-07-07 02:14:44.768960159 +0000 UTC m=+313.787675111"
Jul 07 02:14:47.639873 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:47.639838    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" podUID="fb22740f-437d-4783-8fff-b67175ef448c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 02:14:49.741842 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:49.741809    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77854d5d67-c8prz"]
Jul 07 02:14:57.640498 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:57.640456    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" podUID="fb22740f-437d-4783-8fff-b67175ef448c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 02:14:57.640883 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:57.640524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9"
Jul 07 02:14:57.641048 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:57.641018    2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e878e85ceb002b6d725201d538b728540a1f07a287ebc2dd00f584c3be316be7"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 07 02:14:57.641088 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:57.641068    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" podUID="fb22740f-437d-4783-8fff-b67175ef448c" containerName="service-proxy" containerID="cri-o://e878e85ceb002b6d725201d538b728540a1f07a287ebc2dd00f584c3be316be7" gracePeriod=30
Jul 07 02:14:57.795437 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:57.795409    2562 generic.go:356] "Generic (PLEG): container finished" podID="fb22740f-437d-4783-8fff-b67175ef448c" containerID="e878e85ceb002b6d725201d538b728540a1f07a287ebc2dd00f584c3be316be7" exitCode=2
Jul 07 02:14:57.795530 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:57.795489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" event={"ID":"fb22740f-437d-4783-8fff-b67175ef448c","Type":"ContainerDied","Data":"e878e85ceb002b6d725201d538b728540a1f07a287ebc2dd00f584c3be316be7"}
Jul 07 02:14:58.801179 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:14:58.801143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58589f844f-q92j9" event={"ID":"fb22740f-437d-4783-8fff-b67175ef448c","Type":"ContainerStarted","Data":"f59e2fa89d951acd14d565d6c9f0cfdf2f6e1c64435522fe08dcd28923af9da5"}
Jul 07 02:15:14.768639 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:14.768581    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e" containerName="registry" containerID="cri-o://0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd" gracePeriod=30
Jul 07 02:15:15.008238 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.008211    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:15:15.139433 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139352    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-installation-pull-secrets\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139433 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-trusted-ca\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139433 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139430    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-certificates\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139720 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139452    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzb8d\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-kube-api-access-zzb8d\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139720 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139484    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-bound-sa-token\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139720 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d82621aa-007a-40e9-9dc1-e34b83329a8e-ca-trust-extracted\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139720 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139523    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.139720 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139555    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-image-registry-private-configuration\") pod \"d82621aa-007a-40e9-9dc1-e34b83329a8e\" (UID: \"d82621aa-007a-40e9-9dc1-e34b83329a8e\") "
Jul 07 02:15:15.140001 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.139940    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:15:15.140055 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.140022    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:15:15.142073 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.141996    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:15:15.142441 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.142406    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:15:15.142441 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.142427    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:15:15.142580 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.142455    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:15:15.142580 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.142467    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-kube-api-access-zzb8d" (OuterVolumeSpecName: "kube-api-access-zzb8d") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "kube-api-access-zzb8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:15:15.148137 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.148111    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d82621aa-007a-40e9-9dc1-e34b83329a8e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d82621aa-007a-40e9-9dc1-e34b83329a8e" (UID: "d82621aa-007a-40e9-9dc1-e34b83329a8e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:15:15.240010 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.239975    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-certificates\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240010 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240005    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzb8d\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-kube-api-access-zzb8d\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240010 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240015    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-bound-sa-token\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240024    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d82621aa-007a-40e9-9dc1-e34b83329a8e-ca-trust-extracted\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240032    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d82621aa-007a-40e9-9dc1-e34b83329a8e-registry-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240041    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-image-registry-private-configuration\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240050    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d82621aa-007a-40e9-9dc1-e34b83329a8e-installation-pull-secrets\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.240210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.240058    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d82621aa-007a-40e9-9dc1-e34b83329a8e-trusted-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:15:15.857830 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.857737    2562 generic.go:356] "Generic (PLEG): container finished" podID="d82621aa-007a-40e9-9dc1-e34b83329a8e" containerID="0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd" exitCode=0
Jul 07 02:15:15.857830 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.857789    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77854d5d67-c8prz"
Jul 07 02:15:15.857830 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.857816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" event={"ID":"d82621aa-007a-40e9-9dc1-e34b83329a8e","Type":"ContainerDied","Data":"0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd"}
Jul 07 02:15:15.858438 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.857865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77854d5d67-c8prz" event={"ID":"d82621aa-007a-40e9-9dc1-e34b83329a8e","Type":"ContainerDied","Data":"350849485eb2dfc5c0e336d0f6965318d103d36b7e1d26f1e98e91265851783d"}
Jul 07 02:15:15.858438 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.857890    2562 scope.go:117] "RemoveContainer" containerID="0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd"
Jul 07 02:15:15.865790 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.865771    2562 scope.go:117] "RemoveContainer" containerID="0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd"
Jul 07 02:15:15.866081 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:15:15.866060    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd\": container with ID starting with 0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd not found: ID does not exist" containerID="0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd"
Jul 07 02:15:15.866134 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.866088    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd"} err="failed to get container status \"0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd\": rpc error: code = NotFound desc = could not find container \"0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd\": container with ID starting with 0236eec3c1a81ceb31fa502b5df7e4f1a4f975a15356c57d04c7762f9c41ebfd not found: ID does not exist"
Jul 07 02:15:15.882396 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.882373    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77854d5d67-c8prz"]
Jul 07 02:15:15.889218 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:15.889199    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77854d5d67-c8prz"]
Jul 07 02:15:17.531159 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:17.531121    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e" path="/var/lib/kubelet/pods/d82621aa-007a-40e9-9dc1-e34b83329a8e/volumes"
Jul 07 02:15:28.692175 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:28.692102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntczb_736403bf-f977-403e-b3c0-3193dcf541ed/serve-healthcheck-canary/0.log"
Jul 07 02:15:44.346794 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:44.346751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:15:44.349263 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:44.349228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74996c74-f396-44e7-9ae9-5084d8175756-metrics-certs\") pod \"network-metrics-daemon-cv6l6\" (UID: \"74996c74-f396-44e7-9ae9-5084d8175756\") " pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:15:44.630036 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:44.629959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q64zw\""
Jul 07 02:15:44.638758 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:44.638738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cv6l6"
Jul 07 02:15:44.787121 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:44.787088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cv6l6"]
Jul 07 02:15:44.790714 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:15:44.790685    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74996c74_f396_44e7_9ae9_5084d8175756.slice/crio-6784211ffb5864acaa572c248238640511ae4f54dc4960d15e00017e52424920 WatchSource:0}: Error finding container 6784211ffb5864acaa572c248238640511ae4f54dc4960d15e00017e52424920: Status 404 returned error can't find the container with id 6784211ffb5864acaa572c248238640511ae4f54dc4960d15e00017e52424920
Jul 07 02:15:44.954570 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:44.954540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cv6l6" event={"ID":"74996c74-f396-44e7-9ae9-5084d8175756","Type":"ContainerStarted","Data":"6784211ffb5864acaa572c248238640511ae4f54dc4960d15e00017e52424920"}
Jul 07 02:15:46.966767 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:46.966722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cv6l6" event={"ID":"74996c74-f396-44e7-9ae9-5084d8175756","Type":"ContainerStarted","Data":"13d28da6f1bdc136e215f6077d3b32ad1b214becd8aedee863610ee1a59d3dd0"}
Jul 07 02:15:46.967181 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:46.966782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cv6l6" event={"ID":"74996c74-f396-44e7-9ae9-5084d8175756","Type":"ContainerStarted","Data":"412cbbd16333e4f6901efb885492b9918a51e926eeda11fda87d24f46da0cbf7"}
Jul 07 02:15:46.982640 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:15:46.982586    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cv6l6" podStartSLOduration=374.644394062 podStartE2EDuration="6m15.98257138s" totalImagesPullingTime="1.338177318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:46.981087074 +0000 UTC m=+375.999802025" watchObservedRunningTime="2026-07-07 02:15:46.98257138 +0000 UTC m=+376.001286326"
Jul 07 02:17:34.001422 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.001388    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9ct42"]
Jul 07 02:17:34.001869 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.001633    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e" containerName="registry"
Jul 07 02:17:34.001869 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.001644    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e" containerName="registry"
Jul 07 02:17:34.001869 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.001709    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d82621aa-007a-40e9-9dc1-e34b83329a8e" containerName="registry"
Jul 07 02:17:34.004283 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.004268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.006609 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.006579    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 02:17:34.006609 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.006596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 02:17:34.006789 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.006622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d74lt\""
Jul 07 02:17:34.014126 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.014107    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9ct42"]
Jul 07 02:17:34.095054 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.095018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/940d686b-55ab-416e-8427-ae1d01c2f64a-bound-sa-token\") pod \"cert-manager-55b4d954d5-9ct42\" (UID: \"940d686b-55ab-416e-8427-ae1d01c2f64a\") " pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.095155 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.095080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmfx\" (UniqueName: \"kubernetes.io/projected/940d686b-55ab-416e-8427-ae1d01c2f64a-kube-api-access-rhmfx\") pod \"cert-manager-55b4d954d5-9ct42\" (UID: \"940d686b-55ab-416e-8427-ae1d01c2f64a\") " pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.196332 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.196300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/940d686b-55ab-416e-8427-ae1d01c2f64a-bound-sa-token\") pod \"cert-manager-55b4d954d5-9ct42\" (UID: \"940d686b-55ab-416e-8427-ae1d01c2f64a\") " pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.196496 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.196358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmfx\" (UniqueName: \"kubernetes.io/projected/940d686b-55ab-416e-8427-ae1d01c2f64a-kube-api-access-rhmfx\") pod \"cert-manager-55b4d954d5-9ct42\" (UID: \"940d686b-55ab-416e-8427-ae1d01c2f64a\") " pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.204668 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.204644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/940d686b-55ab-416e-8427-ae1d01c2f64a-bound-sa-token\") pod \"cert-manager-55b4d954d5-9ct42\" (UID: \"940d686b-55ab-416e-8427-ae1d01c2f64a\") " pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.204786 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.204736    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmfx\" (UniqueName: \"kubernetes.io/projected/940d686b-55ab-416e-8427-ae1d01c2f64a-kube-api-access-rhmfx\") pod \"cert-manager-55b4d954d5-9ct42\" (UID: \"940d686b-55ab-416e-8427-ae1d01c2f64a\") " pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.313153 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.313083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9ct42"
Jul 07 02:17:34.438975 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:34.438941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9ct42"]
Jul 07 02:17:34.442051 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:17:34.442013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod940d686b_55ab_416e_8427_ae1d01c2f64a.slice/crio-4a6738b1ec0afde5af34acb1ceac4161853c8be035ecc71db2696c95bbb7622f WatchSource:0}: Error finding container 4a6738b1ec0afde5af34acb1ceac4161853c8be035ecc71db2696c95bbb7622f: Status 404 returned error can't find the container with id 4a6738b1ec0afde5af34acb1ceac4161853c8be035ecc71db2696c95bbb7622f
Jul 07 02:17:35.317020 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:35.316960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9ct42" event={"ID":"940d686b-55ab-416e-8427-ae1d01c2f64a","Type":"ContainerStarted","Data":"4a6738b1ec0afde5af34acb1ceac4161853c8be035ecc71db2696c95bbb7622f"}
Jul 07 02:17:38.329830 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:38.329789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9ct42" event={"ID":"940d686b-55ab-416e-8427-ae1d01c2f64a","Type":"ContainerStarted","Data":"3b47caed568a3cdf99c2bb9e242ad4cf4816101c2ae54d7328ff7fb098147636"}
Jul 07 02:17:38.345481 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:38.345381    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9ct42" podStartSLOduration=1.7054286730000001 podStartE2EDuration="5.34536579s" totalImagesPullingTime="3.639937117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:38.343990918 +0000 UTC m=+487.362705871" watchObservedRunningTime="2026-07-07 02:17:38.34536579 +0000 UTC m=+487.364080742"
Jul 07 02:17:39.874626 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.874597    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"]
Jul 07 02:17:39.877517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.877502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:39.879714 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.879694    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:17:39.879851 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.879833    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 02:17:39.880688 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.880661    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wrvl4\""
Jul 07 02:17:39.885929 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.885887    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"]
Jul 07 02:17:39.941219 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.941188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a478aeaf-ed7f-4cf5-8147-63e9e012270a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xknb6\" (UID: \"a478aeaf-ed7f-4cf5-8147-63e9e012270a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:39.941380 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:39.941235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djght\" (UniqueName: \"kubernetes.io/projected/a478aeaf-ed7f-4cf5-8147-63e9e012270a-kube-api-access-djght\") pod \"openshift-lws-operator-fd8ccff4c-xknb6\" (UID: \"a478aeaf-ed7f-4cf5-8147-63e9e012270a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:40.041794 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.041761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djght\" (UniqueName: \"kubernetes.io/projected/a478aeaf-ed7f-4cf5-8147-63e9e012270a-kube-api-access-djght\") pod \"openshift-lws-operator-fd8ccff4c-xknb6\" (UID: \"a478aeaf-ed7f-4cf5-8147-63e9e012270a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:40.041978 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.041813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a478aeaf-ed7f-4cf5-8147-63e9e012270a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xknb6\" (UID: \"a478aeaf-ed7f-4cf5-8147-63e9e012270a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:40.042173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.042155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a478aeaf-ed7f-4cf5-8147-63e9e012270a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xknb6\" (UID: \"a478aeaf-ed7f-4cf5-8147-63e9e012270a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:40.050039 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.050015    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djght\" (UniqueName: \"kubernetes.io/projected/a478aeaf-ed7f-4cf5-8147-63e9e012270a-kube-api-access-djght\") pod \"openshift-lws-operator-fd8ccff4c-xknb6\" (UID: \"a478aeaf-ed7f-4cf5-8147-63e9e012270a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:40.186938 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.186832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"
Jul 07 02:17:40.311045 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.310882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6"]
Jul 07 02:17:40.313460 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:17:40.313437    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda478aeaf_ed7f_4cf5_8147_63e9e012270a.slice/crio-49ff9efe4dfc083b76caaa2f91118990599001b1c1e245aad84a90954ecbb262 WatchSource:0}: Error finding container 49ff9efe4dfc083b76caaa2f91118990599001b1c1e245aad84a90954ecbb262: Status 404 returned error can't find the container with id 49ff9efe4dfc083b76caaa2f91118990599001b1c1e245aad84a90954ecbb262
Jul 07 02:17:40.338396 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:40.338366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6" event={"ID":"a478aeaf-ed7f-4cf5-8147-63e9e012270a","Type":"ContainerStarted","Data":"49ff9efe4dfc083b76caaa2f91118990599001b1c1e245aad84a90954ecbb262"}
Jul 07 02:17:43.351175 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:43.351130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6" event={"ID":"a478aeaf-ed7f-4cf5-8147-63e9e012270a","Type":"ContainerStarted","Data":"64d6b6dbf4e3423e3ee62c54303f80cf0f292b6a3a4ef34ab6f4ad82b4c0bc73"}
Jul 07 02:17:43.367938 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:43.367859    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xknb6" podStartSLOduration=1.897752426 podStartE2EDuration="4.367839872s" totalImagesPullingTime="2.470087446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:17:43.367129896 +0000 UTC m=+492.385844849" watchObservedRunningTime="2026-07-07 02:17:43.367839872 +0000 UTC m=+492.386554828"
Jul 07 02:17:59.777823 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.777789    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"]
Jul 07 02:17:59.781353 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.781336    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.784147 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.784123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 02:17:59.784770 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.784740    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6ghdc\""
Jul 07 02:17:59.784855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.784810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 02:17:59.784855 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.784842    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 02:17:59.785350 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.785335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 02:17:59.796868 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.796845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"]
Jul 07 02:17:59.885788 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.885753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f838223-4920-4b93-b0a6-e5e82e70f358-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.885962 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.885797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zh8p\" (UniqueName: \"kubernetes.io/projected/3f838223-4920-4b93-b0a6-e5e82e70f358-kube-api-access-5zh8p\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.885962 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.885845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f838223-4920-4b93-b0a6-e5e82e70f358-webhook-cert\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.885962 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.885877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f838223-4920-4b93-b0a6-e5e82e70f358-manifests\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.886084 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.885976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f838223-4920-4b93-b0a6-e5e82e70f358-tmp\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.987183 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.987144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f838223-4920-4b93-b0a6-e5e82e70f358-tmp\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.987366 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.987189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f838223-4920-4b93-b0a6-e5e82e70f358-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.987366 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.987224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zh8p\" (UniqueName: \"kubernetes.io/projected/3f838223-4920-4b93-b0a6-e5e82e70f358-kube-api-access-5zh8p\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.987366 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.987247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f838223-4920-4b93-b0a6-e5e82e70f358-webhook-cert\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.987366 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.987270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f838223-4920-4b93-b0a6-e5e82e70f358-manifests\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.987721 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.987687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f838223-4920-4b93-b0a6-e5e82e70f358-manifests\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.989506 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.989481    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f838223-4920-4b93-b0a6-e5e82e70f358-tmp\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.989709 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.989691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f838223-4920-4b93-b0a6-e5e82e70f358-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.989761 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.989744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f838223-4920-4b93-b0a6-e5e82e70f358-webhook-cert\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:17:59.999371 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:17:59.999350    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zh8p\" (UniqueName: \"kubernetes.io/projected/3f838223-4920-4b93-b0a6-e5e82e70f358-kube-api-access-5zh8p\") pod \"opendatahub-operator-controller-manager-76797ccd4c-p5g9b\" (UID: \"3f838223-4920-4b93-b0a6-e5e82e70f358\") " pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:18:00.091468 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:00.091385    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:18:00.231116 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:00.231093    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"]
Jul 07 02:18:00.233691 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:18:00.233655    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f838223_4920_4b93_b0a6_e5e82e70f358.slice/crio-3fc66fcd29d9e94086e8dcd7416005b19c0034febac7a9468966471182c4610b WatchSource:0}: Error finding container 3fc66fcd29d9e94086e8dcd7416005b19c0034febac7a9468966471182c4610b: Status 404 returned error can't find the container with id 3fc66fcd29d9e94086e8dcd7416005b19c0034febac7a9468966471182c4610b
Jul 07 02:18:00.415817 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:00.415729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b" event={"ID":"3f838223-4920-4b93-b0a6-e5e82e70f358","Type":"ContainerStarted","Data":"3fc66fcd29d9e94086e8dcd7416005b19c0034febac7a9468966471182c4610b"}
Jul 07 02:18:04.436027 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:04.435983    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b" event={"ID":"3f838223-4920-4b93-b0a6-e5e82e70f358","Type":"ContainerStarted","Data":"149ff44fa70178a341aaa8320850e7405f52df7024213a98b4c4bd03a89d1bf6"}
Jul 07 02:18:05.440614 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:05.440569    2562 generic.go:356] "Generic (PLEG): container finished" podID="3f838223-4920-4b93-b0a6-e5e82e70f358" containerID="149ff44fa70178a341aaa8320850e7405f52df7024213a98b4c4bd03a89d1bf6" exitCode=0
Jul 07 02:18:05.441058 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:05.440659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b" event={"ID":"3f838223-4920-4b93-b0a6-e5e82e70f358","Type":"ContainerDied","Data":"149ff44fa70178a341aaa8320850e7405f52df7024213a98b4c4bd03a89d1bf6"}
Jul 07 02:18:06.446530 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:06.446439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b" event={"ID":"3f838223-4920-4b93-b0a6-e5e82e70f358","Type":"ContainerStarted","Data":"f70d885f8c438cb80651f1fd0b16944a17526fd8999a2ecc3bc9ec38ac9d4481"}
Jul 07 02:18:06.446983 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:06.446576    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:18:06.468193 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:06.468150    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b" podStartSLOduration=2.392344329 podStartE2EDuration="7.468137864s" totalImagesPullingTime="4.000336868s" totalInitContainerRuntime="1.075456667s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:17:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:06.466942064 +0000 UTC m=+515.485657013" watchObservedRunningTime="2026-07-07 02:18:06.468137864 +0000 UTC m=+515.486852816"
Jul 07 02:18:17.452647 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:17.452617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76797ccd4c-p5g9b"
Jul 07 02:18:19.866812 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:19.866782    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbtbr"]
Jul 07 02:18:19.872502 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:19.872484    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:19.874797 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:19.874775    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 02:18:19.874938 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:19.874826    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8mg6x\""
Jul 07 02:18:19.880611 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:19.880586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbtbr"]
Jul 07 02:18:20.037451 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.037415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnt7h\" (UniqueName: \"kubernetes.io/projected/2429e661-c24b-4363-8922-8347814f6778-kube-api-access-gnt7h\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.037451 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.037455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2429e661-c24b-4363-8922-8347814f6778-cert\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.137999 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.137878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnt7h\" (UniqueName: \"kubernetes.io/projected/2429e661-c24b-4363-8922-8347814f6778-kube-api-access-gnt7h\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.137999 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.137942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2429e661-c24b-4363-8922-8347814f6778-cert\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.138206 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:18:20.138104    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 02:18:20.138206 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:18:20.138170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2429e661-c24b-4363-8922-8347814f6778-cert podName:2429e661-c24b-4363-8922-8347814f6778 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:20.638154961 +0000 UTC m=+529.656869892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2429e661-c24b-4363-8922-8347814f6778-cert") pod "odh-model-controller-7998c67dc4-sbtbr" (UID: "2429e661-c24b-4363-8922-8347814f6778") : secret "odh-model-controller-webhook-cert" not found
Jul 07 02:18:20.154082 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.154052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnt7h\" (UniqueName: \"kubernetes.io/projected/2429e661-c24b-4363-8922-8347814f6778-kube-api-access-gnt7h\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.504234 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.504206    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gh9xc"]
Jul 07 02:18:20.506465 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.506450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.509974 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.509946    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 02:18:20.518303 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.518283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gh9xc"]
Jul 07 02:18:20.642182 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.642146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2429e661-c24b-4363-8922-8347814f6778-cert\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.642350 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.642188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z225\" (UniqueName: \"kubernetes.io/projected/7992c896-e2c1-40f8-b9d7-8a000972e332-kube-api-access-9z225\") pod \"model-serving-api-54d89bd5fc-gh9xc\" (UID: \"7992c896-e2c1-40f8-b9d7-8a000972e332\") " pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.642350 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.642222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7992c896-e2c1-40f8-b9d7-8a000972e332-tls-certs\") pod \"model-serving-api-54d89bd5fc-gh9xc\" (UID: \"7992c896-e2c1-40f8-b9d7-8a000972e332\") " pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.644655 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.644633    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2429e661-c24b-4363-8922-8347814f6778-cert\") pod \"odh-model-controller-7998c67dc4-sbtbr\" (UID: \"2429e661-c24b-4363-8922-8347814f6778\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.743578 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.743546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7992c896-e2c1-40f8-b9d7-8a000972e332-tls-certs\") pod \"model-serving-api-54d89bd5fc-gh9xc\" (UID: \"7992c896-e2c1-40f8-b9d7-8a000972e332\") " pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.743756 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.743601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z225\" (UniqueName: \"kubernetes.io/projected/7992c896-e2c1-40f8-b9d7-8a000972e332-kube-api-access-9z225\") pod \"model-serving-api-54d89bd5fc-gh9xc\" (UID: \"7992c896-e2c1-40f8-b9d7-8a000972e332\") " pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.746284 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.746253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7992c896-e2c1-40f8-b9d7-8a000972e332-tls-certs\") pod \"model-serving-api-54d89bd5fc-gh9xc\" (UID: \"7992c896-e2c1-40f8-b9d7-8a000972e332\") " pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.751182 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.751157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z225\" (UniqueName: \"kubernetes.io/projected/7992c896-e2c1-40f8-b9d7-8a000972e332-kube-api-access-9z225\") pod \"model-serving-api-54d89bd5fc-gh9xc\" (UID: \"7992c896-e2c1-40f8-b9d7-8a000972e332\") " pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.783177 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.783101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:20.816144 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.816118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:20.917345 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.917313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbtbr"]
Jul 07 02:18:20.920625 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:18:20.920592    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2429e661_c24b_4363_8922_8347814f6778.slice/crio-01089b0a9666a47f645a3d21ab2f2cf00e7c04220fee3f13e35dbee31f7a49a4 WatchSource:0}: Error finding container 01089b0a9666a47f645a3d21ab2f2cf00e7c04220fee3f13e35dbee31f7a49a4: Status 404 returned error can't find the container with id 01089b0a9666a47f645a3d21ab2f2cf00e7c04220fee3f13e35dbee31f7a49a4
Jul 07 02:18:20.958011 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:20.957977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gh9xc"]
Jul 07 02:18:20.960964 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:18:20.960942    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7992c896_e2c1_40f8_b9d7_8a000972e332.slice/crio-6b8b3d13b0a53258a7cb9d4f91b47608a53f46f7425cc7b34bc3d9bbe5f8839c WatchSource:0}: Error finding container 6b8b3d13b0a53258a7cb9d4f91b47608a53f46f7425cc7b34bc3d9bbe5f8839c: Status 404 returned error can't find the container with id 6b8b3d13b0a53258a7cb9d4f91b47608a53f46f7425cc7b34bc3d9bbe5f8839c
Jul 07 02:18:21.499844 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:21.499810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr" event={"ID":"2429e661-c24b-4363-8922-8347814f6778","Type":"ContainerStarted","Data":"01089b0a9666a47f645a3d21ab2f2cf00e7c04220fee3f13e35dbee31f7a49a4"}
Jul 07 02:18:21.500919 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:21.500876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc" event={"ID":"7992c896-e2c1-40f8-b9d7-8a000972e332","Type":"ContainerStarted","Data":"6b8b3d13b0a53258a7cb9d4f91b47608a53f46f7425cc7b34bc3d9bbe5f8839c"}
Jul 07 02:18:24.515378 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:24.515340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc" event={"ID":"7992c896-e2c1-40f8-b9d7-8a000972e332","Type":"ContainerStarted","Data":"ad08ac3d3e1c92779826add4b739de7fee0111c32acc0265dbf1c6437659cc83"}
Jul 07 02:18:24.515816 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:24.515471    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:24.516887 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:24.516864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr" event={"ID":"2429e661-c24b-4363-8922-8347814f6778","Type":"ContainerStarted","Data":"018e59261c06aceb856dcb50087241e49b4f613ff966066531a6a3d5b56c0f44"}
Jul 07 02:18:24.517033 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:24.516940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:24.530949 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:24.530891    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc" podStartSLOduration=1.495591595 podStartE2EDuration="4.530877931s" totalImagesPullingTime="3.035286336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:24.52972455 +0000 UTC m=+533.548439502" watchObservedRunningTime="2026-07-07 02:18:24.530877931 +0000 UTC m=+533.549592861"
Jul 07 02:18:24.543747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:24.543701    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr" podStartSLOduration=2.436418421 podStartE2EDuration="5.543688798s" totalImagesPullingTime="3.107270377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:24.543356179 +0000 UTC m=+533.562071132" watchObservedRunningTime="2026-07-07 02:18:24.543688798 +0000 UTC m=+533.562403765"
Jul 07 02:18:29.159116 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.159081    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"]
Jul 07 02:18:29.161517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.161494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.167878 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.167859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zghj8\""
Jul 07 02:18:29.168001 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.167926    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 02:18:29.183142 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.183112    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"]
Jul 07 02:18:29.185763 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.185741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"]
Jul 07 02:18:29.185860 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.185843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.189187 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.189168    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 02:18:29.189292 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.189281    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-shsqv\""
Jul 07 02:18:29.206706 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.206668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"]
Jul 07 02:18:29.311217 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.311178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmzx\" (UniqueName: \"kubernetes.io/projected/d72ffd86-b591-432f-917b-a610ace57823-kube-api-access-fhmzx\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.311217 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.311221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0361d811-6ce1-42fb-a13d-c31544b2fc45-cert\") pod \"kserve-controller-manager-d6f4b65b8-rb5fj\" (UID: \"0361d811-6ce1-42fb-a13d-c31544b2fc45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.311424 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.311247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72ffd86-b591-432f-917b-a610ace57823-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.311424 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.311324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhcp\" (UniqueName: \"kubernetes.io/projected/0361d811-6ce1-42fb-a13d-c31544b2fc45-kube-api-access-llhcp\") pod \"kserve-controller-manager-d6f4b65b8-rb5fj\" (UID: \"0361d811-6ce1-42fb-a13d-c31544b2fc45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.412685 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.412600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmzx\" (UniqueName: \"kubernetes.io/projected/d72ffd86-b591-432f-917b-a610ace57823-kube-api-access-fhmzx\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.412685 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.412635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0361d811-6ce1-42fb-a13d-c31544b2fc45-cert\") pod \"kserve-controller-manager-d6f4b65b8-rb5fj\" (UID: \"0361d811-6ce1-42fb-a13d-c31544b2fc45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.412685 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.412656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72ffd86-b591-432f-917b-a610ace57823-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.413005 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:18:29.412749    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 02:18:29.413005 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.412788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhcp\" (UniqueName: \"kubernetes.io/projected/0361d811-6ce1-42fb-a13d-c31544b2fc45-kube-api-access-llhcp\") pod \"kserve-controller-manager-d6f4b65b8-rb5fj\" (UID: \"0361d811-6ce1-42fb-a13d-c31544b2fc45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.413005 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:18:29.412808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72ffd86-b591-432f-917b-a610ace57823-cert podName:d72ffd86-b591-432f-917b-a610ace57823 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:29.912790079 +0000 UTC m=+538.931505010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d72ffd86-b591-432f-917b-a610ace57823-cert") pod "llmisvc-controller-manager-777c6bd7d5-j8cpp" (UID: "d72ffd86-b591-432f-917b-a610ace57823") : secret "llmisvc-webhook-server-cert" not found
Jul 07 02:18:29.415326 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.415300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0361d811-6ce1-42fb-a13d-c31544b2fc45-cert\") pod \"kserve-controller-manager-d6f4b65b8-rb5fj\" (UID: \"0361d811-6ce1-42fb-a13d-c31544b2fc45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.436163 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.436134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhcp\" (UniqueName: \"kubernetes.io/projected/0361d811-6ce1-42fb-a13d-c31544b2fc45-kube-api-access-llhcp\") pod \"kserve-controller-manager-d6f4b65b8-rb5fj\" (UID: \"0361d811-6ce1-42fb-a13d-c31544b2fc45\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.436665 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.436642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmzx\" (UniqueName: \"kubernetes.io/projected/d72ffd86-b591-432f-917b-a610ace57823-kube-api-access-fhmzx\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.471465 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.471431    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:29.603801 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.603769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"]
Jul 07 02:18:29.606773 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:18:29.606750    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0361d811_6ce1_42fb_a13d_c31544b2fc45.slice/crio-c3bb9a06ab48d53136ddf43f1d8a1c8cebd3e6b04d99bc6ab8403ee1ad7aa874 WatchSource:0}: Error finding container c3bb9a06ab48d53136ddf43f1d8a1c8cebd3e6b04d99bc6ab8403ee1ad7aa874: Status 404 returned error can't find the container with id c3bb9a06ab48d53136ddf43f1d8a1c8cebd3e6b04d99bc6ab8403ee1ad7aa874
Jul 07 02:18:29.918376 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.918339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72ffd86-b591-432f-917b-a610ace57823-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:29.920969 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:29.920944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d72ffd86-b591-432f-917b-a610ace57823-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j8cpp\" (UID: \"d72ffd86-b591-432f-917b-a610ace57823\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:30.096805 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.096771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:30.217290 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.217262    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-94d78774d-85ncg"]
Jul 07 02:18:30.220238 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.220188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.223570 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.223546    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 02:18:30.223703 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.223577    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 02:18:30.223703 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.223633    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 02:18:30.224428 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.224405    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 02:18:30.224543 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.224447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xsg9s\""
Jul 07 02:18:30.242588 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.242558    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"]
Jul 07 02:18:30.243108 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.243087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-94d78774d-85ncg"]
Jul 07 02:18:30.321706 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.321669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tmp\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.321879 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.321796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tls-certs\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.321879 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.321823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2krrn\" (UniqueName: \"kubernetes.io/projected/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-kube-api-access-2krrn\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.423207 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.423174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tls-certs\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.423363 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.423218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2krrn\" (UniqueName: \"kubernetes.io/projected/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-kube-api-access-2krrn\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.423363 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.423241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tmp\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.423363 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:18:30.423353    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 02:18:30.423502 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:18:30.423418    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tls-certs podName:2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:30.923402484 +0000 UTC m=+539.942117435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tls-certs") pod "kube-auth-proxy-94d78774d-85ncg" (UID: "2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9") : secret "kube-auth-proxy-tls" not found
Jul 07 02:18:30.425726 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.425670    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tmp\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.435120 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.435094    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2krrn\" (UniqueName: \"kubernetes.io/projected/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-kube-api-access-2krrn\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.542658 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.542622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp" event={"ID":"d72ffd86-b591-432f-917b-a610ace57823","Type":"ContainerStarted","Data":"e75cd5bdd63c6dd5563478d394fc145f8541363539f16daa55d76656164c4df5"}
Jul 07 02:18:30.543957 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.543926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj" event={"ID":"0361d811-6ce1-42fb-a13d-c31544b2fc45","Type":"ContainerStarted","Data":"c3bb9a06ab48d53136ddf43f1d8a1c8cebd3e6b04d99bc6ab8403ee1ad7aa874"}
Jul 07 02:18:30.928169 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.928126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tls-certs\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:30.930828 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:30.930794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9-tls-certs\") pod \"kube-auth-proxy-94d78774d-85ncg\" (UID: \"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9\") " pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:31.132204 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:31.132167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg"
Jul 07 02:18:31.395827 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:31.395792    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-94d78774d-85ncg"]
Jul 07 02:18:31.487273 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:18:31.487240    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0fd80d_20a5_41e2_a8b0_cc067b13dfb9.slice/crio-a277d74bfafaa948dac60490ef69cffc8d19e618630b4a47f8424f13975326d8 WatchSource:0}: Error finding container a277d74bfafaa948dac60490ef69cffc8d19e618630b4a47f8424f13975326d8: Status 404 returned error can't find the container with id a277d74bfafaa948dac60490ef69cffc8d19e618630b4a47f8424f13975326d8
Jul 07 02:18:31.549623 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:31.549550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg" event={"ID":"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9","Type":"ContainerStarted","Data":"a277d74bfafaa948dac60490ef69cffc8d19e618630b4a47f8424f13975326d8"}
Jul 07 02:18:32.168670 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.168637    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"]
Jul 07 02:18:32.172999 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.172973    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.177365 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.177339    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 02:18:32.177365 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.177354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 02:18:32.177595 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.177578    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 02:18:32.177836 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.177817    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 02:18:32.177942 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.177822    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gp2mt\""
Jul 07 02:18:32.209177 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.209109    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"]
Jul 07 02:18:32.339367 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce99def-f302-4df5-8ee4-785e47d28503-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.339510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cce99def-f302-4df5-8ee4-785e47d28503-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.339510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce99def-f302-4df5-8ee4-785e47d28503-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.339510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.339510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.339510 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.339686 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.339524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5rgt\" (UniqueName: \"kubernetes.io/projected/cce99def-f302-4df5-8ee4-785e47d28503-kube-api-access-j5rgt\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.440522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.440522 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5rgt\" (UniqueName: \"kubernetes.io/projected/cce99def-f302-4df5-8ee4-785e47d28503-kube-api-access-j5rgt\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.441056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce99def-f302-4df5-8ee4-785e47d28503-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.441056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cce99def-f302-4df5-8ee4-785e47d28503-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.441056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce99def-f302-4df5-8ee4-785e47d28503-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.441056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.441056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.440680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.441619 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.441569    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cce99def-f302-4df5-8ee4-785e47d28503-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.443758 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.443729    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.443864 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.443731    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.443864 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.443777    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cce99def-f302-4df5-8ee4-785e47d28503-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.443864 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.443838    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce99def-f302-4df5-8ee4-785e47d28503-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.449609 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.449583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5rgt\" (UniqueName: \"kubernetes.io/projected/cce99def-f302-4df5-8ee4-785e47d28503-kube-api-access-j5rgt\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.449802 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.449782    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce99def-f302-4df5-8ee4-785e47d28503-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dsv9z\" (UID: \"cce99def-f302-4df5-8ee4-785e47d28503\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.484674 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.484645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:32.557162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.557110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj" event={"ID":"0361d811-6ce1-42fb-a13d-c31544b2fc45","Type":"ContainerStarted","Data":"fd26e9bd1ddac8f61504b8f5b1dfebb844e724d4a14cc7a35f413a64bd9f4e5b"}
Jul 07 02:18:32.557337 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.557273    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:18:32.574749 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.574700    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj" podStartSLOduration=0.92451962 podStartE2EDuration="3.574685362s" totalImagesPullingTime="2.650165742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:32.572909701 +0000 UTC m=+541.591624646" watchObservedRunningTime="2026-07-07 02:18:32.574685362 +0000 UTC m=+541.593400313"
Jul 07 02:18:32.634535 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:32.634505    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"]
Jul 07 02:18:32.637835 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:18:32.637797    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce99def_f302_4df5_8ee4_785e47d28503.slice/crio-7dc0959ccec5d562ffddf2bb9df8709e636d69cd3942dcf75f1f9e2c5f9d91c8 WatchSource:0}: Error finding container 7dc0959ccec5d562ffddf2bb9df8709e636d69cd3942dcf75f1f9e2c5f9d91c8: Status 404 returned error can't find the container with id 7dc0959ccec5d562ffddf2bb9df8709e636d69cd3942dcf75f1f9e2c5f9d91c8
Jul 07 02:18:33.561737 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:33.561709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z" event={"ID":"cce99def-f302-4df5-8ee4-785e47d28503","Type":"ContainerStarted","Data":"7dc0959ccec5d562ffddf2bb9df8709e636d69cd3942dcf75f1f9e2c5f9d91c8"}
Jul 07 02:18:34.568326 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:34.568285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp" event={"ID":"d72ffd86-b591-432f-917b-a610ace57823","Type":"ContainerStarted","Data":"f976b52a9f666332c9f9ca219dc46c33794f9f42a5bcba3a2281e061a84aed92"}
Jul 07 02:18:34.568780 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:34.568376    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:18:34.586322 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:34.586266    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp" podStartSLOduration=2.27902726 podStartE2EDuration="5.586248337s" totalImagesPullingTime="3.307221077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:34.584673449 +0000 UTC m=+543.603388413" watchObservedRunningTime="2026-07-07 02:18:34.586248337 +0000 UTC m=+543.604963288"
Jul 07 02:18:35.523998 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:35.523961    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sbtbr"
Jul 07 02:18:35.526204 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:35.526185    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gh9xc"
Jul 07 02:18:35.863184 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:35.863146    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 02:18:35.863487 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:35.863215    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 02:18:35.864088 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:35.864070    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 02:18:36.579442 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.579409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg" event={"ID":"2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9","Type":"ContainerStarted","Data":"3a8acfdf8024041c526489e66d7a84621647156f975f45f3abae820305cdf846"}
Jul 07 02:18:36.583575 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.583540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z" event={"ID":"cce99def-f302-4df5-8ee4-785e47d28503","Type":"ContainerStarted","Data":"2b73ba478f09fbaffe9ed19f835332fa08ede2a9f93a42e212815345df7b3897"}
Jul 07 02:18:36.584003 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.583969    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:18:36.590784 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.590756    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-dsv9z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:18:36.590931 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.590808    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z" podUID="cce99def-f302-4df5-8ee4-785e47d28503" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:18:36.599640 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.599584    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-94d78774d-85ncg" podStartSLOduration=2.227322159 podStartE2EDuration="6.59956874s" totalImagesPullingTime="4.372246581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:36.598798207 +0000 UTC m=+545.617513170" watchObservedRunningTime="2026-07-07 02:18:36.59956874 +0000 UTC m=+545.618283696"
Jul 07 02:18:36.621280 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:36.621232    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z" podStartSLOduration=1.398735919 podStartE2EDuration="4.621217023s" totalImagesPullingTime="3.222481104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:18:36.61928291 +0000 UTC m=+545.637997864" watchObservedRunningTime="2026-07-07 02:18:36.621217023 +0000 UTC m=+545.639931975"
Jul 07 02:18:37.588707 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:18:37.588679    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dsv9z"
Jul 07 02:19:03.567122 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:19:03.567087    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rb5fj"
Jul 07 02:19:05.575874 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:19:05.575845    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j8cpp"
Jul 07 02:19:31.427294 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:19:31.427268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:19:31.427726 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:19:31.427460    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:20:23.910243 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:23.910202    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"]
Jul 07 02:20:23.913161 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:23.913143    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:20:23.916586 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:23.916566    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5rxcx\""
Jul 07 02:20:23.916704 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:23.916570    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 02:20:23.917218 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:23.917203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 02:20:23.928933 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:23.928910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"]
Jul 07 02:20:24.001558 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:24.001505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wtq9\" (UniqueName: \"kubernetes.io/projected/06cccccf-b066-45c6-861b-71d6f2e6bb9c-kube-api-access-6wtq9\") pod \"limitador-operator-controller-manager-859d7b78bd-7n78m\" (UID: \"06cccccf-b066-45c6-861b-71d6f2e6bb9c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:20:24.102331 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:24.102294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wtq9\" (UniqueName: \"kubernetes.io/projected/06cccccf-b066-45c6-861b-71d6f2e6bb9c-kube-api-access-6wtq9\") pod \"limitador-operator-controller-manager-859d7b78bd-7n78m\" (UID: \"06cccccf-b066-45c6-861b-71d6f2e6bb9c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:20:24.111148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:24.111119    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wtq9\" (UniqueName: \"kubernetes.io/projected/06cccccf-b066-45c6-861b-71d6f2e6bb9c-kube-api-access-6wtq9\") pod \"limitador-operator-controller-manager-859d7b78bd-7n78m\" (UID: \"06cccccf-b066-45c6-861b-71d6f2e6bb9c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:20:24.225038 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:24.224998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:20:24.363156 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:24.363132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"]
Jul 07 02:20:24.365746 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:20:24.365717    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cccccf_b066_45c6_861b_71d6f2e6bb9c.slice/crio-b75cda6540c68c9a1420c05fdaee30f7fb40b9fef75c8c72eaaff9e11b1aff78 WatchSource:0}: Error finding container b75cda6540c68c9a1420c05fdaee30f7fb40b9fef75c8c72eaaff9e11b1aff78: Status 404 returned error can't find the container with id b75cda6540c68c9a1420c05fdaee30f7fb40b9fef75c8c72eaaff9e11b1aff78
Jul 07 02:20:24.367725 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:24.367708    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:20:25.021369 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:25.021335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m" event={"ID":"06cccccf-b066-45c6-861b-71d6f2e6bb9c","Type":"ContainerStarted","Data":"b75cda6540c68c9a1420c05fdaee30f7fb40b9fef75c8c72eaaff9e11b1aff78"}
Jul 07 02:20:26.026360 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:26.026327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m" event={"ID":"06cccccf-b066-45c6-861b-71d6f2e6bb9c","Type":"ContainerStarted","Data":"1db5e891fcf1eea25e97abf4e50955f8615477bfd0b65043203dff8870bac262"}
Jul 07 02:20:26.026671 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:26.026396    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:20:26.050085 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:26.050034    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m" podStartSLOduration=1.467309278 podStartE2EDuration="3.050016223s" totalImagesPullingTime="1.582706945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:26.049323397 +0000 UTC m=+655.068038349" watchObservedRunningTime="2026-07-07 02:20:26.050016223 +0000 UTC m=+655.068731227"
Jul 07 02:20:37.034401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:20:37.034369    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7n78m"
Jul 07 02:21:39.569279 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.569245    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-rfjk7"]
Jul 07 02:21:39.572457 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.572438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:39.575385 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.575367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 02:21:39.575493 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.575373    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7cf92\""
Jul 07 02:21:39.580821 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.580797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-rfjk7"]
Jul 07 02:21:39.610981 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.610955    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-rfjk7"]
Jul 07 02:21:39.611179 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:21:39.611160    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2ccq8 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-2ccq8 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-rfjk7" podUID="bf014222-6081-4765-9a5b-63c8eeb0125d"
Jul 07 02:21:39.694863 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.694825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ccq8\" (UniqueName: \"kubernetes.io/projected/bf014222-6081-4765-9a5b-63c8eeb0125d-kube-api-access-2ccq8\") pod \"authorino-76877994-rfjk7\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") " pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:39.695025 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.694927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf014222-6081-4765-9a5b-63c8eeb0125d-tls-cert\") pod \"authorino-76877994-rfjk7\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") " pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:39.796180 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.796143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf014222-6081-4765-9a5b-63c8eeb0125d-tls-cert\") pod \"authorino-76877994-rfjk7\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") " pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:39.796180 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.796181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ccq8\" (UniqueName: \"kubernetes.io/projected/bf014222-6081-4765-9a5b-63c8eeb0125d-kube-api-access-2ccq8\") pod \"authorino-76877994-rfjk7\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") " pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:39.798848 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.798816    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf014222-6081-4765-9a5b-63c8eeb0125d-tls-cert\") pod \"authorino-76877994-rfjk7\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") " pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:39.803118 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:39.803094    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ccq8\" (UniqueName: \"kubernetes.io/projected/bf014222-6081-4765-9a5b-63c8eeb0125d-kube-api-access-2ccq8\") pod \"authorino-76877994-rfjk7\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") " pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:40.332097 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.332068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:40.338813 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.338790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:40.400634 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.400605    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf014222-6081-4765-9a5b-63c8eeb0125d-tls-cert\") pod \"bf014222-6081-4765-9a5b-63c8eeb0125d\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") "
Jul 07 02:21:40.400796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.400670    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ccq8\" (UniqueName: \"kubernetes.io/projected/bf014222-6081-4765-9a5b-63c8eeb0125d-kube-api-access-2ccq8\") pod \"bf014222-6081-4765-9a5b-63c8eeb0125d\" (UID: \"bf014222-6081-4765-9a5b-63c8eeb0125d\") "
Jul 07 02:21:40.402859 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.402828    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf014222-6081-4765-9a5b-63c8eeb0125d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf014222-6081-4765-9a5b-63c8eeb0125d" (UID: "bf014222-6081-4765-9a5b-63c8eeb0125d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:21:40.402979 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.402953    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf014222-6081-4765-9a5b-63c8eeb0125d-kube-api-access-2ccq8" (OuterVolumeSpecName: "kube-api-access-2ccq8") pod "bf014222-6081-4765-9a5b-63c8eeb0125d" (UID: "bf014222-6081-4765-9a5b-63c8eeb0125d"). InnerVolumeSpecName "kube-api-access-2ccq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:21:40.501454 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.501418    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf014222-6081-4765-9a5b-63c8eeb0125d-tls-cert\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:21:40.501454 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:40.501451    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ccq8\" (UniqueName: \"kubernetes.io/projected/bf014222-6081-4765-9a5b-63c8eeb0125d-kube-api-access-2ccq8\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:21:41.336484 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:41.336448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-rfjk7"
Jul 07 02:21:41.363940 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:41.363890    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-rfjk7"]
Jul 07 02:21:41.367689 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:41.367666    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-rfjk7"]
Jul 07 02:21:41.533162 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:41.533126    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf014222-6081-4765-9a5b-63c8eeb0125d" path="/var/lib/kubelet/pods/bf014222-6081-4765-9a5b-63c8eeb0125d/volumes"
Jul 07 02:21:48.068640 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.068603    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d44d4f54-l7ljl"]
Jul 07 02:21:48.071994 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.071974    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.074976 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.074951    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cl2fm\""
Jul 07 02:21:48.075637 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.075620    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 02:21:48.075715 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.075649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 02:21:48.081376 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.081355    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-l7ljl"]
Jul 07 02:21:48.159380 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.159348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bk6f\" (UniqueName: \"kubernetes.io/projected/be5150c9-3430-4163-a0de-f4839e405d56-kube-api-access-2bk6f\") pod \"maas-controller-68d44d4f54-l7ljl\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") " pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.159554 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.159394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be5150c9-3430-4163-a0de-f4839e405d56-webhook-cert\") pod \"maas-controller-68d44d4f54-l7ljl\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") " pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.260602 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.260572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bk6f\" (UniqueName: \"kubernetes.io/projected/be5150c9-3430-4163-a0de-f4839e405d56-kube-api-access-2bk6f\") pod \"maas-controller-68d44d4f54-l7ljl\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") " pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.260748 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.260623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be5150c9-3430-4163-a0de-f4839e405d56-webhook-cert\") pod \"maas-controller-68d44d4f54-l7ljl\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") " pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.263293 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.263267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be5150c9-3430-4163-a0de-f4839e405d56-webhook-cert\") pod \"maas-controller-68d44d4f54-l7ljl\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") " pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.269349 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.269327    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bk6f\" (UniqueName: \"kubernetes.io/projected/be5150c9-3430-4163-a0de-f4839e405d56-kube-api-access-2bk6f\") pod \"maas-controller-68d44d4f54-l7ljl\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") " pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.383076 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.382995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:48.510798 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:48.510765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-l7ljl"]
Jul 07 02:21:48.513835 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:21:48.513810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5150c9_3430_4163_a0de_f4839e405d56.slice/crio-3016acc87ac39d4d78f1e377aed9f4ca448b22bf8718e3f1d94f1b02ee7d493f WatchSource:0}: Error finding container 3016acc87ac39d4d78f1e377aed9f4ca448b22bf8718e3f1d94f1b02ee7d493f: Status 404 returned error can't find the container with id 3016acc87ac39d4d78f1e377aed9f4ca448b22bf8718e3f1d94f1b02ee7d493f
Jul 07 02:21:49.369441 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:49.369391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d44d4f54-l7ljl" event={"ID":"be5150c9-3430-4163-a0de-f4839e405d56","Type":"ContainerStarted","Data":"3016acc87ac39d4d78f1e377aed9f4ca448b22bf8718e3f1d94f1b02ee7d493f"}
Jul 07 02:21:51.387273 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:51.387231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d44d4f54-l7ljl" event={"ID":"be5150c9-3430-4163-a0de-f4839e405d56","Type":"ContainerStarted","Data":"8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf"}
Jul 07 02:21:51.387664 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:51.387318    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:21:51.406470 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:21:51.406423    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d44d4f54-l7ljl" podStartSLOduration=1.602251696 podStartE2EDuration="3.406408578s" totalImagesPullingTime="1.804156882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:51.404732791 +0000 UTC m=+740.423447743" watchObservedRunningTime="2026-07-07 02:21:51.406408578 +0000 UTC m=+740.425123529"
Jul 07 02:22:02.397836 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:02.397807    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:22:50.628870 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.628830    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"]
Jul 07 02:22:50.631408 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.631390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.634249 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.634224    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 02:22:50.634815 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.634777    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 02:22:50.635061 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.635045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bzvlw\""
Jul 07 02:22:50.635140 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.635126    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 02:22:50.648780 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.648755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"]
Jul 07 02:22:50.760777 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.760735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.760777 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.760772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.761054 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.760808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrfp\" (UniqueName: \"kubernetes.io/projected/ddf62b87-ca12-4355-9a38-c87f3fb50106-kube-api-access-xnrfp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.761054 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.760913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.761054 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.760966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddf62b87-ca12-4355-9a38-c87f3fb50106-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.761054 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.761027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862364 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862364 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrfp\" (UniqueName: \"kubernetes.io/projected/ddf62b87-ca12-4355-9a38-c87f3fb50106-kube-api-access-xnrfp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862599 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862599 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddf62b87-ca12-4355-9a38-c87f3fb50106-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862599 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862599 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.862806 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.862780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.863088 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.863066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.863088 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.863066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.865151 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.865124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddf62b87-ca12-4355-9a38-c87f3fb50106-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.865367 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.865349    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddf62b87-ca12-4355-9a38-c87f3fb50106-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.872305 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.872285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrfp\" (UniqueName: \"kubernetes.io/projected/ddf62b87-ca12-4355-9a38-c87f3fb50106-kube-api-access-xnrfp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh\" (UID: \"ddf62b87-ca12-4355-9a38-c87f3fb50106\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:50.941756 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:50.941678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:22:51.077342 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:51.077301    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"]
Jul 07 02:22:51.082280 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:22:51.082248    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf62b87_ca12_4355_9a38_c87f3fb50106.slice/crio-7febdde140f5bc67a7dfd8e65df15e01b1911fe8cfe2a3d2c20662cb8d0bc0d4 WatchSource:0}: Error finding container 7febdde140f5bc67a7dfd8e65df15e01b1911fe8cfe2a3d2c20662cb8d0bc0d4: Status 404 returned error can't find the container with id 7febdde140f5bc67a7dfd8e65df15e01b1911fe8cfe2a3d2c20662cb8d0bc0d4
Jul 07 02:22:51.643436 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:51.643396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh" event={"ID":"ddf62b87-ca12-4355-9a38-c87f3fb50106","Type":"ContainerStarted","Data":"7febdde140f5bc67a7dfd8e65df15e01b1911fe8cfe2a3d2c20662cb8d0bc0d4"}
Jul 07 02:22:52.648677 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:52.648640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh" event={"ID":"ddf62b87-ca12-4355-9a38-c87f3fb50106","Type":"ContainerStarted","Data":"434aa5bc89844a55a1f69c11ceeaa05bc565b5fd69baf8108bf5933f96e8655e"}
Jul 07 02:22:52.686512 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:52.686456    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh" podStartSLOduration=1.5655548719999999 podStartE2EDuration="2.686439456s" totalImagesPullingTime="1.120884584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:22:52.684844494 +0000 UTC m=+801.703559447" watchObservedRunningTime="2026-07-07 02:22:52.686439456 +0000 UTC m=+801.705154408"
Jul 07 02:22:57.559261 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.559230    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"]
Jul 07 02:22:57.562111 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.562092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.567711 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.567691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 02:22:57.590132 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.590098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"]
Jul 07 02:22:57.613505 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.613476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.613646 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.613517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/235563b3-8ff6-4de3-a577-7e4a4d404b1b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.613646 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.613539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdj2t\" (UniqueName: \"kubernetes.io/projected/235563b3-8ff6-4de3-a577-7e4a4d404b1b-kube-api-access-kdj2t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.613718 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.613637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.613718 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.613674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.613718 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.613698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.714754 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.714721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.714754 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.714759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715042 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.714780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715042 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.714805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715042 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.714829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/235563b3-8ff6-4de3-a577-7e4a4d404b1b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715042 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.714847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdj2t\" (UniqueName: \"kubernetes.io/projected/235563b3-8ff6-4de3-a577-7e4a4d404b1b-kube-api-access-kdj2t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715271 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.715240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715331 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.715253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.715331 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.715291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.717361 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.717339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/235563b3-8ff6-4de3-a577-7e4a4d404b1b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.717560 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.717543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/235563b3-8ff6-4de3-a577-7e4a4d404b1b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.726822 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.726800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdj2t\" (UniqueName: \"kubernetes.io/projected/235563b3-8ff6-4de3-a577-7e4a4d404b1b-kube-api-access-kdj2t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9n4pc\" (UID: \"235563b3-8ff6-4de3-a577-7e4a4d404b1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:57.872203 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:57.872129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:22:58.026068 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:58.026039    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"]
Jul 07 02:22:58.028960 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:22:58.028933    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235563b3_8ff6_4de3_a577_7e4a4d404b1b.slice/crio-3bf4d92b93932221caa56c8ab8169fd1ba628bc7e1bd3ab39a74bd517ac65d6f WatchSource:0}: Error finding container 3bf4d92b93932221caa56c8ab8169fd1ba628bc7e1bd3ab39a74bd517ac65d6f: Status 404 returned error can't find the container with id 3bf4d92b93932221caa56c8ab8169fd1ba628bc7e1bd3ab39a74bd517ac65d6f
Jul 07 02:22:58.675925 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:58.675878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc" event={"ID":"235563b3-8ff6-4de3-a577-7e4a4d404b1b","Type":"ContainerStarted","Data":"ffbacb010ff119ad61370bd403e01e202467afb60ac71aa5402bd07a6a1bfed0"}
Jul 07 02:22:58.676286 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:58.675940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc" event={"ID":"235563b3-8ff6-4de3-a577-7e4a4d404b1b","Type":"ContainerStarted","Data":"3bf4d92b93932221caa56c8ab8169fd1ba628bc7e1bd3ab39a74bd517ac65d6f"}
Jul 07 02:22:58.721738 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:22:58.721679    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc" podStartSLOduration=1.548629392 podStartE2EDuration="1.721661192s" totalImagesPullingTime="173.0318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:22:58.720969978 +0000 UTC m=+807.739684930" watchObservedRunningTime="2026-07-07 02:22:58.721661192 +0000 UTC m=+807.740376144"
Jul 07 02:23:00.941872 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:00.941837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:23:00.942373 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:00.941917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:23:00.954143 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:00.954118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:23:01.700139 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:01.700112    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh"
Jul 07 02:23:07.872435 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:07.872397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:23:07.872835 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:07.872693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:23:07.885153 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:07.885121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:23:08.729313 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:08.729284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9n4pc"
Jul 07 02:23:30.285642 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.285603    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"]
Jul 07 02:23:30.288835 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.288818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.308758 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.308730    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 02:23:30.310911 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.310870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"]
Jul 07 02:23:30.386710 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.386674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.386873 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.386714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvsx\" (UniqueName: \"kubernetes.io/projected/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-kube-api-access-ftvsx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.386873 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.386738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.386873 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.386755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.386873 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.386819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.387308 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.386885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.487445 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.487413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvsx\" (UniqueName: \"kubernetes.io/projected/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-kube-api-access-ftvsx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.487445 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.487452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.487742 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.487481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.487742 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.487514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.487742 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.487592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.487742 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.487632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.488033 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.488008    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.488135 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.488084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.488188 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.488132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.490121 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.490092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.490353 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.490336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.505216 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.505195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvsx\" (UniqueName: \"kubernetes.io/projected/9c94e918-b6e7-4961-8a41-67c75f7f1fe5-kube-api-access-ftvsx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4\" (UID: \"9c94e918-b6e7-4961-8a41-67c75f7f1fe5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.599060 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.598979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:30.781373 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.781344    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"]
Jul 07 02:23:30.786950 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:23:30.786923    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c94e918_b6e7_4961_8a41_67c75f7f1fe5.slice/crio-c1b5628a317f0cc7f69e6499d94d5bfa6a7ec2614e99711e6335f402bf2a720e WatchSource:0}: Error finding container c1b5628a317f0cc7f69e6499d94d5bfa6a7ec2614e99711e6335f402bf2a720e: Status 404 returned error can't find the container with id c1b5628a317f0cc7f69e6499d94d5bfa6a7ec2614e99711e6335f402bf2a720e
Jul 07 02:23:30.807981 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:30.807949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4" event={"ID":"9c94e918-b6e7-4961-8a41-67c75f7f1fe5","Type":"ContainerStarted","Data":"c1b5628a317f0cc7f69e6499d94d5bfa6a7ec2614e99711e6335f402bf2a720e"}
Jul 07 02:23:31.813640 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:31.813593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4" event={"ID":"9c94e918-b6e7-4961-8a41-67c75f7f1fe5","Type":"ContainerStarted","Data":"cec97934b6cd9fdafd9ab4d83ee68a3e799aca7715d5e9a9540be8c18ae89b4f"}
Jul 07 02:23:31.859013 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:31.858963    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4" podStartSLOduration=1.688090865 podStartE2EDuration="1.858946742s" totalImagesPullingTime="170.855877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:31.858279629 +0000 UTC m=+840.876994582" watchObservedRunningTime="2026-07-07 02:23:31.858946742 +0000 UTC m=+840.877661693"
Jul 07 02:23:40.599701 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:40.599664    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:40.600098 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:40.599716    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:40.612478 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:40.612453    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:23:40.865401 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:23:40.865322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4"
Jul 07 02:24:31.456457 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:24:31.456425    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:24:31.457768 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:24:31.457750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:25:43.858177 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:43.858144    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-l7ljl"]
Jul 07 02:25:43.858666 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:43.858335    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-68d44d4f54-l7ljl" podUID="be5150c9-3430-4163-a0de-f4839e405d56" containerName="manager" containerID="cri-o://8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf" gracePeriod=30
Jul 07 02:25:44.101948 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.101925    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:25:44.200086 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.199997    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be5150c9-3430-4163-a0de-f4839e405d56-webhook-cert\") pod \"be5150c9-3430-4163-a0de-f4839e405d56\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") "
Jul 07 02:25:44.200086 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.200045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bk6f\" (UniqueName: \"kubernetes.io/projected/be5150c9-3430-4163-a0de-f4839e405d56-kube-api-access-2bk6f\") pod \"be5150c9-3430-4163-a0de-f4839e405d56\" (UID: \"be5150c9-3430-4163-a0de-f4839e405d56\") "
Jul 07 02:25:44.202313 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.202280    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be5150c9-3430-4163-a0de-f4839e405d56-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "be5150c9-3430-4163-a0de-f4839e405d56" (UID: "be5150c9-3430-4163-a0de-f4839e405d56"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:25:44.202313 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.202308    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be5150c9-3430-4163-a0de-f4839e405d56-kube-api-access-2bk6f" (OuterVolumeSpecName: "kube-api-access-2bk6f") pod "be5150c9-3430-4163-a0de-f4839e405d56" (UID: "be5150c9-3430-4163-a0de-f4839e405d56"). InnerVolumeSpecName "kube-api-access-2bk6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:25:44.300750 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.300714    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be5150c9-3430-4163-a0de-f4839e405d56-webhook-cert\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:25:44.301146 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.301120    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bk6f\" (UniqueName: \"kubernetes.io/projected/be5150c9-3430-4163-a0de-f4839e405d56-kube-api-access-2bk6f\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:25:44.389416 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.389380    2562 generic.go:356] "Generic (PLEG): container finished" podID="be5150c9-3430-4163-a0de-f4839e405d56" containerID="8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf" exitCode=0
Jul 07 02:25:44.389623 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.389444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d44d4f54-l7ljl" event={"ID":"be5150c9-3430-4163-a0de-f4839e405d56","Type":"ContainerDied","Data":"8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf"}
Jul 07 02:25:44.389623 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.389451    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d44d4f54-l7ljl"
Jul 07 02:25:44.389623 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.389511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d44d4f54-l7ljl" event={"ID":"be5150c9-3430-4163-a0de-f4839e405d56","Type":"ContainerDied","Data":"3016acc87ac39d4d78f1e377aed9f4ca448b22bf8718e3f1d94f1b02ee7d493f"}
Jul 07 02:25:44.389623 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.389533    2562 scope.go:117] "RemoveContainer" containerID="8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf"
Jul 07 02:25:44.398612 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.398589    2562 scope.go:117] "RemoveContainer" containerID="8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf"
Jul 07 02:25:44.398864 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:25:44.398845    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf\": container with ID starting with 8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf not found: ID does not exist" containerID="8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf"
Jul 07 02:25:44.398956 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.398873    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf"} err="failed to get container status \"8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf\": rpc error: code = NotFound desc = could not find container \"8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf\": container with ID starting with 8b2533cb76ad5c37eb4f27f6ffcbf4ec413a5653a8ac8525eca83d18acd8ffdf not found: ID does not exist"
Jul 07 02:25:44.414033 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.414005    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-l7ljl"]
Jul 07 02:25:44.416416 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:44.416396    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-l7ljl"]
Jul 07 02:25:45.176442 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.176409    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d44d4f54-84g27"]
Jul 07 02:25:45.176826 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.176737    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be5150c9-3430-4163-a0de-f4839e405d56" containerName="manager"
Jul 07 02:25:45.176826 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.176750    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="be5150c9-3430-4163-a0de-f4839e405d56" containerName="manager"
Jul 07 02:25:45.176826 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.176816    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be5150c9-3430-4163-a0de-f4839e405d56" containerName="manager"
Jul 07 02:25:45.181010 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.180991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.183676 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.183658    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cl2fm\""
Jul 07 02:25:45.184483 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.184468    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 02:25:45.184544 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.184474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 02:25:45.192019 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.191997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-84g27"]
Jul 07 02:25:45.309747 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.309709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1112ec46-5aa0-4508-b39d-3dcca2fe4b65-webhook-cert\") pod \"maas-controller-68d44d4f54-84g27\" (UID: \"1112ec46-5aa0-4508-b39d-3dcca2fe4b65\") " pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.309954 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.309776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpsjr\" (UniqueName: \"kubernetes.io/projected/1112ec46-5aa0-4508-b39d-3dcca2fe4b65-kube-api-access-dpsjr\") pod \"maas-controller-68d44d4f54-84g27\" (UID: \"1112ec46-5aa0-4508-b39d-3dcca2fe4b65\") " pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.410962 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.410927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1112ec46-5aa0-4508-b39d-3dcca2fe4b65-webhook-cert\") pod \"maas-controller-68d44d4f54-84g27\" (UID: \"1112ec46-5aa0-4508-b39d-3dcca2fe4b65\") " pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.411102 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.410986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpsjr\" (UniqueName: \"kubernetes.io/projected/1112ec46-5aa0-4508-b39d-3dcca2fe4b65-kube-api-access-dpsjr\") pod \"maas-controller-68d44d4f54-84g27\" (UID: \"1112ec46-5aa0-4508-b39d-3dcca2fe4b65\") " pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.413441 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.413418    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1112ec46-5aa0-4508-b39d-3dcca2fe4b65-webhook-cert\") pod \"maas-controller-68d44d4f54-84g27\" (UID: \"1112ec46-5aa0-4508-b39d-3dcca2fe4b65\") " pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.421978 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.421951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpsjr\" (UniqueName: \"kubernetes.io/projected/1112ec46-5aa0-4508-b39d-3dcca2fe4b65-kube-api-access-dpsjr\") pod \"maas-controller-68d44d4f54-84g27\" (UID: \"1112ec46-5aa0-4508-b39d-3dcca2fe4b65\") " pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.492001 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.491972    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:45.533098 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.533051    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be5150c9-3430-4163-a0de-f4839e405d56" path="/var/lib/kubelet/pods/be5150c9-3430-4163-a0de-f4839e405d56/volumes"
Jul 07 02:25:45.634232 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.634209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d44d4f54-84g27"]
Jul 07 02:25:45.636366 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:25:45.636329    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1112ec46_5aa0_4508_b39d_3dcca2fe4b65.slice/crio-db200a31fe38bab0ab6c201e339195c37b576a5638a81530aad7d1f61ee67021 WatchSource:0}: Error finding container db200a31fe38bab0ab6c201e339195c37b576a5638a81530aad7d1f61ee67021: Status 404 returned error can't find the container with id db200a31fe38bab0ab6c201e339195c37b576a5638a81530aad7d1f61ee67021
Jul 07 02:25:45.637664 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:45.637648    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:25:46.400691 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:46.400589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d44d4f54-84g27" event={"ID":"1112ec46-5aa0-4508-b39d-3dcca2fe4b65","Type":"ContainerStarted","Data":"4ee93d20078f090bdc76621ad52e4d782be158f85e180ead5dcb6d9433ebe0e3"}
Jul 07 02:25:46.400691 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:46.400637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d44d4f54-84g27" event={"ID":"1112ec46-5aa0-4508-b39d-3dcca2fe4b65","Type":"ContainerStarted","Data":"db200a31fe38bab0ab6c201e339195c37b576a5638a81530aad7d1f61ee67021"}
Jul 07 02:25:46.400691 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:46.400686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:25:46.421430 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:46.421376    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d44d4f54-84g27" podStartSLOduration=0.957994884 podStartE2EDuration="1.421360854s" totalImagesPullingTime="463.36597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:46.419045378 +0000 UTC m=+975.437760346" watchObservedRunningTime="2026-07-07 02:25:46.421360854 +0000 UTC m=+975.440075806"
Jul 07 02:25:57.410867 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:25:57.410788    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d44d4f54-84g27"
Jul 07 02:29:31.481435 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:29:31.481405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:29:31.482917 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:29:31.482877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:30:00.151463 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.151420    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723190-8nvq8"]
Jul 07 02:30:00.154856 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.154832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:00.157081 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.157055    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2kkqn\""
Jul 07 02:30:00.169646 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.169620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723190-8nvq8"]
Jul 07 02:30:00.316547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.316504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wnj5\" (UniqueName: \"kubernetes.io/projected/57c1a42a-8e60-4668-b7fa-0c4986beca4e-kube-api-access-5wnj5\") pod \"maas-api-key-cleanup-29723190-8nvq8\" (UID: \"57c1a42a-8e60-4668-b7fa-0c4986beca4e\") " pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:00.417783 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.417693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wnj5\" (UniqueName: \"kubernetes.io/projected/57c1a42a-8e60-4668-b7fa-0c4986beca4e-kube-api-access-5wnj5\") pod \"maas-api-key-cleanup-29723190-8nvq8\" (UID: \"57c1a42a-8e60-4668-b7fa-0c4986beca4e\") " pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:00.427544 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.427517    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wnj5\" (UniqueName: \"kubernetes.io/projected/57c1a42a-8e60-4668-b7fa-0c4986beca4e-kube-api-access-5wnj5\") pod \"maas-api-key-cleanup-29723190-8nvq8\" (UID: \"57c1a42a-8e60-4668-b7fa-0c4986beca4e\") " pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:00.465173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.465131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:00.602914 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:00.602866    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723190-8nvq8"]
Jul 07 02:30:00.604398 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:30:00.604371    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c1a42a_8e60_4668_b7fa_0c4986beca4e.slice/crio-95418d75819a1dec4c43d9d12154305b9f1d9ae3fcfd518e7755ed935f669bf7 WatchSource:0}: Error finding container 95418d75819a1dec4c43d9d12154305b9f1d9ae3fcfd518e7755ed935f669bf7: Status 404 returned error can't find the container with id 95418d75819a1dec4c43d9d12154305b9f1d9ae3fcfd518e7755ed935f669bf7
Jul 07 02:30:01.518358 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:01.518323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8" event={"ID":"57c1a42a-8e60-4668-b7fa-0c4986beca4e","Type":"ContainerStarted","Data":"95418d75819a1dec4c43d9d12154305b9f1d9ae3fcfd518e7755ed935f669bf7"}
Jul 07 02:30:06.543553 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:06.543514    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8" event={"ID":"57c1a42a-8e60-4668-b7fa-0c4986beca4e","Type":"ContainerStarted","Data":"166db19f9df9ce2dd077a6792b5db97bec285525f9ac2f2e9987f3fc2fbfd4b6"}
Jul 07 02:30:06.558094 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:06.558044    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8" podStartSLOduration=1.381008875 podStartE2EDuration="6.558031344s" totalImagesPullingTime="5.177022469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:30:06.557860176 +0000 UTC m=+1235.576575129" watchObservedRunningTime="2026-07-07 02:30:06.558031344 +0000 UTC m=+1235.576746318"
Jul 07 02:30:07.548991 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:07.548948    2562 generic.go:356] "Generic (PLEG): container finished" podID="57c1a42a-8e60-4668-b7fa-0c4986beca4e" containerID="166db19f9df9ce2dd077a6792b5db97bec285525f9ac2f2e9987f3fc2fbfd4b6" exitCode=0
Jul 07 02:30:07.549434 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:07.549030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8" event={"ID":"57c1a42a-8e60-4668-b7fa-0c4986beca4e","Type":"ContainerDied","Data":"166db19f9df9ce2dd077a6792b5db97bec285525f9ac2f2e9987f3fc2fbfd4b6"}
Jul 07 02:30:08.688979 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:08.688947    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:08.786488 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:08.786452    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wnj5\" (UniqueName: \"kubernetes.io/projected/57c1a42a-8e60-4668-b7fa-0c4986beca4e-kube-api-access-5wnj5\") pod \"57c1a42a-8e60-4668-b7fa-0c4986beca4e\" (UID: \"57c1a42a-8e60-4668-b7fa-0c4986beca4e\") "
Jul 07 02:30:08.788635 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:08.788600    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c1a42a-8e60-4668-b7fa-0c4986beca4e-kube-api-access-5wnj5" (OuterVolumeSpecName: "kube-api-access-5wnj5") pod "57c1a42a-8e60-4668-b7fa-0c4986beca4e" (UID: "57c1a42a-8e60-4668-b7fa-0c4986beca4e"). InnerVolumeSpecName "kube-api-access-5wnj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:30:08.887112 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:08.887023    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wnj5\" (UniqueName: \"kubernetes.io/projected/57c1a42a-8e60-4668-b7fa-0c4986beca4e-kube-api-access-5wnj5\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:30:09.559073 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:09.559041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8" event={"ID":"57c1a42a-8e60-4668-b7fa-0c4986beca4e","Type":"ContainerDied","Data":"95418d75819a1dec4c43d9d12154305b9f1d9ae3fcfd518e7755ed935f669bf7"}
Jul 07 02:30:09.559073 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:09.559072    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-8nvq8"
Jul 07 02:30:09.559238 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:30:09.559089    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95418d75819a1dec4c43d9d12154305b9f1d9ae3fcfd518e7755ed935f669bf7"
Jul 07 02:34:31.506600 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:34:31.506565    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:34:31.509587 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:34:31.509564    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:37:40.899821 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.899786    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"]
Jul 07 02:37:40.900239 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.900143    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c1a42a-8e60-4668-b7fa-0c4986beca4e" containerName="cleanup"
Jul 07 02:37:40.900239 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.900160    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c1a42a-8e60-4668-b7fa-0c4986beca4e" containerName="cleanup"
Jul 07 02:37:40.900307 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.900241    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c1a42a-8e60-4668-b7fa-0c4986beca4e" containerName="cleanup"
Jul 07 02:37:40.902806 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.902788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:40.905063 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.905039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-d01c49f5-serving-cert\""
Jul 07 02:37:40.905342 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.905325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2kkqn\""
Jul 07 02:37:40.915785 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:40.915761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"]
Jul 07 02:37:41.043799 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.043759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7de79038-d415-46ea-b5d0-3d3440f8cfc3-openshift-service-ca\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.043799 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.043803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdwrg\" (UniqueName: \"kubernetes.io/projected/7de79038-d415-46ea-b5d0-3d3440f8cfc3-kube-api-access-qdwrg\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.044027 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.043890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.145347 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.145310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.145507 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.145377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7de79038-d415-46ea-b5d0-3d3440f8cfc3-openshift-service-ca\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.145507 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.145399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdwrg\" (UniqueName: \"kubernetes.io/projected/7de79038-d415-46ea-b5d0-3d3440f8cfc3-kube-api-access-qdwrg\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.145507 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:37:41.145468    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-d01c49f5-serving-cert: secret "maas-api-e2e-ait-d01c49f5-serving-cert" not found
Jul 07 02:37:41.145628 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:37:41.145534    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls podName:7de79038-d415-46ea-b5d0-3d3440f8cfc3 nodeName:}" failed. No retries permitted until 2026-07-07 02:37:41.645515233 +0000 UTC m=+1690.664230164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls") pod "maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" (UID: "7de79038-d415-46ea-b5d0-3d3440f8cfc3") : secret "maas-api-e2e-ait-d01c49f5-serving-cert" not found
Jul 07 02:37:41.146029 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.146012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7de79038-d415-46ea-b5d0-3d3440f8cfc3-openshift-service-ca\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.158826 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.158764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdwrg\" (UniqueName: \"kubernetes.io/projected/7de79038-d415-46ea-b5d0-3d3440f8cfc3-kube-api-access-qdwrg\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.648905 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.648873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.651411 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.651390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls\") pod \"maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") " pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.813272 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.813241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:41.957944 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.957917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"]
Jul 07 02:37:41.960697 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:37:41.960660    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de79038_d415_46ea_b5d0_3d3440f8cfc3.slice/crio-50dc627fc2b39d7eec13bcc07a97c0705ae9299f65b2b19c94f771f3e0f0cfb3 WatchSource:0}: Error finding container 50dc627fc2b39d7eec13bcc07a97c0705ae9299f65b2b19c94f771f3e0f0cfb3: Status 404 returned error can't find the container with id 50dc627fc2b39d7eec13bcc07a97c0705ae9299f65b2b19c94f771f3e0f0cfb3
Jul 07 02:37:41.962269 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:41.962244    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:37:42.558543 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:42.558506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" event={"ID":"7de79038-d415-46ea-b5d0-3d3440f8cfc3","Type":"ContainerStarted","Data":"50dc627fc2b39d7eec13bcc07a97c0705ae9299f65b2b19c94f771f3e0f0cfb3"}
Jul 07 02:37:43.564275 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:43.564241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" event={"ID":"7de79038-d415-46ea-b5d0-3d3440f8cfc3","Type":"ContainerStarted","Data":"b525a956b487728e6abb935267718f37e132ab0e0f0b7936cbcae95608981bce"}
Jul 07 02:37:43.564742 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:43.564355    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:43.581839 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:43.581790    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" podStartSLOduration=2.105249703 podStartE2EDuration="3.581771714s" totalImagesPullingTime="1.476522011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:37:43.581039868 +0000 UTC m=+1692.599754833" watchObservedRunningTime="2026-07-07 02:37:43.581771714 +0000 UTC m=+1692.600486855"
Jul 07 02:37:46.344767 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.344734    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"]
Jul 07 02:37:46.345297 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.344939    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" podUID="7de79038-d415-46ea-b5d0-3d3440f8cfc3" containerName="maas-api" containerID="cri-o://b525a956b487728e6abb935267718f37e132ab0e0f0b7936cbcae95608981bce" gracePeriod=30
Jul 07 02:37:46.579728 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.579690    2562 generic.go:356] "Generic (PLEG): container finished" podID="7de79038-d415-46ea-b5d0-3d3440f8cfc3" containerID="b525a956b487728e6abb935267718f37e132ab0e0f0b7936cbcae95608981bce" exitCode=0
Jul 07 02:37:46.579933 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.579782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" event={"ID":"7de79038-d415-46ea-b5d0-3d3440f8cfc3","Type":"ContainerDied","Data":"b525a956b487728e6abb935267718f37e132ab0e0f0b7936cbcae95608981bce"}
Jul 07 02:37:46.598007 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.597937    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:46.694030 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.693998    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7de79038-d415-46ea-b5d0-3d3440f8cfc3-openshift-service-ca\") pod \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") "
Jul 07 02:37:46.694194 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.694097    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls\") pod \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") "
Jul 07 02:37:46.694278 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.694196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdwrg\" (UniqueName: \"kubernetes.io/projected/7de79038-d415-46ea-b5d0-3d3440f8cfc3-kube-api-access-qdwrg\") pod \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\" (UID: \"7de79038-d415-46ea-b5d0-3d3440f8cfc3\") "
Jul 07 02:37:46.694433 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.694412    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de79038-d415-46ea-b5d0-3d3440f8cfc3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7de79038-d415-46ea-b5d0-3d3440f8cfc3" (UID: "7de79038-d415-46ea-b5d0-3d3440f8cfc3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:37:46.696262 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.696239    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7de79038-d415-46ea-b5d0-3d3440f8cfc3" (UID: "7de79038-d415-46ea-b5d0-3d3440f8cfc3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:37:46.696317 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.696283    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de79038-d415-46ea-b5d0-3d3440f8cfc3-kube-api-access-qdwrg" (OuterVolumeSpecName: "kube-api-access-qdwrg") pod "7de79038-d415-46ea-b5d0-3d3440f8cfc3" (UID: "7de79038-d415-46ea-b5d0-3d3440f8cfc3"). InnerVolumeSpecName "kube-api-access-qdwrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:37:46.795148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.795122    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7de79038-d415-46ea-b5d0-3d3440f8cfc3-maas-api-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:37:46.795148 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.795144    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdwrg\" (UniqueName: \"kubernetes.io/projected/7de79038-d415-46ea-b5d0-3d3440f8cfc3-kube-api-access-qdwrg\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:37:46.795303 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:46.795156    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7de79038-d415-46ea-b5d0-3d3440f8cfc3-openshift-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:37:47.585405 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:47.585372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs" event={"ID":"7de79038-d415-46ea-b5d0-3d3440f8cfc3","Type":"ContainerDied","Data":"50dc627fc2b39d7eec13bcc07a97c0705ae9299f65b2b19c94f771f3e0f0cfb3"}
Jul 07 02:37:47.585797 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:47.585438    2562 scope.go:117] "RemoveContainer" containerID="b525a956b487728e6abb935267718f37e132ab0e0f0b7936cbcae95608981bce"
Jul 07 02:37:47.585797 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:47.585387    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"
Jul 07 02:37:47.601641 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:47.601616    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"]
Jul 07 02:37:47.605628 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:47.605604    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-d01c49f5-57df748b9b-kfggs"]
Jul 07 02:37:49.533241 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:37:49.533206    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de79038-d415-46ea-b5d0-3d3440f8cfc3" path="/var/lib/kubelet/pods/7de79038-d415-46ea-b5d0-3d3440f8cfc3/volumes"
Jul 07 02:38:11.934210 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.934171    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"]
Jul 07 02:38:11.934641 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.934511    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de79038-d415-46ea-b5d0-3d3440f8cfc3" containerName="maas-api"
Jul 07 02:38:11.934641 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.934523    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de79038-d415-46ea-b5d0-3d3440f8cfc3" containerName="maas-api"
Jul 07 02:38:11.934641 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.934594    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de79038-d415-46ea-b5d0-3d3440f8cfc3" containerName="maas-api"
Jul 07 02:38:11.937393 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.937377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:11.939805 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.939776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-c2f066bd-serving-cert\""
Jul 07 02:38:11.939946 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.939838    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2kkqn\""
Jul 07 02:38:11.949094 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:11.949067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"]
Jul 07 02:38:12.006705 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.006666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.006867 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.006722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-openshift-service-ca\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.006867 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.006807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr22c\" (UniqueName: \"kubernetes.io/projected/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-kube-api-access-jr22c\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.107471 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.107434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.107633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.107487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-openshift-service-ca\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.107633 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.107531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr22c\" (UniqueName: \"kubernetes.io/projected/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-kube-api-access-jr22c\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.107633 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:38:12.107590    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-c2f066bd-serving-cert: secret "maas-api-e2e-derive-c2f066bd-serving-cert" not found
Jul 07 02:38:12.107741 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:38:12.107666    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls podName:aff7a781-02bd-4d6f-a387-3e2bd573f8f4 nodeName:}" failed. No retries permitted until 2026-07-07 02:38:12.607649124 +0000 UTC m=+1721.626364057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls") pod "maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" (UID: "aff7a781-02bd-4d6f-a387-3e2bd573f8f4") : secret "maas-api-e2e-derive-c2f066bd-serving-cert" not found
Jul 07 02:38:12.108168 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.108148    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-openshift-service-ca\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.116065 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.116038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr22c\" (UniqueName: \"kubernetes.io/projected/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-kube-api-access-jr22c\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.613128 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.613087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.615682 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.615656    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls\") pod \"maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") " pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.848136 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.848095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:12.987411 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:12.987384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"]
Jul 07 02:38:12.989591 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:38:12.989559    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff7a781_02bd_4d6f_a387_3e2bd573f8f4.slice/crio-caf4ecf32fdd67d3529173bb7ccff1ef5af597665fe9c9217e26fcb45b506eff WatchSource:0}: Error finding container caf4ecf32fdd67d3529173bb7ccff1ef5af597665fe9c9217e26fcb45b506eff: Status 404 returned error can't find the container with id caf4ecf32fdd67d3529173bb7ccff1ef5af597665fe9c9217e26fcb45b506eff
Jul 07 02:38:13.708302 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:13.708269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" event={"ID":"aff7a781-02bd-4d6f-a387-3e2bd573f8f4","Type":"ContainerStarted","Data":"e2f738bd05cd3a5a0b2de7ebc4d39ca4f29e04a642aee8e3facdc52b719097ec"}
Jul 07 02:38:13.708462 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:13.708315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" event={"ID":"aff7a781-02bd-4d6f-a387-3e2bd573f8f4","Type":"ContainerStarted","Data":"caf4ecf32fdd67d3529173bb7ccff1ef5af597665fe9c9217e26fcb45b506eff"}
Jul 07 02:38:13.708462 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:13.708408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:13.726572 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:13.726524    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" podStartSLOduration=2.419667627 podStartE2EDuration="2.726508292s" totalImagesPullingTime="306.840665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:38:13.725413666 +0000 UTC m=+1722.744128615" watchObservedRunningTime="2026-07-07 02:38:13.726508292 +0000 UTC m=+1722.745223337"
Jul 07 02:38:16.590596 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.590507    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"]
Jul 07 02:38:16.591037 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.590721    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" podUID="aff7a781-02bd-4d6f-a387-3e2bd573f8f4" containerName="maas-api" containerID="cri-o://e2f738bd05cd3a5a0b2de7ebc4d39ca4f29e04a642aee8e3facdc52b719097ec" gracePeriod=30
Jul 07 02:38:16.729821 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.729783    2562 generic.go:356] "Generic (PLEG): container finished" podID="aff7a781-02bd-4d6f-a387-3e2bd573f8f4" containerID="e2f738bd05cd3a5a0b2de7ebc4d39ca4f29e04a642aee8e3facdc52b719097ec" exitCode=0
Jul 07 02:38:16.730009 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.729841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" event={"ID":"aff7a781-02bd-4d6f-a387-3e2bd573f8f4","Type":"ContainerDied","Data":"e2f738bd05cd3a5a0b2de7ebc4d39ca4f29e04a642aee8e3facdc52b719097ec"}
Jul 07 02:38:16.842934 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.842865    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:16.947093 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.947062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-openshift-service-ca\") pod \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") "
Jul 07 02:38:16.947268 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.947151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls\") pod \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") "
Jul 07 02:38:16.947268 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.947204    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr22c\" (UniqueName: \"kubernetes.io/projected/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-kube-api-access-jr22c\") pod \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\" (UID: \"aff7a781-02bd-4d6f-a387-3e2bd573f8f4\") "
Jul 07 02:38:16.947482 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.947458    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aff7a781-02bd-4d6f-a387-3e2bd573f8f4" (UID: "aff7a781-02bd-4d6f-a387-3e2bd573f8f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:38:16.949245 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.949221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aff7a781-02bd-4d6f-a387-3e2bd573f8f4" (UID: "aff7a781-02bd-4d6f-a387-3e2bd573f8f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:38:16.949371 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:16.949354    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-kube-api-access-jr22c" (OuterVolumeSpecName: "kube-api-access-jr22c") pod "aff7a781-02bd-4d6f-a387-3e2bd573f8f4" (UID: "aff7a781-02bd-4d6f-a387-3e2bd573f8f4"). InnerVolumeSpecName "kube-api-access-jr22c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:38:17.048005 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.047970    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-openshift-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:38:17.048005 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.047997    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-maas-api-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:38:17.048005 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.048007    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr22c\" (UniqueName: \"kubernetes.io/projected/aff7a781-02bd-4d6f-a387-3e2bd573f8f4-kube-api-access-jr22c\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:38:17.735226 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.735185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g" event={"ID":"aff7a781-02bd-4d6f-a387-3e2bd573f8f4","Type":"ContainerDied","Data":"caf4ecf32fdd67d3529173bb7ccff1ef5af597665fe9c9217e26fcb45b506eff"}
Jul 07 02:38:17.735226 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.735210    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"
Jul 07 02:38:17.735731 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.735249    2562 scope.go:117] "RemoveContainer" containerID="e2f738bd05cd3a5a0b2de7ebc4d39ca4f29e04a642aee8e3facdc52b719097ec"
Jul 07 02:38:17.751175 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.751144    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"]
Jul 07 02:38:17.754853 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:17.754830    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-c2f066bd-7fb4f9c8f4-9hf4g"]
Jul 07 02:38:19.533501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:38:19.533467    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff7a781-02bd-4d6f-a387-3e2bd573f8f4" path="/var/lib/kubelet/pods/aff7a781-02bd-4d6f-a387-3e2bd573f8f4/volumes"
Jul 07 02:39:31.534838 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:39:31.534809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:39:31.538716 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:39:31.538694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:43:24.211841 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.211804    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"]
Jul 07 02:43:24.212367 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.212216    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff7a781-02bd-4d6f-a387-3e2bd573f8f4" containerName="maas-api"
Jul 07 02:43:24.212367 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.212230    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff7a781-02bd-4d6f-a387-3e2bd573f8f4" containerName="maas-api"
Jul 07 02:43:24.212367 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.212305    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff7a781-02bd-4d6f-a387-3e2bd573f8f4" containerName="maas-api"
Jul 07 02:43:24.214524 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.214506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.217241 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.216848    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-902459-serving-cert\""
Jul 07 02:43:24.217241 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.216965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2kkqn\""
Jul 07 02:43:24.226126 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.226103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"]
Jul 07 02:43:24.323657 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.323619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d94808e-b12e-443b-be3e-f10a56433300-openshift-service-ca\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.323841 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.323686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdwxj\" (UniqueName: \"kubernetes.io/projected/8d94808e-b12e-443b-be3e-f10a56433300-kube-api-access-wdwxj\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.323841 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.323725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d94808e-b12e-443b-be3e-f10a56433300-maas-api-tls\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.424242 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.424206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdwxj\" (UniqueName: \"kubernetes.io/projected/8d94808e-b12e-443b-be3e-f10a56433300-kube-api-access-wdwxj\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.424426 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.424252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d94808e-b12e-443b-be3e-f10a56433300-maas-api-tls\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.424426 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.424300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d94808e-b12e-443b-be3e-f10a56433300-openshift-service-ca\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.425006 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.424981    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d94808e-b12e-443b-be3e-f10a56433300-openshift-service-ca\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.426828 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.426806    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d94808e-b12e-443b-be3e-f10a56433300-maas-api-tls\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.433067 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.433046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdwxj\" (UniqueName: \"kubernetes.io/projected/8d94808e-b12e-443b-be3e-f10a56433300-kube-api-access-wdwxj\") pod \"maas-api-e2e-inf-b-902459-675b897d7f-8gx6n\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") " pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.528082 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.527998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:24.659695 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.659669    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"]
Jul 07 02:43:24.662862 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:43:24.662824    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d94808e_b12e_443b_be3e_f10a56433300.slice/crio-84d48c60e697d1dd5d30d292a9a742d35d2506fd26a36f4945754cc004f05604 WatchSource:0}: Error finding container 84d48c60e697d1dd5d30d292a9a742d35d2506fd26a36f4945754cc004f05604: Status 404 returned error can't find the container with id 84d48c60e697d1dd5d30d292a9a742d35d2506fd26a36f4945754cc004f05604
Jul 07 02:43:24.664699 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:24.664680    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:43:25.099538 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:25.099502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n" event={"ID":"8d94808e-b12e-443b-be3e-f10a56433300","Type":"ContainerStarted","Data":"f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09"}
Jul 07 02:43:25.099712 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:25.099551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n" event={"ID":"8d94808e-b12e-443b-be3e-f10a56433300","Type":"ContainerStarted","Data":"84d48c60e697d1dd5d30d292a9a742d35d2506fd26a36f4945754cc004f05604"}
Jul 07 02:43:25.099712 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:25.099581    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:43:25.120557 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:25.120505    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n" podStartSLOduration=0.774954581 podStartE2EDuration="1.120490416s" totalImagesPullingTime="345.535835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:25.119520547 +0000 UTC m=+2034.138235500" watchObservedRunningTime="2026-07-07 02:43:25.120490416 +0000 UTC m=+2034.139205368"
Jul 07 02:43:31.109681 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:43:31.109648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:44:31.560326 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:44:31.560294    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:44:31.565044 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:44:31.565019    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:45:00.135452 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.135413    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723205-pvvvp"]
Jul 07 02:45:00.140056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.140030    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"]
Jul 07 02:45:00.140190 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.140146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:00.143083 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.143066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:00.149767 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.149743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723205-pvvvp"]
Jul 07 02:45:00.152583 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.152558    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"]
Jul 07 02:45:00.237837 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.237797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmgpw\" (UniqueName: \"kubernetes.io/projected/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23-kube-api-access-nmgpw\") pod \"maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z\" (UID: \"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:00.238059 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.237878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfn2x\" (UniqueName: \"kubernetes.io/projected/88b7baa6-a8db-411a-aa33-e7fd1cbab639-kube-api-access-kfn2x\") pod \"maas-api-key-cleanup-29723205-pvvvp\" (UID: \"88b7baa6-a8db-411a-aa33-e7fd1cbab639\") " pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:00.338654 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.338620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfn2x\" (UniqueName: \"kubernetes.io/projected/88b7baa6-a8db-411a-aa33-e7fd1cbab639-kube-api-access-kfn2x\") pod \"maas-api-key-cleanup-29723205-pvvvp\" (UID: \"88b7baa6-a8db-411a-aa33-e7fd1cbab639\") " pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:00.338817 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.338674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmgpw\" (UniqueName: \"kubernetes.io/projected/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23-kube-api-access-nmgpw\") pod \"maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z\" (UID: \"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:00.346998 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.346966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfn2x\" (UniqueName: \"kubernetes.io/projected/88b7baa6-a8db-411a-aa33-e7fd1cbab639-kube-api-access-kfn2x\") pod \"maas-api-key-cleanup-29723205-pvvvp\" (UID: \"88b7baa6-a8db-411a-aa33-e7fd1cbab639\") " pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:00.347373 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.347351    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmgpw\" (UniqueName: \"kubernetes.io/projected/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23-kube-api-access-nmgpw\") pod \"maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z\" (UID: \"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:00.452928 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.452815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:00.459776 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.459757    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:00.595547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.595456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723205-pvvvp"]
Jul 07 02:45:00.597437 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:45:00.597397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b7baa6_a8db_411a_aa33_e7fd1cbab639.slice/crio-044bfb18122848e70c1f7d451d4488803dc8669f3b33b5b6f05b8238e09688c8 WatchSource:0}: Error finding container 044bfb18122848e70c1f7d451d4488803dc8669f3b33b5b6f05b8238e09688c8: Status 404 returned error can't find the container with id 044bfb18122848e70c1f7d451d4488803dc8669f3b33b5b6f05b8238e09688c8
Jul 07 02:45:00.619996 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:00.619972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"]
Jul 07 02:45:00.636077 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:45:00.636045    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97796d5_4ffa_43ce_8a82_b60e9e3a4e23.slice/crio-5a835f1543854faf391d5c90759cabdc7fb41a27d98f268cb0087dd9ee6f6ef0 WatchSource:0}: Error finding container 5a835f1543854faf391d5c90759cabdc7fb41a27d98f268cb0087dd9ee6f6ef0: Status 404 returned error can't find the container with id 5a835f1543854faf391d5c90759cabdc7fb41a27d98f268cb0087dd9ee6f6ef0
Jul 07 02:45:01.535672 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:01.535624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z" event={"ID":"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23","Type":"ContainerStarted","Data":"869ca46413107f340d89c80949bfa26c73d2fab6905597122be2c1547812ad66"}
Jul 07 02:45:01.536071 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:01.535688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z" event={"ID":"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23","Type":"ContainerStarted","Data":"5a835f1543854faf391d5c90759cabdc7fb41a27d98f268cb0087dd9ee6f6ef0"}
Jul 07 02:45:01.537093 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:01.537066    2562 generic.go:356] "Generic (PLEG): container finished" podID="88b7baa6-a8db-411a-aa33-e7fd1cbab639" containerID="f5c1f8947607493174e91fd24eb3fa64493f258cbb1b6646c9b1c6a76c93468e" exitCode=0
Jul 07 02:45:01.537213 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:01.537128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp" event={"ID":"88b7baa6-a8db-411a-aa33-e7fd1cbab639","Type":"ContainerDied","Data":"f5c1f8947607493174e91fd24eb3fa64493f258cbb1b6646c9b1c6a76c93468e"}
Jul 07 02:45:01.537213 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:01.537158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp" event={"ID":"88b7baa6-a8db-411a-aa33-e7fd1cbab639","Type":"ContainerStarted","Data":"044bfb18122848e70c1f7d451d4488803dc8669f3b33b5b6f05b8238e09688c8"}
Jul 07 02:45:01.560700 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:01.560555    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z" podStartSLOduration=1.5605379369999999 podStartE2EDuration="1.560537937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:45:01.559236185 +0000 UTC m=+2130.577951138" watchObservedRunningTime="2026-07-07 02:45:01.560537937 +0000 UTC m=+2130.579252890"
Jul 07 02:45:02.543501 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:02.543465    2562 generic.go:356] "Generic (PLEG): container finished" podID="a97796d5-4ffa-43ce-8a82-b60e9e3a4e23" containerID="869ca46413107f340d89c80949bfa26c73d2fab6905597122be2c1547812ad66" exitCode=0
Jul 07 02:45:02.543956 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:02.543554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z" event={"ID":"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23","Type":"ContainerDied","Data":"869ca46413107f340d89c80949bfa26c73d2fab6905597122be2c1547812ad66"}
Jul 07 02:45:02.675787 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:02.675764    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:02.760051 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:02.760016    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfn2x\" (UniqueName: \"kubernetes.io/projected/88b7baa6-a8db-411a-aa33-e7fd1cbab639-kube-api-access-kfn2x\") pod \"88b7baa6-a8db-411a-aa33-e7fd1cbab639\" (UID: \"88b7baa6-a8db-411a-aa33-e7fd1cbab639\") "
Jul 07 02:45:02.762258 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:02.762237    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b7baa6-a8db-411a-aa33-e7fd1cbab639-kube-api-access-kfn2x" (OuterVolumeSpecName: "kube-api-access-kfn2x") pod "88b7baa6-a8db-411a-aa33-e7fd1cbab639" (UID: "88b7baa6-a8db-411a-aa33-e7fd1cbab639"). InnerVolumeSpecName "kube-api-access-kfn2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:45:02.861014 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:02.860917    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfn2x\" (UniqueName: \"kubernetes.io/projected/88b7baa6-a8db-411a-aa33-e7fd1cbab639-kube-api-access-kfn2x\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:45:03.549386 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.549362    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp"
Jul 07 02:45:03.549710 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.549406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-pvvvp" event={"ID":"88b7baa6-a8db-411a-aa33-e7fd1cbab639","Type":"ContainerDied","Data":"044bfb18122848e70c1f7d451d4488803dc8669f3b33b5b6f05b8238e09688c8"}
Jul 07 02:45:03.549710 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.549451    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="044bfb18122848e70c1f7d451d4488803dc8669f3b33b5b6f05b8238e09688c8"
Jul 07 02:45:03.682492 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.682469    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:03.769071 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.769024    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmgpw\" (UniqueName: \"kubernetes.io/projected/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23-kube-api-access-nmgpw\") pod \"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23\" (UID: \"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23\") "
Jul 07 02:45:03.771201 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.771177    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23-kube-api-access-nmgpw" (OuterVolumeSpecName: "kube-api-access-nmgpw") pod "a97796d5-4ffa-43ce-8a82-b60e9e3a4e23" (UID: "a97796d5-4ffa-43ce-8a82-b60e9e3a4e23"). InnerVolumeSpecName "kube-api-access-nmgpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:45:03.869948 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:03.869842    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmgpw\" (UniqueName: \"kubernetes.io/projected/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23-kube-api-access-nmgpw\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:45:04.555121 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:04.555089    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"
Jul 07 02:45:04.555469 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:04.555119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z" event={"ID":"a97796d5-4ffa-43ce-8a82-b60e9e3a4e23","Type":"ContainerDied","Data":"5a835f1543854faf391d5c90759cabdc7fb41a27d98f268cb0087dd9ee6f6ef0"}
Jul 07 02:45:04.555469 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:04.555160    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a835f1543854faf391d5c90759cabdc7fb41a27d98f268cb0087dd9ee6f6ef0"
Jul 07 02:45:11.517220 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.517179    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"]
Jul 07 02:45:11.517683 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.517512    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n" podUID="8d94808e-b12e-443b-be3e-f10a56433300" containerName="maas-api" containerID="cri-o://f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09" gracePeriod=30
Jul 07 02:45:11.581449 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.581400    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"]
Jul 07 02:45:11.582977 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.582956    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-902459-29723205-lcx5z"]
Jul 07 02:45:11.752934 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.752888    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:45:11.835762 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.835675    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdwxj\" (UniqueName: \"kubernetes.io/projected/8d94808e-b12e-443b-be3e-f10a56433300-kube-api-access-wdwxj\") pod \"8d94808e-b12e-443b-be3e-f10a56433300\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") "
Jul 07 02:45:11.835762 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.835736    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d94808e-b12e-443b-be3e-f10a56433300-openshift-service-ca\") pod \"8d94808e-b12e-443b-be3e-f10a56433300\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") "
Jul 07 02:45:11.835991 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.835789    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d94808e-b12e-443b-be3e-f10a56433300-maas-api-tls\") pod \"8d94808e-b12e-443b-be3e-f10a56433300\" (UID: \"8d94808e-b12e-443b-be3e-f10a56433300\") "
Jul 07 02:45:11.836160 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.836124    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d94808e-b12e-443b-be3e-f10a56433300-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d94808e-b12e-443b-be3e-f10a56433300" (UID: "8d94808e-b12e-443b-be3e-f10a56433300"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:45:11.838101 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.838061    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d94808e-b12e-443b-be3e-f10a56433300-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d94808e-b12e-443b-be3e-f10a56433300" (UID: "8d94808e-b12e-443b-be3e-f10a56433300"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:45:11.838232 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.838173    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d94808e-b12e-443b-be3e-f10a56433300-kube-api-access-wdwxj" (OuterVolumeSpecName: "kube-api-access-wdwxj") pod "8d94808e-b12e-443b-be3e-f10a56433300" (UID: "8d94808e-b12e-443b-be3e-f10a56433300"). InnerVolumeSpecName "kube-api-access-wdwxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:45:11.937173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.937137    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d94808e-b12e-443b-be3e-f10a56433300-openshift-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:45:11.937173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.937168    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d94808e-b12e-443b-be3e-f10a56433300-maas-api-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:45:11.937173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:11.937177    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdwxj\" (UniqueName: \"kubernetes.io/projected/8d94808e-b12e-443b-be3e-f10a56433300-kube-api-access-wdwxj\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:45:12.591351 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.591314    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d94808e-b12e-443b-be3e-f10a56433300" containerID="f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09" exitCode=0
Jul 07 02:45:12.591757 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.591355    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"
Jul 07 02:45:12.591757 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.591399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n" event={"ID":"8d94808e-b12e-443b-be3e-f10a56433300","Type":"ContainerDied","Data":"f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09"}
Jul 07 02:45:12.591757 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.591452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n" event={"ID":"8d94808e-b12e-443b-be3e-f10a56433300","Type":"ContainerDied","Data":"84d48c60e697d1dd5d30d292a9a742d35d2506fd26a36f4945754cc004f05604"}
Jul 07 02:45:12.591757 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.591474    2562 scope.go:117] "RemoveContainer" containerID="f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09"
Jul 07 02:45:12.600404 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.600387    2562 scope.go:117] "RemoveContainer" containerID="f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09"
Jul 07 02:45:12.600659 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:45:12.600640    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09\": container with ID starting with f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09 not found: ID does not exist" containerID="f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09"
Jul 07 02:45:12.600729 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.600667    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09"} err="failed to get container status \"f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09\": rpc error: code = NotFound desc = could not find container \"f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09\": container with ID starting with f38a25fefdf8426c30ccc88318794c680909db7a2e0738db64fbaddb9ff8ef09 not found: ID does not exist"
Jul 07 02:45:12.615359 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.615329    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"]
Jul 07 02:45:12.620116 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:12.620093    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-902459-675b897d7f-8gx6n"]
Jul 07 02:45:13.533190 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:13.533157    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d94808e-b12e-443b-be3e-f10a56433300" path="/var/lib/kubelet/pods/8d94808e-b12e-443b-be3e-f10a56433300/volumes"
Jul 07 02:45:13.533496 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:13.533483    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a97796d5-4ffa-43ce-8a82-b60e9e3a4e23" path="/var/lib/kubelet/pods/a97796d5-4ffa-43ce-8a82-b60e9e3a4e23/volumes"
Jul 07 02:45:58.993848 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.993814    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"]
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994159    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97796d5-4ffa-43ce-8a82-b60e9e3a4e23" containerName="cleanup"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994171    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97796d5-4ffa-43ce-8a82-b60e9e3a4e23" containerName="cleanup"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994186    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d94808e-b12e-443b-be3e-f10a56433300" containerName="maas-api"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994192    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d94808e-b12e-443b-be3e-f10a56433300" containerName="maas-api"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994201    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b7baa6-a8db-411a-aa33-e7fd1cbab639" containerName="cleanup"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994206    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b7baa6-a8db-411a-aa33-e7fd1cbab639" containerName="cleanup"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994256    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b7baa6-a8db-411a-aa33-e7fd1cbab639" containerName="cleanup"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994266    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97796d5-4ffa-43ce-8a82-b60e9e3a4e23" containerName="cleanup"
Jul 07 02:45:58.994517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.994272    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d94808e-b12e-443b-be3e-f10a56433300" containerName="maas-api"
Jul 07 02:45:58.997361 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:58.997341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.000133 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.000108    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2kkqn\""
Jul 07 02:45:59.000235 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.000197    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-f01161-serving-cert\""
Jul 07 02:45:59.009998 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.009973    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"]
Jul 07 02:45:59.028763 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.028738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.028890 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.028779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.028890 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.028798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cwwc\" (UniqueName: \"kubernetes.io/projected/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-kube-api-access-9cwwc\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.129825 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.129783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.129825 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.129819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cwwc\" (UniqueName: \"kubernetes.io/projected/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-kube-api-access-9cwwc\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.130054 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.129934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.130054 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:45:59.129968    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-f01161-serving-cert: secret "maas-api-e2e-shared-a-f01161-serving-cert" not found
Jul 07 02:45:59.130134 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:45:59.130056    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls podName:c8a38deb-5830-4f33-ab21-a0cbc34a64fa nodeName:}" failed. No retries permitted until 2026-07-07 02:45:59.630034477 +0000 UTC m=+2188.648749407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls") pod "maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" (UID: "c8a38deb-5830-4f33-ab21-a0cbc34a64fa") : secret "maas-api-e2e-shared-a-f01161-serving-cert" not found
Jul 07 02:45:59.130521 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.130504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.142484 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.142461    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cwwc\" (UniqueName: \"kubernetes.io/projected/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-kube-api-access-9cwwc\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.633979 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.633947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.636652 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.636614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls\") pod \"maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") " pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:45:59.908984 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:45:59.908877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:46:00.047729 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:46:00.047702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"]
Jul 07 02:46:00.050302 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:46:00.050269    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a38deb_5830_4f33_ab21_a0cbc34a64fa.slice/crio-2623ead95f8359ac6c279f4e240808dcbe96bd9fed99020b0d9c93deac5323a9 WatchSource:0}: Error finding container 2623ead95f8359ac6c279f4e240808dcbe96bd9fed99020b0d9c93deac5323a9: Status 404 returned error can't find the container with id 2623ead95f8359ac6c279f4e240808dcbe96bd9fed99020b0d9c93deac5323a9
Jul 07 02:46:00.808667 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:46:00.808568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" event={"ID":"c8a38deb-5830-4f33-ab21-a0cbc34a64fa","Type":"ContainerStarted","Data":"02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f"}
Jul 07 02:46:00.808804 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:46:00.808682    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:46:00.808804 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:46:00.808701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" event={"ID":"c8a38deb-5830-4f33-ab21-a0cbc34a64fa","Type":"ContainerStarted","Data":"2623ead95f8359ac6c279f4e240808dcbe96bd9fed99020b0d9c93deac5323a9"}
Jul 07 02:46:00.826419 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:46:00.826363    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" podStartSLOduration=2.396198038 podStartE2EDuration="2.826346438s" totalImagesPullingTime="430.1484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:46:00.825291847 +0000 UTC m=+2189.844006800" watchObservedRunningTime="2026-07-07 02:46:00.826346438 +0000 UTC m=+2189.845061389"
Jul 07 02:46:06.823766 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:46:06.823735    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:49:31.585263 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:49:31.585229    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:49:31.591549 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:49:31.591526    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:51:31.655770 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:31.655740    2562 scope.go:117] "RemoveContainer" containerID="869ca46413107f340d89c80949bfa26c73d2fab6905597122be2c1547812ad66"
Jul 07 02:51:36.267099 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.267060    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"]
Jul 07 02:51:36.267586 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.267291    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" podUID="c8a38deb-5830-4f33-ab21-a0cbc34a64fa" containerName="maas-api" containerID="cri-o://02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f" gracePeriod=30
Jul 07 02:51:36.516596 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.516568    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:51:36.581547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.581464    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls\") pod \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") "
Jul 07 02:51:36.581547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.581537    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-openshift-service-ca\") pod \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") "
Jul 07 02:51:36.581773 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.581558    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cwwc\" (UniqueName: \"kubernetes.io/projected/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-kube-api-access-9cwwc\") pod \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\" (UID: \"c8a38deb-5830-4f33-ab21-a0cbc34a64fa\") "
Jul 07 02:51:36.581932 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.581880    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8a38deb-5830-4f33-ab21-a0cbc34a64fa" (UID: "c8a38deb-5830-4f33-ab21-a0cbc34a64fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:36.583603 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.583572    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8a38deb-5830-4f33-ab21-a0cbc34a64fa" (UID: "c8a38deb-5830-4f33-ab21-a0cbc34a64fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:51:36.583698 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.583678    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-kube-api-access-9cwwc" (OuterVolumeSpecName: "kube-api-access-9cwwc") pod "c8a38deb-5830-4f33-ab21-a0cbc34a64fa" (UID: "c8a38deb-5830-4f33-ab21-a0cbc34a64fa"). InnerVolumeSpecName "kube-api-access-9cwwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:36.682421 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.682387    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-maas-api-tls\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:51:36.682421 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.682415    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-openshift-service-ca\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:51:36.682421 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:36.682424    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cwwc\" (UniqueName: \"kubernetes.io/projected/c8a38deb-5830-4f33-ab21-a0cbc34a64fa-kube-api-access-9cwwc\") on node \"ip-10-0-129-246.ec2.internal\" DevicePath \"\""
Jul 07 02:51:37.338624 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.338585    2562 generic.go:356] "Generic (PLEG): container finished" podID="c8a38deb-5830-4f33-ab21-a0cbc34a64fa" containerID="02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f" exitCode=0
Jul 07 02:51:37.339045 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.338631    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"
Jul 07 02:51:37.339045 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.338667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" event={"ID":"c8a38deb-5830-4f33-ab21-a0cbc34a64fa","Type":"ContainerDied","Data":"02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f"}
Jul 07 02:51:37.339045 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.338728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7" event={"ID":"c8a38deb-5830-4f33-ab21-a0cbc34a64fa","Type":"ContainerDied","Data":"2623ead95f8359ac6c279f4e240808dcbe96bd9fed99020b0d9c93deac5323a9"}
Jul 07 02:51:37.339045 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.338750    2562 scope.go:117] "RemoveContainer" containerID="02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f"
Jul 07 02:51:37.347651 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.347633    2562 scope.go:117] "RemoveContainer" containerID="02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f"
Jul 07 02:51:37.347973 ip-10-0-129-246 kubenswrapper[2562]: E0707 02:51:37.347951    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f\": container with ID starting with 02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f not found: ID does not exist" containerID="02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f"
Jul 07 02:51:37.348031 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.347983    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f"} err="failed to get container status \"02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f\": rpc error: code = NotFound desc = could not find container \"02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f\": container with ID starting with 02f8e9803de20c4012dd77e71ee274037345dafffbd2a327b2835982d145004f not found: ID does not exist"
Jul 07 02:51:37.358725 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.358702    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"]
Jul 07 02:51:37.364459 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.364436    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-f01161-75d6d87b7d-nb7d7"]
Jul 07 02:51:37.534058 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:51:37.534026    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a38deb-5830-4f33-ab21-a0cbc34a64fa" path="/var/lib/kubelet/pods/c8a38deb-5830-4f33-ab21-a0cbc34a64fa/volumes"
Jul 07 02:52:30.584751 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:30.584724    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rb5fj_0361d811-6ce1-42fb-a13d-c31544b2fc45/manager/0.log"
Jul 07 02:52:30.703230 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:30.703198    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j8cpp_d72ffd86-b591-432f-917b-a610ace57823/manager/0.log"
Jul 07 02:52:30.944999 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:30.944891    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723190-8nvq8_57c1a42a-8e60-4668-b7fa-0c4986beca4e/cleanup/0.log"
Jul 07 02:52:31.064990 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:31.064954    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723205-pvvvp_88b7baa6-a8db-411a-aa33-e7fd1cbab639/cleanup/0.log"
Jul 07 02:52:31.192124 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:31.192083    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d44d4f54-84g27_1112ec46-5aa0-4508-b39d-3dcca2fe4b65/manager/0.log"
Jul 07 02:52:31.309042 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:31.309014    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gh9xc_7992c896-e2c1-40f8-b9d7-8a000972e332/server/0.log"
Jul 07 02:52:31.429652 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:31.429617    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sbtbr_2429e661-c24b-4363-8922-8347814f6778/manager/0.log"
Jul 07 02:52:31.791555 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:31.791527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76797ccd4c-p5g9b_3f838223-4920-4b93-b0a6-e5e82e70f358/copy-manifests/0.log"
Jul 07 02:52:31.797710 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:31.797677    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76797ccd4c-p5g9b_3f838223-4920-4b93-b0a6-e5e82e70f358/manager/0.log"
Jul 07 02:52:34.084471 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:34.084438    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7n78m_06cccccf-b066-45c6-861b-71d6f2e6bb9c/manager/0.log"
Jul 07 02:52:34.575126 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:34.575091    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dsv9z_cce99def-f302-4df5-8ee4-785e47d28503/discovery/0.log"
Jul 07 02:52:34.814066 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:34.814035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-94d78774d-85ncg_2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9/kube-auth-proxy/0.log"
Jul 07 02:52:35.646848 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:35.646821    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-w85vh_ddf62b87-ca12-4355-9a38-c87f3fb50106/main/0.log"
Jul 07 02:52:35.763133 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:35.763106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9n4pc_235563b3-8ff6-4de3-a577-7e4a4d404b1b/main/0.log"
Jul 07 02:52:36.000455 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:36.000428    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2lvr4_9c94e918-b6e7-4961-8a41-67c75f7f1fe5/main/0.log"
Jul 07 02:52:42.867865 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:42.867831    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d2mxb_3483671b-37a1-486b-b6c1-a4783d063235/global-pull-secret-syncer/0.log"
Jul 07 02:52:43.029514 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:43.029469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8j42g_994816f2-6fef-4ed9-acfd-f129b249e094/konnectivity-agent/0.log"
Jul 07 02:52:43.078797 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:43.078762    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-246.ec2.internal_3f7c227f086314e8b066b539e30b1918/haproxy/0.log"
Jul 07 02:52:48.138265 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:48.138230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7n78m_06cccccf-b066-45c6-861b-71d6f2e6bb9c/manager/0.log"
Jul 07 02:52:50.152377 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:50.152342    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k78d_0aaaf9a7-7315-48cc-a276-32bde04af219/node-exporter/0.log"
Jul 07 02:52:50.192698 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:50.192674    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k78d_0aaaf9a7-7315-48cc-a276-32bde04af219/kube-rbac-proxy/0.log"
Jul 07 02:52:50.266866 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:50.266841    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k78d_0aaaf9a7-7315-48cc-a276-32bde04af219/init-textfile/0.log"
Jul 07 02:52:52.396864 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:52.396775    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-5md4h_983b7a5b-2217-4214-8cd5-9a55c15aad11/networking-console-plugin/0.log"
Jul 07 02:52:53.700183 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.700148    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"]
Jul 07 02:52:53.700636 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.700617    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a38deb-5830-4f33-ab21-a0cbc34a64fa" containerName="maas-api"
Jul 07 02:52:53.700636 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.700636    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a38deb-5830-4f33-ab21-a0cbc34a64fa" containerName="maas-api"
Jul 07 02:52:53.700763 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.700730    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a38deb-5830-4f33-ab21-a0cbc34a64fa" containerName="maas-api"
Jul 07 02:52:53.703782 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.703763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.706083 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.706062    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7l5m7\"/\"default-dockercfg-rbjgn\""
Jul 07 02:52:53.706173 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.706061    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7l5m7\"/\"openshift-service-ca.crt\""
Jul 07 02:52:53.706820 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.706804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7l5m7\"/\"kube-root-ca.crt\""
Jul 07 02:52:53.712678 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.712657    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"]
Jul 07 02:52:53.811684 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.811652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-proc\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.811839 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.811716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcx4c\" (UniqueName: \"kubernetes.io/projected/161623ad-5863-4097-9e1e-c7e7c69555b5-kube-api-access-lcx4c\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.811839 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.811758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-sys\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.811839 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.811778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-podres\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.811839 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.811804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-lib-modules\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912374 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcx4c\" (UniqueName: \"kubernetes.io/projected/161623ad-5863-4097-9e1e-c7e7c69555b5-kube-api-access-lcx4c\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-sys\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-podres\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-lib-modules\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-proc\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912547 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912482    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-sys\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912579    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-podres\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-proc\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.912755 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.912596    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161623ad-5863-4097-9e1e-c7e7c69555b5-lib-modules\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:53.921155 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:53.921134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcx4c\" (UniqueName: \"kubernetes.io/projected/161623ad-5863-4097-9e1e-c7e7c69555b5-kube-api-access-lcx4c\") pod \"perf-node-gather-daemonset-xt7vn\" (UID: \"161623ad-5863-4097-9e1e-c7e7c69555b5\") " pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:54.014766 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:54.014739    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:54.141368 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:54.141342    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"]
Jul 07 02:52:54.143391 ip-10-0-129-246 kubenswrapper[2562]: W0707 02:52:54.143357    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod161623ad_5863_4097_9e1e_c7e7c69555b5.slice/crio-b3e350d9f4bd1cc12c63283cbabeb5fc411fa91e1c83fcc6caa86bdd62e174c2 WatchSource:0}: Error finding container b3e350d9f4bd1cc12c63283cbabeb5fc411fa91e1c83fcc6caa86bdd62e174c2: Status 404 returned error can't find the container with id b3e350d9f4bd1cc12c63283cbabeb5fc411fa91e1c83fcc6caa86bdd62e174c2
Jul 07 02:52:54.687796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:54.687694    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn" event={"ID":"161623ad-5863-4097-9e1e-c7e7c69555b5","Type":"ContainerStarted","Data":"923e6dec9518d4b0565beafa4f5fc126a7950a447ac86fa73ff6137f917da5f5"}
Jul 07 02:52:54.687796 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:54.687751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn" event={"ID":"161623ad-5863-4097-9e1e-c7e7c69555b5","Type":"ContainerStarted","Data":"b3e350d9f4bd1cc12c63283cbabeb5fc411fa91e1c83fcc6caa86bdd62e174c2"}
Jul 07 02:52:54.688049 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:54.687861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:52:54.707490 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:54.707442    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn" podStartSLOduration=1.707424467 podStartE2EDuration="1.707424467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:52:54.706587906 +0000 UTC m=+2603.725302860" watchObservedRunningTime="2026-07-07 02:52:54.707424467 +0000 UTC m=+2603.726139419"
Jul 07 02:52:55.389916 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:55.389877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9f8vz_f2a6ea09-b08a-4157-8a97-fbe49f24585e/dns/0.log"
Jul 07 02:52:55.411151 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:55.411126    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9f8vz_f2a6ea09-b08a-4157-8a97-fbe49f24585e/kube-rbac-proxy/0.log"
Jul 07 02:52:55.528677 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:55.528651    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfqbq_0406dd5f-b302-46b9-82b7-5c31d0854612/dns-node-resolver/0.log"
Jul 07 02:52:56.123915 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:56.123875    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sq475_443ab38e-9d9d-4ff0-b3b8-f9eaa5796010/node-ca/0.log"
Jul 07 02:52:57.150310 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:57.150280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dsv9z_cce99def-f302-4df5-8ee4-785e47d28503/discovery/0.log"
Jul 07 02:52:57.195131 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:57.195103    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-94d78774d-85ncg_2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9/kube-auth-proxy/0.log"
Jul 07 02:52:58.031132 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:58.031103    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntczb_736403bf-f977-403e-b3c0-3193dcf541ed/serve-healthcheck-canary/0.log"
Jul 07 02:52:58.690327 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:58.690290    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sskpx_93f410f1-ddac-49a4-af52-9ecbc3176a5b/kube-rbac-proxy/0.log"
Jul 07 02:52:58.711041 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:58.711016    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sskpx_93f410f1-ddac-49a4-af52-9ecbc3176a5b/exporter/0.log"
Jul 07 02:52:58.732486 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:52:58.732466    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sskpx_93f410f1-ddac-49a4-af52-9ecbc3176a5b/extractor/0.log"
Jul 07 02:53:00.702160 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:00.702133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7l5m7/perf-node-gather-daemonset-xt7vn"
Jul 07 02:53:00.980984 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:00.980955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rb5fj_0361d811-6ce1-42fb-a13d-c31544b2fc45/manager/0.log"
Jul 07 02:53:01.109263 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.109228    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j8cpp_d72ffd86-b591-432f-917b-a610ace57823/manager/0.log"
Jul 07 02:53:01.163792 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.163762    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723190-8nvq8_57c1a42a-8e60-4668-b7fa-0c4986beca4e/cleanup/0.log"
Jul 07 02:53:01.187559 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.187527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723205-pvvvp_88b7baa6-a8db-411a-aa33-e7fd1cbab639/cleanup/0.log"
Jul 07 02:53:01.284056 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.283971    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d44d4f54-84g27_1112ec46-5aa0-4508-b39d-3dcca2fe4b65/manager/0.log"
Jul 07 02:53:01.306332 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.306303    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gh9xc_7992c896-e2c1-40f8-b9d7-8a000972e332/server/0.log"
Jul 07 02:53:01.368823 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.368791    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sbtbr_2429e661-c24b-4363-8922-8347814f6778/manager/0.log"
Jul 07 02:53:01.538988 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.538911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76797ccd4c-p5g9b_3f838223-4920-4b93-b0a6-e5e82e70f358/manager/0.log"
Jul 07 02:53:01.559517 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:01.559486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76797ccd4c-p5g9b_3f838223-4920-4b93-b0a6-e5e82e70f358/copy-manifests/0.log"
Jul 07 02:53:02.859625 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:02.859589    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xknb6_a478aeaf-ed7f-4cf5-8147-63e9e012270a/openshift-lws-operator/0.log"
Jul 07 02:53:03.598380 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:03.598343    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dsv9z_cce99def-f302-4df5-8ee4-785e47d28503/discovery/0.log"
Jul 07 02:53:03.628111 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:03.628086    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-94d78774d-85ncg_2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9/kube-auth-proxy/0.log"
Jul 07 02:53:05.258985 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:05.258946    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dsv9z_cce99def-f302-4df5-8ee4-785e47d28503/discovery/0.log"
Jul 07 02:53:05.289429 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:05.289399    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-94d78774d-85ncg_2d0fd80d-20a5-41e2-a8b0-cc067b13dfb9/kube-auth-proxy/0.log"
Jul 07 02:53:09.614556 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.614526    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6nzvk_2678f7b0-5d56-4982-b6a9-42cbf9d53425/kube-multus/0.log"
Jul 07 02:53:09.822395 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.822367    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/kube-multus-additional-cni-plugins/0.log"
Jul 07 02:53:09.841731 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.841709    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/egress-router-binary-copy/0.log"
Jul 07 02:53:09.863161 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.863130    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/cni-plugins/0.log"
Jul 07 02:53:09.901194 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.901117    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/bond-cni-plugin/0.log"
Jul 07 02:53:09.925645 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.925621    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/routeoverride-cni/0.log"
Jul 07 02:53:09.950545 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.950513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/whereabouts-cni-bincopy/0.log"
Jul 07 02:53:09.969772 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:09.969746    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rx725_a33e5efb-95d3-4dca-b90d-e6d8f072085c/whereabouts-cni/0.log"
Jul 07 02:53:10.259340 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:10.259315    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cv6l6_74996c74-f396-44e7-9ae9-5084d8175756/network-metrics-daemon/0.log"
Jul 07 02:53:10.279845 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:10.279800    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cv6l6_74996c74-f396-44e7-9ae9-5084d8175756/kube-rbac-proxy/0.log"
Jul 07 02:53:11.165609 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.165581    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-controller/0.log"
Jul 07 02:53:11.183153 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.183114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/1.log"
Jul 07 02:53:11.183153 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.183152    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovn-acl-logging/0.log"
Jul 07 02:53:11.204019 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.203995    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/kube-rbac-proxy-node/0.log"
Jul 07 02:53:11.228049 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.228024    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 02:53:11.251951 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.251924    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/northd/0.log"
Jul 07 02:53:11.273043 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.273019    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/nbdb/0.log"
Jul 07 02:53:11.294167 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.294131    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/sbdb/0.log"
Jul 07 02:53:11.341906 ip-10-0-129-246 kubenswrapper[2562]: I0707 02:53:11.341877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fddr_0a02b7cc-884e-4087-9222-5a1876bca3d3/ovnkube-controller/0.log"